Jun 23 16:20:37 devstack cinder-volume[82289]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 23 16:20:37 devstack cinder-volume[82289]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 23 16:20:37 devstack cinder-volume[82289]: we strongly recommend against using it for new projects. Jun 23 16:20:37 devstack cinder-volume[82289]: If you are already using Eventlet, we recommend migrating to a different Jun 23 16:20:37 devstack cinder-volume[82289]: framework. For more detail see Jun 23 16:20:37 devstack cinder-volume[82289]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 23 16:20:37 devstack cinder-volume[82289]: import eventlet # noqa Jun 23 16:20:39 devstack cinder-volume[82289]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 23 16:20:39 devstack cinder-volume[82289]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 23 16:20:39 devstack cinder-volume[82289]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 23 16:20:40 devstack cinder-volume[82289]: INFO dbcounter [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] Registered counter for database cinder Jun 23 16:20:40 devstack cinder-volume[82289]: DEBUG oslo_db.sqlalchemy.engines [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82289) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 16:20:41 devstack cinder-volume[82289]: DEBUG dbcounter [-] [82289] Writer thread running {{(pid=82289) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 23 16:20:41 devstack cinder-volume[82289]: INFO cinder.rpc [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 23 16:20:41 devstack cinder-volume[82289]: INFO cinder.rpc [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 23 16:20:41 devstack cinder-volume[82289]: DEBUG oslo_db.sqlalchemy.engines [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82289) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 16:20:41 devstack cinder-volume[82289]: INFO cinder.volume.manager [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] Determined volume DB was empty at startup. Jun 23 16:20:41 devstack cinder-volume[82289]: DEBUG cinder.volume.manager [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82289) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 23 16:20:41 devstack cinder-volume[82289]: INFO cinder.volume.manager [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 23 16:20:41 devstack cinder-volume[82289]: WARNING stevedore.named [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 23 16:20:41 devstack cinder-volume[82289]: WARNING castellan.key_manager [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 23 16:20:41 devstack cinder-volume[82289]: WARNING cinder.keymgr.conf_key_mgr [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 23 16:20:41 devstack cinder-volume[82289]: DEBUG cinder.volume.drivers.lvm [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=82289) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jun 23 16:20:41 devstack cinder-volume[82289]: DEBUG oslo_concurrency.processutils [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=82289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:20:41 devstack cinder-volume[82289]: DEBUG oslo_concurrency.processutils [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] CMD "cinder-rtstool verify" returned: 0 in 0.422s {{(pid=82289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:20:41 devstack cinder-volume[82289]: DEBUG oslo_db.sqlalchemy.engines [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82289) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 16:20:41 devstack cinder-volume[82289]: INFO cinder.rpc [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jun 23 16:20:41 devstack cinder-volume[82289]: INFO cinder.rpc [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jun 23 16:20:41 devstack cinder-volume[82289]: WARNING stevedore.named [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 23 16:20:41 devstack cinder-volume[82289]: WARNING castellan.key_manager [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 23 16:20:41 devstack cinder-volume[82289]: INFO cinder.volume.manager [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jun 23 16:20:41 devstack cinder-volume[82289]: DEBUG oslo_db.sqlalchemy.engines [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82289) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 16:20:41 devstack cinder-volume[82289]: INFO oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] Starting 1 workers Jun 23 16:20:41 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] Started child 82445 {{(pid=82289) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 23 16:20:41 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] Full set of CONF: {{(pid=82289) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 23 16:20:41 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] ******************************************************************************** {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 23 16:20:41 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] Configuration options gathered from: {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 23 16:20:41 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 23 16:20:41 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 23 16:20:41 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] ================================================================================ {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 23 16:20:41 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] allow_availability_zone_fallback = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:41 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] allow_compression_on_image_upload = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:41 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] allowed_direct_url_schemes = [] {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:41 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] api_rate_limit = True {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:41 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] auth_strategy = keystone {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:41 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] az_cache_duration = 3600 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:41 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_availability_zone = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:41 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_host = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:41 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_name = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:41 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_stats_polling_interval = 60 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:41 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backup_api_class = cinder.backup.api.API {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:41 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:41 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backup_name_template = backup-%s {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:41 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backup_use_same_host = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:41 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backup_use_temp_snapshot = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:41 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] chap_password = **** {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:41 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] chap_username = {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:41 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:41 devstack cinder-volume[82445]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] cinder_internal_tenant_project_id = ad90cfdf66bd4d56a7bb44a6d5a966cd {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] cinder_internal_tenant_user_id = 31ba3bd9a53a4adb8ba5794ed3d268d3 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] cloned_volume_same_az = True {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] cluster = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] compression_format = gzip {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] compute_api_class = cinder.compute.nova.API {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] config_dir = [] {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] config_source = [] {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] control_exchange = openstack {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] debug = True {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] default_availability_zone = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] default_group_type = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] default_volume_type = lvmdriver-1 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] disk_geometry = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] driver_client_cert = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] driver_client_cert_key = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] driver_data_namespace = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] driver_ssl_cert_path = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] driver_ssl_cert_verify = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] driver_use_ssl = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] enable_force_upload = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] enable_new_services = True {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] enable_unsupported_driver = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] enabled_backends = ['lvmdriver-1'] {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] enforce_multipath_for_image_xfer = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] filter_function = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] glance_api_insecure = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] glance_api_servers = ['http://192.168.122.106/image'] {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] glance_api_ssl_compression = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] glance_ca_certificates_file = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] glance_catalog_info = image:glance:publicURL {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] glance_certfile = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] glance_keyfile = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] glance_num_retries = 3 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] glance_request_timeout = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] goodness_function = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] graceful_shutdown_timeout = 5 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] group_api_class = cinder.group.api.API {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] host = devstack {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] image_compress_on_upload = True {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] image_conversion_address_space_limit = 1 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] image_conversion_cpu_limit = 60 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] image_conversion_disable = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] image_upload_use_cinder_backend = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] image_upload_use_internal_tenant = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] image_volume_cache_enabled = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] image_volume_cache_max_count = 0 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] image_volume_cache_max_size_gb = 0 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] init_host_max_objects_retrieval = 0 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] instance_format = [instance: %(uuid)s] {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] iscsi_target_flags = {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] iscsi_write_cache = on {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] iser_helper = tgtadm {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] iser_ip_address = 192.168.122.106 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] iser_port = 3260 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] log_color = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] log_config_append = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] log_dir = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] log_file = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] log_options = True {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] log_rotate_interval = 1 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] log_rotate_interval_type = days {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] log_rotation_type = none {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] max_age = 0 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] max_logfile_count = 30 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] max_logfile_size_mb = 200 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] max_over_subscription_ratio = 20.0 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] message_reap_interval = 86400 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] message_ttl = 2592000 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] migration_create_volume_timeout_secs = 300 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] monkey_patch = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] monkey_patch_modules = [] {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] my_ip = 192.168.122.106 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] no_snapshot_gb_quota = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] num_iser_scan_tries = 3 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] num_shell_tries = 3 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] num_volume_device_scan_tries = 3 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] nvmeof_conn_info_version = 1 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] nvmet_ns_id = 10 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] nvmet_port_id = 1 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] osapi_max_limit = 1000 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] osapi_volume_ext_list = [] {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] osapi_volume_listen_port = 8776 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] osapi_volume_use_ssl = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] osapi_volume_workers = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] per_volume_size_limit = -1 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] periodic_fuzzy_delay = 60 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] periodic_interval = 60 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] public_endpoint = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] publish_errors = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] quota_backup_gigabytes = 1000 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] quota_backups = 10 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] quota_gigabytes = 1000 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] quota_groups = 10 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] quota_snapshots = 10 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] quota_volumes = 10 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] rate_limit_burst = 0 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] rate_limit_except_level = CRITICAL {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] rate_limit_interval = 0 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] reinit_driver_count = 3 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] replication_device = **** {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] report_discard_supported = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] report_interval = 120 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] reservation_clean_interval = 86400 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] reservation_expire = 86400 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] reserved_image_namespaces = [] {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] reserved_percentage = 0 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82445]: INFO cinder.volume.manager [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] rpc_response_timeout = 120 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] run_external_periodic_tasks = True {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] scst_target_driver = iscsi {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] scst_target_iqn_name = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] service_down_time = 720 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] shell_completion = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] snapshot_name_template = snapshot-%s {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] snapshot_same_host = True {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] split_loggers = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] state_path = /opt/stack/data/cinder {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] storage_availability_zone = nova {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] storage_protocol = iSCSI {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] syslog_log_facility = LOG_USER {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] target_helper = lioadm {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] target_ip_address = 192.168.122.106 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] target_port = 3260 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] target_protocol = iscsi {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] target_secondary_ip_addresses = [] {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] trace_flags = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] transport_url = **** {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] until_refresh = 0 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] use_chap_auth = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] use_default_quota_class = True {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] use_journal = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] use_json = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] use_multipath_for_image_xfer = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] use_stderr = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] use_syslog = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] verify_glance_signatures = enabled {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] volume_api_class = cinder.volume.api.API {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] volume_backend_name = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] volume_clear = zero {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] volume_clear_ionice = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] volume_clear_size = 0 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] volume_copy_bps_limit = 0 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] volume_dd_blocksize = 1M {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] volume_name_template = volume-%s {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] volume_service_inithost_offload = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] volume_usage_audit_period = month {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] zoning_mode = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_concurrency.disable_process_locking = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] keystone_authtoken.auth_section = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] keystone_authtoken.auth_type = password {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] keystone_authtoken.auth_version = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] keystone_authtoken.cache = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] keystone_authtoken.certfile = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] keystone_authtoken.include_service_catalog = True {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] keystone_authtoken.insecure = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] keystone_authtoken.interface = public {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] keystone_authtoken.keyfile = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.055s {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] keystone_authtoken.memcache_password = {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] keystone_authtoken.memcache_username = {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] keystone_authtoken.region_name = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] keystone_authtoken.service_token_roles_required = True {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] keystone_authtoken.service_type = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.106/identity {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] cache.backend = dogpile.cache.null {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] cache.backend_argument = **** {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] cache.backend_expiration_time = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] cache.config_prefix = cache.oslo {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] cache.debug_cache_backend = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] cache.enable_retry_client = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] cache.enable_socket_keepalive = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] cache.enabled = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] cache.expiration_time = 600 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] cache.hashclient_retry_attempts = 2 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] cache.memcache_dead_retry = 300 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] cache.memcache_pool_maxsize = 10 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] cache.memcache_sasl_enabled = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] cache.password = **** {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] cache.proxies = [] {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] cache.redis_db = 0 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] cache.redis_server = localhost:6379 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] cache.retry_attempts = 2 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] cache.retry_delay = 0.0 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] cache.socket_keepalive_count = 1 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] cache.socket_keepalive_idle = 1 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] cache.socket_keepalive_interval = 1 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] cache.socket_timeout = 1.0 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] cache.tls_allowed_ciphers = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] cache.tls_cafile = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] cache.tls_certfile = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] cache.tls_enabled = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] cache.tls_keyfile = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] cache.username = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] coordination.backend_url = **** {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] database.asyncio_connection = **** {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] database.asyncio_slave_connection = **** {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] database.backend = sqlalchemy {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] database.connection = **** {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] database.connection_debug = 0 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] database.connection_parameters = {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] database.connection_recycle_time = 3600 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] database.connection_trace = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] database.db_inc_retry_interval = True {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] database.db_max_retries = 20 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] database.db_max_retry_interval = 10 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] database.db_retry_interval = 1 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] database.max_overflow = 50 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] database.max_pool_size = 5 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] database.max_retries = 10 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] database.mysql_wsrep_sync_wait = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] database.pool_timeout = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] database.retry_interval = 10 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] database.slave_connection = **** {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] database.sqlite_synchronous = True {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] database.synchronous_reader = True {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] database.use_db_reconnect = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] profiler.connection_string = messaging:// {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] profiler.enabled = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] profiler.es_doc_type = notification {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] profiler.es_scroll_size = 10000 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] profiler.es_scroll_time = 2m {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] profiler.filter_error_trace = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] profiler.hmac_keys = **** {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] profiler.sentinel_service_name = mymaster {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] profiler.socket_timeout = 0.1 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] profiler.trace_requests = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] profiler.trace_sqlalchemy = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] profiler_jaeger.process_tags = {} {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] profiler_jaeger.service_name_prefix = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] profiler_otlp.service_name_prefix = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_policy.enforce_new_defaults = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:20:42 devstack cinder-volume[82289]: WARNING oslo_config.cfg [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_policy.enforce_scope = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_policy.policy_default_rule = default {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_policy.policy_file = policy.yaml {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] privsep_osbrick.group = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] privsep_osbrick.helper_command = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] privsep_osbrick.user = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] cinder_sys_admin.group = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] cinder_sys_admin.helper_command = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] cinder_sys_admin.user = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] service_user.auth_section = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] service_user.auth_type = password {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] service_user.cafile = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] service_user.certfile = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] service_user.collect_timing = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] service_user.insecure = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] service_user.keyfile = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] service_user.send_service_user_token = True {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] service_user.split_loggers = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] service_user.timeout = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] glance.auth_section = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] glance.auth_type = password {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] glance.certfile = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] glance.collect_timing = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] glance.insecure = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] glance.keyfile = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] glance.region_name = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] glance.split_loggers = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] glance.timeout = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.backend_availability_zone = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.chap_password = **** {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.chap_username = {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.disk_geometry = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.driver_client_cert = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.driver_client_cert_key = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.driver_data_namespace = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.driver_use_ssl = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.extra_capabilities = {} {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.filter_function = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.goodness_function = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.iscsi_target_flags = {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.iscsi_write_cache = on {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.iser_helper = tgtadm {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.iser_ip_address = 192.168.122.106 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.iser_port = 3260 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.lvm_mirrors = 0 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.lvm_share_target = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.lvm_type = auto {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.num_shell_tries = 3 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.replication_device = **** {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.report_discard_supported = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.reserved_percentage = 0 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack sudo[82450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.target_helper = tgtadm {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack sudo[82450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.target_ip_address = 192.168.122.106 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.target_port = 3260 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.target_protocol = iscsi {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.trace_flags = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.unique_fqdn_network = True {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.use_chap_auth = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.volume_backend_name = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.volume_clear = zero {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.volume_clear_ionice = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.volume_clear_size = 0 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.volume_group = cinder-volumes {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_reports.file_event_handler = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_reports.log_dir = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.backend_availability_zone = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.backend_host = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.chap_password = **** {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.chap_username = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.chiscsi_conf = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.disk_geometry = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.driver_client_cert = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.driver_data_namespace = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.driver_use_ssl = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.extra_capabilities = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.filter_function = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.goodness_function = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.iser_helper = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.iser_ip_address = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.iser_port = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.iser_target_prefix = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.lvm_conf_file = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.lvm_mirrors = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.lvm_share_target = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.lvm_type = auto {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.num_shell_tries = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.nvmet_port_id = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.replication_device = **** {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.report_discard_supported = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.reserved_percentage = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.scst_target_driver = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.storage_protocol = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.target_helper = lioadm {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.target_ip_address = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.target_port = 3260 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.target_protocol = iscsi {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.trace_flags = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.use_chap_auth = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.volume_clear = zero {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.volume_clear_size = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] lvmdriver-1.volumes_dir = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_messaging_rabbit.ssl = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_messaging_notifications.driver = [] {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_messaging_notifications.retry = -1 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] key_manager.fixed_key = **** {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] barbican.barbican_api_version = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] barbican.barbican_endpoint = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] barbican.barbican_endpoint_type = public {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] barbican.barbican_region_name = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] barbican.cafile = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] barbican.certfile = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] barbican.collect_timing = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] barbican.insecure = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] barbican.keyfile = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] barbican.number_of_retries = 60 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] barbican.retry_delay = 1 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] barbican.send_service_user_token = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] barbican.split_loggers = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] barbican.timeout = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] barbican.verify_ssl = True {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] barbican.verify_ssl_path = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] barbican_service_user.auth_section = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] barbican_service_user.auth_type = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] barbican_service_user.cafile = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] barbican_service_user.certfile = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] barbican_service_user.collect_timing = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] barbican_service_user.insecure = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] barbican_service_user.keyfile = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] barbican_service_user.split_loggers = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] barbican_service_user.timeout = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] vault.approle_role_id = **** {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] vault.approle_secret_id = **** {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] vault.kv_mountpoint = secret {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] vault.kv_path = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] vault.kv_version = 2 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] vault.namespace = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] vault.root_token_id = **** {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] vault.ssl_ca_crt_file = None {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] vault.timeout = 60.0 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] vault.use_ssl = False {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:20:42 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] ******************************************************************************** {{(pid=82289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 23 16:20:42 devstack sudo[82450]: pam_unix(sudo:session): session closed for user root Jun 23 16:20:42 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.770s {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:20:42 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:20:42 devstack sudo[82455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 16:20:42 devstack sudo[82455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:20:43 devstack sudo[82455]: pam_unix(sudo:session): session closed for user root Jun 23 16:20:43 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.713s {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:20:43 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:20:43 devstack cinder-volume[82445]: INFO cinder.brick.local_dev.lvm [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jun 23 16:20:43 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:20:43 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:20:43 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:20:43 devstack sudo[82727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 16:20:43 devstack sudo[82727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:20:44 devstack sudo[82727]: pam_unix(sudo:session): session closed for user root Jun 23 16:20:44 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.707s {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:20:44 devstack cinder-volume[82445]: DEBUG cinder.brick.local_dev.lvm [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=82445) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jun 23 16:20:44 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:20:44 devstack sudo[82934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 16:20:44 devstack sudo[82934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:20:45 devstack sudo[82934]: pam_unix(sudo:session): session closed for user root Jun 23 16:20:45 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.595s {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:20:45 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:20:46 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:20:46 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:20:46 devstack sudo[83207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 16:20:46 devstack sudo[83207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:20:46 devstack sudo[83207]: pam_unix(sudo:session): session closed for user root Jun 23 16:20:46 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.718s {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:20:46 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:20:46 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:20:46 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:20:46 devstack sudo[83238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jun 23 16:20:46 devstack sudo[83238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:20:47 devstack sudo[83238]: pam_unix(sudo:session): session closed for user root Jun 23 16:20:47 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 1.008s {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:20:47 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:20:47 devstack sudo[83243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 16:20:47 devstack sudo[83243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:20:48 devstack sudo[83243]: pam_unix(sudo:session): session closed for user root Jun 23 16:20:48 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.873s {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:20:48 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:20:48 devstack sudo[83254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 16:20:48 devstack sudo[83254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:20:49 devstack sudo[83254]: pam_unix(sudo:session): session closed for user root Jun 23 16:20:49 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.792s {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:20:49 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:20:49 devstack sudo[83261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 16:20:49 devstack sudo[83261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:20:50 devstack sudo[83261]: pam_unix(sudo:session): session closed for user root Jun 23 16:20:50 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.785s {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:20:50 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:20:50 devstack sudo[83269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 16:20:50 devstack sudo[83269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:20:50 devstack sudo[83269]: pam_unix(sudo:session): session closed for user root Jun 23 16:20:50 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.645s {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:20:50 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:20:50 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:20:50 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:20:50 devstack sudo[83273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 16:20:50 devstack sudo[83273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:20:51 devstack sudo[83273]: pam_unix(sudo:session): session closed for user root Jun 23 16:20:51 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.916s {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:20:51 devstack cinder-volume[82445]: INFO cinder.volume.drivers.lvm [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jun 23 16:20:51 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:20:51 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:20:51 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:20:51 devstack sudo[83393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 16:20:51 devstack sudo[83393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:20:51 devstack cinder-volume[82289]: DEBUG dbcounter [-] [82289] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=82289) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:20:52 devstack sudo[83393]: pam_unix(sudo:session): session closed for user root Jun 23 16:20:52 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.694s {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:20:52 devstack cinder-volume[82445]: DEBUG cinder.volume.drivers.lvm [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] Updating volume stats {{(pid=82445) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 23 16:20:52 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:20:52 devstack sudo[83448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 16:20:52 devstack sudo[83448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:20:53 devstack sudo[83448]: pam_unix(sudo:session): session closed for user root Jun 23 16:20:53 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.630s {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:20:53 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:20:53 devstack sudo[83540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 16:20:53 devstack sudo[83540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:20:53 devstack sudo[83540]: pam_unix(sudo:session): session closed for user root Jun 23 16:20:53 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.638s {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:20:53 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:20:53 devstack sudo[83544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 16:20:53 devstack sudo[83544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:20:54 devstack sudo[83544]: pam_unix(sudo:session): session closed for user root Jun 23 16:20:54 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.632s {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:20:54 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:20:54 devstack sudo[83547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 16:20:54 devstack sudo[83547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:20:55 devstack sudo[83547]: pam_unix(sudo:session): session closed for user root Jun 23 16:20:55 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.660s {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:20:55 devstack cinder-volume[82445]: INFO cinder.volume.driver [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] Driver hasn't implemented _init_vendor_properties() Jun 23 16:20:55 devstack cinder-volume[82445]: DEBUG cinder.volume.driver [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82445) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 23 16:20:55 devstack cinder-volume[82445]: DEBUG oslo_db.sqlalchemy.engines [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82445) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 16:20:55 devstack cinder-volume[82445]: DEBUG dbcounter [-] [82445] Writer thread running {{(pid=82445) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 23 16:20:55 devstack cinder-volume[82445]: DEBUG cinder.db.api [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] Building query based on filter {{(pid=82445) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 23 16:20:55 devstack cinder-volume[82445]: DEBUG cinder.image.image_utils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82445) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 23 16:20:55 devstack cinder-volume[82445]: INFO cinder.keymgr.migration [None req-64e0f53e-105f-4360-8437-80294e44cc86 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 23 16:20:55 devstack cinder-volume[82445]: DEBUG cinder.volume.drivers.lvm [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] Updating volume stats {{(pid=82445) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 23 16:20:55 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:20:55 devstack sudo[83552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 16:20:55 devstack sudo[83552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:20:55 devstack sudo[83552]: pam_unix(sudo:session): session closed for user root Jun 23 16:20:55 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.685s {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:20:55 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:20:55 devstack sudo[83558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 16:20:55 devstack sudo[83558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:20:56 devstack sudo[83558]: pam_unix(sudo:session): session closed for user root Jun 23 16:20:56 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.682s {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:20:56 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:20:56 devstack sudo[83561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 16:20:56 devstack sudo[83561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:20:57 devstack sudo[83561]: pam_unix(sudo:session): session closed for user root Jun 23 16:20:57 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.741s {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:20:57 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:20:57 devstack sudo[83565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 16:20:57 devstack sudo[83565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:20:58 devstack sudo[83565]: pam_unix(sudo:session): session closed for user root Jun 23 16:20:58 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.662s {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:20:58 devstack cinder-volume[82445]: DEBUG cinder.manager [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] Notifying Schedulers of capabilities ... {{(pid=82445) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:20:58 devstack cinder-volume[82445]: INFO cinder.volume.manager [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] Driver initialization completed successfully. Jun 23 16:20:58 devstack cinder-volume[82445]: INFO cinder.manager [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] Initiating service 2 cleanup Jun 23 16:20:58 devstack cinder-volume[82445]: INFO cinder.manager [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] Service 2 cleanup completed. Jun 23 16:20:58 devstack cinder-volume[82445]: DEBUG cinder.service [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] Creating RPC server for service cinder-volume {{(pid=82445) start /opt/stack/cinder/cinder/service.py:231}} Jun 23 16:20:58 devstack cinder-volume[82445]: DEBUG cinder.service [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82445) start /opt/stack/cinder/cinder/service.py:237}} Jun 23 16:20:58 devstack cinder-volume[82445]: INFO cinder.volume.manager [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jun 23 16:20:58 devstack cinder-volume[82445]: DEBUG cinder.volume.drivers.lvm [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] Updating volume stats {{(pid=82445) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 23 16:20:58 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:20:58 devstack sudo[83570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 16:20:58 devstack sudo[83570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:20:58 devstack sudo[83570]: pam_unix(sudo:session): session closed for user root Jun 23 16:20:58 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.660s {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:20:58 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:20:58 devstack sudo[83573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 16:20:58 devstack sudo[83573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:20:59 devstack sudo[83573]: pam_unix(sudo:session): session closed for user root Jun 23 16:20:59 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.646s {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:20:59 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:20:59 devstack sudo[83633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 16:20:59 devstack sudo[83633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:21:00 devstack sudo[83633]: pam_unix(sudo:session): session closed for user root Jun 23 16:21:00 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.615s {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:21:00 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:21:00 devstack sudo[83636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 16:21:00 devstack sudo[83636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:21:00 devstack sudo[83636]: pam_unix(sudo:session): session closed for user root Jun 23 16:21:00 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.624s {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:21:00 devstack cinder-volume[82445]: INFO cinder.volume.manager [None req-ab2b2e88-feee-45cf-821f-643dbebabb15 None None] Driver post RPC initialization completed successfully. Jun 23 16:21:10 devstack cinder-volume[82445]: DEBUG dbcounter [-] [82445] Writing DB stats cinder:SELECT=4 {{(pid=82445) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:21:10 devstack cinder-volume[82445]: DEBUG dbcounter [-] [82445] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=82445) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:21:15 devstack cinder-volume[82445]: DEBUG oslo_service.periodic_task [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] Running periodic task VolumeManager._thread_info {{(pid=82445) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:21:15 devstack cinder-volume[82445]: DEBUG cinder.volume.manager [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] thread count: 6 {{(pid=82445) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 16:21:15 devstack cinder-volume[82445]: DEBUG cinder.volume.manager [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] thread info: [<_MainThread(MainThread, started 125544346894464)>, , , , , ] {{(pid=82445) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 16:22:15 devstack cinder-volume[82445]: DEBUG oslo_service.periodic_task [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82445) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:22:15 devstack cinder-volume[82445]: DEBUG cinder.volume.drivers.lvm [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] Updating volume stats {{(pid=82445) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 23 16:22:15 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:22:15 devstack sudo[85751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 16:22:15 devstack sudo[85751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:22:16 devstack sudo[85751]: pam_unix(sudo:session): session closed for user root Jun 23 16:22:16 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.746s {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:22:16 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:22:16 devstack sudo[85922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 16:22:16 devstack sudo[85922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:22:17 devstack sudo[85922]: pam_unix(sudo:session): session closed for user root Jun 23 16:22:17 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.642s {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:22:17 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:22:17 devstack sudo[85925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 16:22:17 devstack sudo[85925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:22:17 devstack sudo[85925]: pam_unix(sudo:session): session closed for user root Jun 23 16:22:17 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.667s {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:22:17 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:22:17 devstack sudo[85929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 16:22:17 devstack sudo[85929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:22:18 devstack sudo[85929]: pam_unix(sudo:session): session closed for user root Jun 23 16:22:18 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.633s {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:22:18 devstack cinder-volume[82445]: DEBUG cinder.manager [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] Notifying Schedulers of capabilities ... {{(pid=82445) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:22:18 devstack cinder-volume[82445]: DEBUG oslo_service.periodic_task [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] Running periodic task VolumeManager._thread_info {{(pid=82445) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:22:18 devstack cinder-volume[82445]: DEBUG cinder.volume.manager [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] thread count: 6 {{(pid=82445) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 16:22:18 devstack cinder-volume[82445]: DEBUG cinder.volume.manager [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] thread info: [<_MainThread(MainThread, started 125544346894464)>, , , , , ] {{(pid=82445) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 16:23:10 devstack cinder-volume[82445]: DEBUG dbcounter [-] [82445] Writing DB stats cinder:SELECT=1 {{(pid=82445) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:23:10 devstack cinder-volume[82445]: DEBUG dbcounter [-] [82445] Writing DB stats cinder:UPDATE=1 {{(pid=82445) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:23:15 devstack cinder-volume[82445]: DEBUG oslo_service.periodic_task [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82445) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:23:15 devstack cinder-volume[82445]: DEBUG cinder.volume.drivers.lvm [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] Updating volume stats {{(pid=82445) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 23 16:23:15 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:23:15 devstack sudo[88809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 16:23:15 devstack sudo[88809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:23:16 devstack sudo[88809]: pam_unix(sudo:session): session closed for user root Jun 23 16:23:16 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.660s {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:23:16 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:23:16 devstack sudo[88812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 16:23:16 devstack sudo[88812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:23:17 devstack sudo[88812]: pam_unix(sudo:session): session closed for user root Jun 23 16:23:17 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.654s {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:23:17 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:23:17 devstack sudo[88815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 16:23:17 devstack sudo[88815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:23:17 devstack sudo[88815]: pam_unix(sudo:session): session closed for user root Jun 23 16:23:17 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.657s {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:23:17 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:23:17 devstack sudo[88819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 16:23:17 devstack sudo[88819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:23:18 devstack sudo[88819]: pam_unix(sudo:session): session closed for user root Jun 23 16:23:18 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.640s {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:23:18 devstack cinder-volume[82445]: DEBUG cinder.manager [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] Notifying Schedulers of capabilities ... {{(pid=82445) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:23:18 devstack cinder-volume[82445]: DEBUG oslo_service.periodic_task [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] Running periodic task VolumeManager._thread_info {{(pid=82445) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:23:18 devstack cinder-volume[82445]: DEBUG cinder.volume.manager [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] thread count: 6 {{(pid=82445) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 16:23:18 devstack cinder-volume[82445]: DEBUG cinder.volume.manager [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] thread info: [<_MainThread(MainThread, started 125544346894464)>, , , , , ] {{(pid=82445) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 16:24:15 devstack cinder-volume[82445]: DEBUG oslo_service.periodic_task [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82445) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:24:15 devstack cinder-volume[82445]: DEBUG cinder.volume.drivers.lvm [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] Updating volume stats {{(pid=82445) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 23 16:24:15 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:24:15 devstack sudo[90409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 16:24:15 devstack sudo[90409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:24:16 devstack sudo[90409]: pam_unix(sudo:session): session closed for user root Jun 23 16:24:16 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.712s {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:24:16 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:24:16 devstack sudo[90421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 16:24:16 devstack sudo[90421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:24:17 devstack sudo[90421]: pam_unix(sudo:session): session closed for user root Jun 23 16:24:17 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.734s {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:24:17 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:24:17 devstack sudo[90449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 16:24:17 devstack sudo[90449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:24:17 devstack sudo[90449]: pam_unix(sudo:session): session closed for user root Jun 23 16:24:17 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.730s {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:24:17 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:24:17 devstack sudo[90479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 16:24:17 devstack sudo[90479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:24:18 devstack sudo[90479]: pam_unix(sudo:session): session closed for user root Jun 23 16:24:18 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.712s {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:24:18 devstack cinder-volume[82445]: DEBUG cinder.manager [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] Notifying Schedulers of capabilities ... {{(pid=82445) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:24:18 devstack cinder-volume[82445]: DEBUG oslo_service.periodic_task [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] Running periodic task VolumeManager._thread_info {{(pid=82445) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:24:18 devstack cinder-volume[82445]: DEBUG cinder.volume.manager [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] thread count: 6 {{(pid=82445) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 16:24:18 devstack cinder-volume[82445]: DEBUG cinder.volume.manager [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] thread info: [<_MainThread(MainThread, started 125544346894464)>, , , , , ] {{(pid=82445) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 16:25:10 devstack cinder-volume[82445]: DEBUG dbcounter [-] [82445] Writing DB stats cinder:SELECT=1 {{(pid=82445) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:25:10 devstack cinder-volume[82445]: DEBUG dbcounter [-] [82445] Writing DB stats cinder:UPDATE=1 {{(pid=82445) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:25:15 devstack cinder-volume[82445]: DEBUG oslo_service.periodic_task [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82445) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:25:15 devstack cinder-volume[82445]: DEBUG cinder.volume.drivers.lvm [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] Updating volume stats {{(pid=82445) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 23 16:25:15 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:25:15 devstack sudo[91988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 16:25:15 devstack sudo[91988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:25:16 devstack sudo[91988]: pam_unix(sudo:session): session closed for user root Jun 23 16:25:16 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.639s {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:25:16 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:25:16 devstack sudo[91992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 16:25:16 devstack sudo[91992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:25:17 devstack sudo[91992]: pam_unix(sudo:session): session closed for user root Jun 23 16:25:17 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.609s {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:25:17 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:25:17 devstack sudo[92005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 16:25:17 devstack sudo[92005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:25:17 devstack sudo[92005]: pam_unix(sudo:session): session closed for user root Jun 23 16:25:17 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.656s {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:25:17 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:25:17 devstack sudo[92009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 16:25:17 devstack sudo[92009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:25:18 devstack sudo[92009]: pam_unix(sudo:session): session closed for user root Jun 23 16:25:18 devstack cinder-volume[82445]: DEBUG oslo_concurrency.processutils [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.658s {{(pid=82445) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:25:18 devstack cinder-volume[82445]: DEBUG cinder.manager [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] Notifying Schedulers of capabilities ... {{(pid=82445) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:25:18 devstack cinder-volume[82445]: DEBUG oslo_service.periodic_task [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] Running periodic task VolumeManager._thread_info {{(pid=82445) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:25:18 devstack cinder-volume[82445]: DEBUG cinder.volume.manager [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] thread count: 6 {{(pid=82445) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 16:25:18 devstack cinder-volume[82445]: DEBUG cinder.volume.manager [None req-399f91a9-9e13-4e16-bbf9-23eb2d1f503a None None] thread info: [<_MainThread(MainThread, started 125544346894464)>, , , , , ] {{(pid=82445) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 16:25:58 devstack cinder-volume[82289]: INFO oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] Caught SIGTERM, stopping children Jun 23 16:25:58 devstack cinder-volume[82289]: DEBUG oslo_concurrency.lockutils [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] Acquiring lock "singleton_lock" {{(pid=82289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 23 16:25:58 devstack cinder-volume[82289]: DEBUG oslo_concurrency.lockutils [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] Acquired lock "singleton_lock" {{(pid=82289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 23 16:25:58 devstack cinder-volume[82289]: DEBUG oslo_concurrency.lockutils [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] Releasing lock "singleton_lock" {{(pid=82289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 23 16:25:58 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] Stop services. {{(pid=82289) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 23 16:25:58 devstack cinder-volume[82289]: DEBUG oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] Killing children. {{(pid=82289) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 23 16:25:58 devstack cinder-volume[82289]: INFO oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] Waiting on 1 children to exit Jun 23 16:26:03 devstack cinder-volume[82445]: DEBUG oslo_concurrency.lockutils [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] Acquiring lock "singleton_lock" {{(pid=82445) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 23 16:26:03 devstack cinder-volume[82445]: DEBUG oslo_concurrency.lockutils [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] Acquired lock "singleton_lock" {{(pid=82445) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 23 16:26:03 devstack cinder-volume[82445]: DEBUG oslo_concurrency.lockutils [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] Releasing lock "singleton_lock" {{(pid=82445) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 23 16:26:03 devstack cinder-volume[82445]: WARNING amqp [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 23 16:26:03 devstack cinder-volume[82445]: WARNING amqp [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 23 16:26:03 devstack cinder-volume[82289]: INFO oslo_service.backend._eventlet.service [None req-8209b1f8-f3de-4355-8d2d-88714d837c81 None None] Child 82445 exited with status 0 Jun 23 16:26:03 devstack cinder-volume[92970]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 23 16:26:03 devstack cinder-volume[92970]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 23 16:26:03 devstack cinder-volume[92970]: we strongly recommend against using it for new projects. Jun 23 16:26:03 devstack cinder-volume[92970]: If you are already using Eventlet, we recommend migrating to a different Jun 23 16:26:03 devstack cinder-volume[92970]: framework. For more detail see Jun 23 16:26:03 devstack cinder-volume[92970]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 23 16:26:03 devstack cinder-volume[92970]: import eventlet # noqa Jun 23 16:26:05 devstack cinder-volume[92970]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=92970) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 23 16:26:05 devstack cinder-volume[92970]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=92970) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 23 16:26:05 devstack cinder-volume[92970]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=92970) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 23 16:26:06 devstack cinder-volume[92970]: INFO dbcounter [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] Registered counter for database cinder Jun 23 16:26:06 devstack cinder-volume[92970]: DEBUG oslo_db.sqlalchemy.engines [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92970) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 16:26:06 devstack cinder-volume[92970]: DEBUG dbcounter [-] [92970] Writer thread running {{(pid=92970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 23 16:26:06 devstack cinder-volume[92970]: INFO cinder.rpc [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 23 16:26:06 devstack cinder-volume[92970]: INFO cinder.rpc [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_db.sqlalchemy.engines [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92970) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 16:26:07 devstack cinder-volume[92970]: INFO cinder.volume.manager [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] Determined volume DB was empty at startup. Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG cinder.volume.manager [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=92970) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 23 16:26:07 devstack cinder-volume[92970]: INFO cinder.volume.manager [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 23 16:26:07 devstack cinder-volume[92970]: WARNING stevedore.named [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 23 16:26:07 devstack cinder-volume[92970]: WARNING castellan.key_manager [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 23 16:26:07 devstack cinder-volume[92970]: WARNING cinder.keymgr.conf_key_mgr [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 23 16:26:07 devstack cinder-volume[92970]: INFO cinder.volume.manager [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_db.sqlalchemy.engines [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92970) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 16:26:07 devstack cinder-volume[92970]: INFO oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] Starting 1 workers Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] Started child 93185 {{(pid=92970) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] Full set of CONF: {{(pid=92970) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] ******************************************************************************** {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] Configuration options gathered from: {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] ================================================================================ {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] allow_availability_zone_fallback = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] allow_compression_on_image_upload = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] allowed_direct_url_schemes = [] {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] api_rate_limit = True {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] auth_strategy = keystone {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_availability_zone = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_host = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_name = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_stats_polling_interval = 60 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backup_api_class = cinder.backup.api.API {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backup_name_template = backup-%s {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backup_use_same_host = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backup_use_temp_snapshot = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] chap_password = **** {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] chap_username = {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[93185]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] cinder_internal_tenant_project_id = ad90cfdf66bd4d56a7bb44a6d5a966cd {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] cinder_internal_tenant_user_id = 31ba3bd9a53a4adb8ba5794ed3d268d3 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] cluster = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] compression_format = gzip {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] compute_api_class = cinder.compute.nova.API {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] config_dir = [] {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] config_source = [] {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] control_exchange = openstack {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] debug = True {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] default_availability_zone = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] default_group_type = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] default_volume_type = QuobyteHD {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] disk_geometry = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] driver_client_cert = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] driver_client_cert_key = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] driver_data_namespace = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] driver_ssl_cert_path = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] driver_ssl_cert_verify = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] driver_use_ssl = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] enable_new_services = True {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] enable_unsupported_driver = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] enabled_backends = ['QuobyteHD'] {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] enforce_multipath_for_image_xfer = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] filter_function = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] glance_api_insecure = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] glance_api_servers = ['http://192.168.122.106/image'] {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] glance_api_ssl_compression = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] glance_ca_certificates_file = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] glance_catalog_info = image:glance:publicURL {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] glance_certfile = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] glance_keyfile = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] glance_num_retries = 3 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] glance_request_timeout = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] goodness_function = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] graceful_shutdown_timeout = 5 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] group_api_class = cinder.group.api.API {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] host = devstack {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] image_compress_on_upload = True {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] image_conversion_address_space_limit = 1 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] image_conversion_cpu_limit = 60 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] image_conversion_disable = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] image_upload_use_cinder_backend = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] image_upload_use_internal_tenant = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] image_volume_cache_enabled = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] image_volume_cache_max_count = 0 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] image_volume_cache_max_size_gb = 0 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] init_host_max_objects_retrieval = 0 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] instance_format = [instance: %(uuid)s] {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] iscsi_target_flags = {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] iscsi_write_cache = on {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] iser_helper = tgtadm {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] iser_ip_address = 192.168.122.106 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] iser_port = 3260 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] log_color = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] log_config_append = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] log_dir = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] log_file = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] log_options = True {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] log_rotate_interval = 1 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] log_rotate_interval_type = days {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] log_rotation_type = none {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] max_age = 0 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] max_logfile_count = 30 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] max_logfile_size_mb = 200 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] max_over_subscription_ratio = 20.0 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] message_reap_interval = 86400 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] message_ttl = 2592000 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] migration_create_volume_timeout_secs = 300 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] monkey_patch = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] monkey_patch_modules = [] {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] my_ip = 192.168.122.106 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] no_snapshot_gb_quota = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] num_iser_scan_tries = 3 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] num_shell_tries = 3 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] num_volume_device_scan_tries = 3 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] nvmeof_conn_info_version = 1 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] nvmet_ns_id = 10 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] nvmet_port_id = 1 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] osapi_max_limit = 1000 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] osapi_volume_ext_list = [] {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] osapi_volume_listen = 0.0.0.0 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] osapi_volume_listen_port = 8776 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] osapi_volume_use_ssl = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] osapi_volume_workers = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] per_volume_size_limit = -1 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] periodic_fuzzy_delay = 60 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] periodic_interval = 60 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] project_id_regex = [0-9a-f\-]+ {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] public_endpoint = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] publish_errors = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] quota_backup_gigabytes = 1000 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] quota_backups = 10 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] quota_gigabytes = 1000 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] quota_groups = 10 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] quota_snapshots = 10 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] quota_volumes = 10 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] rate_limit_burst = 0 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] rate_limit_except_level = CRITICAL {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] rate_limit_interval = 0 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] reinit_driver_count = 3 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] replication_device = **** {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] report_discard_supported = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] report_interval = 120 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] reservation_clean_interval = 86400 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] reservation_expire = 86400 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] reserved_image_namespaces = [] {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] reserved_percentage = 0 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] rpc_response_timeout = 120 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] run_external_periodic_tasks = True {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] scst_target_driver = iscsi {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] scst_target_iqn_name = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] service_down_time = 720 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] shell_completion = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] snapshot_name_template = snapshot-%s {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] split_loggers = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] state_path = /opt/stack/data/cinder {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] storage_availability_zone = nova {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] storage_protocol = iSCSI {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] syslog_log_facility = LOG_USER {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] target_helper = lioadm {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] target_ip_address = 192.168.122.106 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] target_port = 3260 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] target_protocol = iscsi {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] target_secondary_ip_addresses = [] {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] trace_flags = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] transfer_api_class = cinder.transfer.api.API {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] transport_url = **** {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] until_refresh = 0 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] use_chap_auth = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] use_default_quota_class = True {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] use_journal = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] use_json = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] use_multipath_for_image_xfer = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] use_stderr = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] use_syslog = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] verify_glance_signatures = enabled {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] volume_api_class = cinder.volume.api.API {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] volume_backend_name = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] volume_clear = zero {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] volume_clear_ionice = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] volume_clear_size = 0 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] volume_copy_bps_limit = 0 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] volume_dd_blocksize = 1M {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] volume_name_template = volume-%s {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] volume_service_inithost_offload = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] volume_usage_audit_period = month {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] zoning_mode = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_concurrency.disable_process_locking = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[93185]: INFO cinder.volume.manager [None req-89e1768c-5e3f-45b1-8bfc-6353a53203d2 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[93185]: DEBUG cinder.volume.drivers.remotefs [None req-89e1768c-5e3f-45b1-8bfc-6353a53203d2 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93185) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] keystone_authtoken.auth_section = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] keystone_authtoken.auth_type = password {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] keystone_authtoken.auth_version = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] keystone_authtoken.cache = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] keystone_authtoken.certfile = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] keystone_authtoken.delay_auth_decision = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] keystone_authtoken.http_connect_timeout = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] keystone_authtoken.include_service_catalog = True {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] keystone_authtoken.insecure = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] keystone_authtoken.interface = public {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] keystone_authtoken.keyfile = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] keystone_authtoken.memcache_password = {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] keystone_authtoken.memcache_username = {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] keystone_authtoken.region_name = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] keystone_authtoken.service_token_roles_required = True {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] keystone_authtoken.service_type = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] keystone_authtoken.token_cache_time = 300 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.106/identity {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] cache.backend = dogpile.cache.null {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] cache.backend_argument = **** {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] cache.backend_expiration_time = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] cache.config_prefix = cache.oslo {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] cache.debug_cache_backend = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] cache.enable_retry_client = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] cache.enable_socket_keepalive = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] cache.enabled = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] cache.expiration_time = 600 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] cache.hashclient_retry_attempts = 2 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] cache.memcache_dead_retry = 300 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] cache.memcache_pool_maxsize = 10 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] cache.memcache_sasl_enabled = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] cache.password = **** {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] cache.proxies = [] {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] cache.redis_db = 0 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] cache.redis_sentinel_service_name = mymaster {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] cache.redis_server = localhost:6379 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] cache.retry_attempts = 2 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] cache.retry_delay = 0.0 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] cache.socket_keepalive_count = 1 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] cache.socket_keepalive_idle = 1 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] cache.socket_keepalive_interval = 1 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] cache.socket_timeout = 1.0 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] cache.tls_allowed_ciphers = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] cache.tls_cafile = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] cache.tls_certfile = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] cache.tls_enabled = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] cache.tls_keyfile = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] cache.username = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] coordination.backend_url = **** {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] database.asyncio_connection = **** {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] database.asyncio_slave_connection = **** {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] database.backend = sqlalchemy {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] database.connection = **** {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] database.connection_debug = 0 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] database.connection_parameters = {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] database.connection_recycle_time = 3600 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] database.connection_trace = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] database.db_inc_retry_interval = True {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] database.db_max_retries = 20 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] database.db_max_retry_interval = 10 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] database.db_retry_interval = 1 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] database.max_overflow = 50 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] database.max_pool_size = 5 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] database.max_retries = 10 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] database.mysql_wsrep_sync_wait = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] database.pool_timeout = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] database.retry_interval = 10 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] database.slave_connection = **** {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] database.sqlite_synchronous = True {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] database.synchronous_reader = True {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] database.use_db_reconnect = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] profiler.connection_string = messaging:// {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] profiler.enabled = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] profiler.es_doc_type = notification {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] profiler.es_scroll_size = 10000 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] profiler.es_scroll_time = 2m {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] profiler.filter_error_trace = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] profiler.hmac_keys = **** {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] profiler.sentinel_service_name = mymaster {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] profiler.socket_timeout = 0.1 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] profiler.trace_requests = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] profiler.trace_sqlalchemy = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] profiler_jaeger.process_tags = {} {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] profiler_jaeger.service_name_prefix = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] profiler_otlp.service_name_prefix = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_policy.enforce_new_defaults = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: WARNING oslo_config.cfg [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_policy.enforce_scope = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_policy.policy_default_rule = default {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_policy.policy_file = policy.yaml {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_policy.remote_timeout = 60.0 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] privsep_osbrick.group = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] privsep_osbrick.helper_command = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] privsep_osbrick.user = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] cinder_sys_admin.group = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] cinder_sys_admin.helper_command = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] cinder_sys_admin.user = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] service_user.auth_section = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] service_user.auth_type = password {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] service_user.cafile = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] service_user.certfile = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] service_user.collect_timing = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] service_user.insecure = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] service_user.keyfile = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] service_user.send_service_user_token = True {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] service_user.split_loggers = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] service_user.timeout = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] glance.auth_section = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] glance.auth_type = password {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] glance.certfile = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] glance.collect_timing = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] glance.insecure = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] glance.keyfile = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] glance.region_name = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] glance.split_loggers = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] glance.timeout = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.backend_availability_zone = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.chap_password = **** {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.chap_username = {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.disk_geometry = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.driver_client_cert = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.driver_client_cert_key = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.driver_data_namespace = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.driver_use_ssl = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.enable_unsupported_driver = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.extra_capabilities = {} {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.filter_function = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.goodness_function = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.iscsi_target_flags = {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.iscsi_write_cache = on {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.iser_helper = tgtadm {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.iser_ip_address = 192.168.122.106 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.iser_port = 3260 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.nas_host = {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.nas_login = admin {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.nas_mount_options = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.nas_password = **** {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.nas_private_key = {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.nas_share_path = {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.nas_ssh_port = 22 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.num_shell_tries = 3 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.nvmet_port_id = 1 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.quobyte_client_cfg = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.quobyte_volume_url = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.replication_device = **** {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.report_discard_supported = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.reserved_percentage = 0 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.scst_target_driver = iscsi {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.scst_target_iqn_name = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.storage_protocol = iSCSI {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.target_helper = tgtadm {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.target_ip_address = 192.168.122.106 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.target_port = 3260 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.target_protocol = iscsi {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.trace_flags = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.unique_fqdn_network = True {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.use_chap_auth = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.volume_backend_name = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.volume_clear = zero {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.volume_clear_ionice = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.volume_clear_size = 0 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_reports.file_event_handler = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_reports.log_dir = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.backend_availability_zone = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.backend_host = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.chap_password = **** {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.chap_username = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.chiscsi_conf = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.disk_geometry = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.driver_client_cert = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.driver_client_cert_key = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.driver_data_namespace = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.driver_use_ssl = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.extra_capabilities = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.filter_function = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.goodness_function = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.iscsi_target_flags = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.iscsi_write_cache = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.iser_helper = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.iser_ip_address = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.iser_port = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.iser_target_prefix = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.nas_host = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.nas_login = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.nas_mount_options = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.nas_password = **** {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[93185]: DEBUG cinder.volume.drivers.quobyte [None req-89e1768c-5e3f-45b1-8bfc-6353a53203d2 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93185) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 23 16:26:07 devstack cinder-volume[93185]: WARNING cinder.volume.drivers.quobyte [None req-89e1768c-5e3f-45b1-8bfc-6353a53203d2 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.nas_private_key = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[93185]: WARNING cinder.volume.drivers.quobyte [None req-89e1768c-5e3f-45b1-8bfc-6353a53203d2 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.nas_share_path = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.nas_ssh_port = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.num_shell_tries = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[93185]: DEBUG oslo_concurrency.processutils [None req-89e1768c-5e3f-45b1-8bfc-6353a53203d2 None None] Running cmd (subprocess): mount.quobyte {{(pid=93185) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.nvmet_ns_id = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.nvmet_port_id = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.replication_device = **** {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.report_discard_supported = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.reserved_percentage = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.scst_target_driver = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.storage_protocol = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.target_helper = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.target_ip_address = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.target_port = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.target_prefix = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.target_protocol = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.trace_flags = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.unique_fqdn_network = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.use_chap_auth = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.volume_clear = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.volume_clear_ionice = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.volume_clear_size = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] QuobyteHD.volumes_dir = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_messaging_rabbit.ssl = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_messaging_rabbit.ssl_version = {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_messaging_notifications.driver = [] {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_messaging_notifications.retry = -1 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] oslo_messaging_notifications.transport_url = **** {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] key_manager.fixed_key = **** {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] barbican.barbican_api_version = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] barbican.barbican_endpoint = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] barbican.barbican_endpoint_type = public {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] barbican.barbican_region_name = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] barbican.cafile = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] barbican.certfile = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] barbican.collect_timing = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] barbican.insecure = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] barbican.keyfile = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] barbican.number_of_retries = 60 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] barbican.retry_delay = 1 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] barbican.send_service_user_token = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] barbican.split_loggers = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] barbican.timeout = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] barbican.verify_ssl = True {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] barbican.verify_ssl_path = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] barbican_service_user.auth_section = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] barbican_service_user.auth_type = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] barbican_service_user.cafile = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] barbican_service_user.certfile = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] barbican_service_user.collect_timing = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] barbican_service_user.insecure = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] barbican_service_user.keyfile = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] barbican_service_user.split_loggers = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] barbican_service_user.timeout = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] vault.approle_role_id = **** {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] vault.approle_secret_id = **** {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] vault.kv_mountpoint = secret {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] vault.kv_path = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] vault.kv_version = 2 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] vault.namespace = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] vault.root_token_id = **** {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] vault.ssl_ca_crt_file = None {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] vault.timeout = 60.0 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] vault.use_ssl = False {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:07 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] ******************************************************************************** {{(pid=92970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 23 16:26:07 devstack quobyte-client[93190]: Reading configuration file: /etc/quobyte/client.cfg Jun 23 16:26:07 devstack quobyte-client[93190]: Invalid parameters found, error: missing mount point. Jun 23 16:26:07 devstack quobyte-client[93190]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 23 16:26:07 devstack quobyte-client[93190]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 23 16:26:07 devstack cinder-volume[93185]: DEBUG oslo_concurrency.processutils [None req-89e1768c-5e3f-45b1-8bfc-6353a53203d2 None None] CMD "mount.quobyte" returned: 1 in 0.105s {{(pid=93185) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:26:07 devstack cinder-volume[93185]: DEBUG oslo_concurrency.lockutils [None req-89e1768c-5e3f-45b1-8bfc-6353a53203d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93185) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:26:07 devstack cinder-volume[93185]: DEBUG oslo_concurrency.lockutils [None req-89e1768c-5e3f-45b1-8bfc-6353a53203d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93185) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:26:07 devstack cinder-volume[93185]: DEBUG cinder.volume.drivers.quobyte [None req-89e1768c-5e3f-45b1-8bfc-6353a53203d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93185) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:26:07 devstack cinder-volume[93185]: INFO cinder.volume.drivers.quobyte [None req-89e1768c-5e3f-45b1-8bfc-6353a53203d2 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e ... Jun 23 16:26:07 devstack cinder-volume[93185]: DEBUG oslo_concurrency.processutils [None req-89e1768c-5e3f-45b1-8bfc-6353a53203d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 -c /etc/quobyte/client-cinder.cfg {{(pid=93185) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:26:07 devstack sudo[93191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 -c /etc/quobyte/client-cinder.cfg Jun 23 16:26:07 devstack sudo[93191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:26:08 devstack sudo[93191]: pam_unix(sudo:session): session closed for user root Jun 23 16:26:08 devstack cinder-volume[93185]: DEBUG oslo_concurrency.processutils [None req-89e1768c-5e3f-45b1-8bfc-6353a53203d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.837s {{(pid=93185) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:26:08 devstack cinder-volume[93185]: INFO cinder.volume.drivers.quobyte [None req-89e1768c-5e3f-45b1-8bfc-6353a53203d2 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e succeeded Jun 23 16:26:08 devstack cinder-volume[93185]: DEBUG cinder.volume.drivers.quobyte [None req-89e1768c-5e3f-45b1-8bfc-6353a53203d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93185) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:26:08 devstack cinder-volume[93185]: DEBUG oslo_concurrency.lockutils [None req-89e1768c-5e3f-45b1-8bfc-6353a53203d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.848s {{(pid=93185) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:26:08 devstack cinder-volume[93185]: DEBUG oslo_concurrency.processutils [None req-89e1768c-5e3f-45b1-8bfc-6353a53203d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93185) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:26:08 devstack sudo[93261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:26:08 devstack sudo[93261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:26:09 devstack sudo[93261]: pam_unix(sudo:session): session closed for user root Jun 23 16:26:09 devstack cinder-volume[93185]: DEBUG oslo_concurrency.processutils [None req-89e1768c-5e3f-45b1-8bfc-6353a53203d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.631s {{(pid=93185) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:26:09 devstack cinder-volume[93185]: INFO cinder.volume.driver [None req-89e1768c-5e3f-45b1-8bfc-6353a53203d2 None None] Driver hasn't implemented _init_vendor_properties() Jun 23 16:26:09 devstack cinder-volume[93185]: DEBUG cinder.volume.driver [None req-89e1768c-5e3f-45b1-8bfc-6353a53203d2 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5866012573242, 'free_capacity_gb': 1775.5866012573242, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93185) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 23 16:26:09 devstack cinder-volume[93185]: DEBUG oslo_db.sqlalchemy.engines [None req-89e1768c-5e3f-45b1-8bfc-6353a53203d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93185) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 16:26:09 devstack cinder-volume[93185]: DEBUG dbcounter [-] [93185] Writer thread running {{(pid=93185) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 23 16:26:09 devstack cinder-volume[93185]: DEBUG cinder.db.api [None req-89e1768c-5e3f-45b1-8bfc-6353a53203d2 None None] Building query based on filter {{(pid=93185) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 23 16:26:09 devstack cinder-volume[93185]: DEBUG cinder.image.image_utils [None req-89e1768c-5e3f-45b1-8bfc-6353a53203d2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93185) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 23 16:26:09 devstack cinder-volume[93185]: INFO cinder.keymgr.migration [None req-416ae79a-ff41-4921-9aac-344ea926ae0c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 23 16:26:09 devstack cinder-volume[93185]: DEBUG oslo_concurrency.lockutils [None req-89e1768c-5e3f-45b1-8bfc-6353a53203d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93185) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:26:09 devstack cinder-volume[93185]: DEBUG oslo_concurrency.lockutils [None req-89e1768c-5e3f-45b1-8bfc-6353a53203d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93185) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:26:09 devstack cinder-volume[93185]: DEBUG cinder.volume.drivers.quobyte [None req-89e1768c-5e3f-45b1-8bfc-6353a53203d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93185) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:26:09 devstack cinder-volume[93185]: DEBUG cinder.volume.drivers.quobyte [None req-89e1768c-5e3f-45b1-8bfc-6353a53203d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93185) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:26:09 devstack cinder-volume[93185]: DEBUG oslo_concurrency.lockutils [None req-89e1768c-5e3f-45b1-8bfc-6353a53203d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93185) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:26:09 devstack cinder-volume[93185]: DEBUG oslo_concurrency.processutils [None req-89e1768c-5e3f-45b1-8bfc-6353a53203d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93185) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:26:09 devstack sudo[93264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:26:09 devstack sudo[93264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:26:09 devstack sudo[93264]: pam_unix(sudo:session): session closed for user root Jun 23 16:26:09 devstack cinder-volume[93185]: DEBUG oslo_concurrency.processutils [None req-89e1768c-5e3f-45b1-8bfc-6353a53203d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.641s {{(pid=93185) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:26:09 devstack cinder-volume[93185]: DEBUG cinder.manager [None req-89e1768c-5e3f-45b1-8bfc-6353a53203d2 None None] Notifying Schedulers of capabilities ... {{(pid=93185) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:26:09 devstack cinder-volume[93185]: INFO cinder.volume.manager [None req-89e1768c-5e3f-45b1-8bfc-6353a53203d2 None None] Driver initialization completed successfully. Jun 23 16:26:09 devstack cinder-volume[93185]: INFO cinder.manager [None req-89e1768c-5e3f-45b1-8bfc-6353a53203d2 None None] Initiating service 3 cleanup Jun 23 16:26:09 devstack cinder-volume[93185]: INFO cinder.manager [None req-89e1768c-5e3f-45b1-8bfc-6353a53203d2 None None] Service 3 cleanup completed. Jun 23 16:26:09 devstack cinder-volume[93185]: DEBUG cinder.service [None req-89e1768c-5e3f-45b1-8bfc-6353a53203d2 None None] Creating RPC server for service cinder-volume {{(pid=93185) start /opt/stack/cinder/cinder/service.py:231}} Jun 23 16:26:09 devstack cinder-volume[93185]: DEBUG cinder.service [None req-89e1768c-5e3f-45b1-8bfc-6353a53203d2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93185) start /opt/stack/cinder/cinder/service.py:237}} Jun 23 16:26:10 devstack cinder-volume[93185]: INFO cinder.volume.manager [None req-89e1768c-5e3f-45b1-8bfc-6353a53203d2 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 23 16:26:10 devstack cinder-volume[93185]: DEBUG oslo_concurrency.lockutils [None req-89e1768c-5e3f-45b1-8bfc-6353a53203d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93185) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:26:10 devstack cinder-volume[93185]: DEBUG oslo_concurrency.lockutils [None req-89e1768c-5e3f-45b1-8bfc-6353a53203d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93185) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:26:10 devstack cinder-volume[93185]: DEBUG cinder.volume.drivers.quobyte [None req-89e1768c-5e3f-45b1-8bfc-6353a53203d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93185) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:26:10 devstack cinder-volume[93185]: DEBUG cinder.volume.drivers.quobyte [None req-89e1768c-5e3f-45b1-8bfc-6353a53203d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93185) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:26:10 devstack cinder-volume[93185]: DEBUG oslo_concurrency.lockutils [None req-89e1768c-5e3f-45b1-8bfc-6353a53203d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93185) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:26:10 devstack cinder-volume[93185]: DEBUG oslo_concurrency.processutils [None req-89e1768c-5e3f-45b1-8bfc-6353a53203d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93185) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:26:10 devstack sudo[93271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:26:10 devstack sudo[93271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:26:10 devstack sudo[93271]: pam_unix(sudo:session): session closed for user root Jun 23 16:26:10 devstack cinder-volume[93185]: DEBUG oslo_concurrency.processutils [None req-89e1768c-5e3f-45b1-8bfc-6353a53203d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.654s {{(pid=93185) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:26:10 devstack cinder-volume[93185]: INFO cinder.volume.manager [None req-89e1768c-5e3f-45b1-8bfc-6353a53203d2 None None] Driver post RPC initialization completed successfully. Jun 23 16:26:12 devstack cinder-volume[93185]: DEBUG oslo_service.periodic_task [None req-52da4b54-19ee-4315-926b-63e7f395111a None None] Running periodic task VolumeManager._thread_info {{(pid=93185) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:26:12 devstack cinder-volume[93185]: DEBUG cinder.volume.manager [None req-52da4b54-19ee-4315-926b-63e7f395111a None None] thread count: 6 {{(pid=93185) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 16:26:12 devstack cinder-volume[93185]: DEBUG cinder.volume.manager [None req-52da4b54-19ee-4315-926b-63e7f395111a None None] thread info: [<_MainThread(MainThread, started 131942935101568)>, , , , , ] {{(pid=93185) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 16:26:14 devstack cinder-volume[93185]: DEBUG oslo_concurrency.lockutils [None req-c7881397-dd3a-46c6-8308-57304e1c337c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93185) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:26:14 devstack cinder-volume[93185]: DEBUG oslo_concurrency.lockutils [None req-c7881397-dd3a-46c6-8308-57304e1c337c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93185) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:26:14 devstack cinder-volume[93185]: DEBUG cinder.volume.drivers.quobyte [None req-c7881397-dd3a-46c6-8308-57304e1c337c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93185) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:26:14 devstack cinder-volume[93185]: DEBUG cinder.volume.drivers.quobyte [None req-c7881397-dd3a-46c6-8308-57304e1c337c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93185) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:26:14 devstack cinder-volume[93185]: DEBUG oslo_concurrency.lockutils [None req-c7881397-dd3a-46c6-8308-57304e1c337c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93185) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:26:14 devstack cinder-volume[93185]: DEBUG oslo_concurrency.processutils [None req-c7881397-dd3a-46c6-8308-57304e1c337c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93185) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:26:14 devstack sudo[93396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:26:14 devstack sudo[93396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:26:15 devstack sudo[93396]: pam_unix(sudo:session): session closed for user root Jun 23 16:26:15 devstack cinder-volume[93185]: DEBUG oslo_concurrency.processutils [None req-c7881397-dd3a-46c6-8308-57304e1c337c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.636s {{(pid=93185) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:26:15 devstack cinder-volume[93185]: DEBUG cinder.manager [None req-c7881397-dd3a-46c6-8308-57304e1c337c None None] Notifying Schedulers of capabilities ... {{(pid=93185) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:26:15 devstack cinder-volume[92970]: INFO oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] Caught SIGTERM, stopping children Jun 23 16:26:15 devstack cinder-volume[92970]: DEBUG oslo_concurrency.lockutils [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] Acquiring lock "singleton_lock" {{(pid=92970) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 23 16:26:15 devstack cinder-volume[92970]: DEBUG oslo_concurrency.lockutils [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] Acquired lock "singleton_lock" {{(pid=92970) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 23 16:26:15 devstack cinder-volume[92970]: DEBUG oslo_concurrency.lockutils [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] Releasing lock "singleton_lock" {{(pid=92970) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 23 16:26:15 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] Stop services. {{(pid=92970) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 23 16:26:15 devstack cinder-volume[92970]: DEBUG oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] Killing children. {{(pid=92970) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 23 16:26:15 devstack cinder-volume[92970]: INFO oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] Waiting on 1 children to exit Jun 23 16:26:18 devstack cinder-volume[93185]: DEBUG oslo_concurrency.lockutils [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] Acquiring lock "singleton_lock" {{(pid=93185) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 23 16:26:18 devstack cinder-volume[93185]: DEBUG oslo_concurrency.lockutils [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] Acquired lock "singleton_lock" {{(pid=93185) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 23 16:26:18 devstack cinder-volume[93185]: DEBUG oslo_concurrency.lockutils [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] Releasing lock "singleton_lock" {{(pid=93185) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 23 16:26:18 devstack cinder-volume[93185]: WARNING amqp [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 23 16:26:18 devstack cinder-volume[93185]: WARNING amqp [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 23 16:26:18 devstack cinder-volume[92970]: INFO oslo_service.backend._eventlet.service [None req-d1a4ce9a-9f24-4482-9193-5ed295358b36 None None] Child 93185 exited with status 0 Jun 23 16:26:18 devstack cinder-volume[93469]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 23 16:26:18 devstack cinder-volume[93469]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 23 16:26:18 devstack cinder-volume[93469]: we strongly recommend against using it for new projects. Jun 23 16:26:18 devstack cinder-volume[93469]: If you are already using Eventlet, we recommend migrating to a different Jun 23 16:26:18 devstack cinder-volume[93469]: framework. For more detail see Jun 23 16:26:18 devstack cinder-volume[93469]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 23 16:26:18 devstack cinder-volume[93469]: import eventlet # noqa Jun 23 16:26:22 devstack cinder-volume[93469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93469) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 23 16:26:22 devstack cinder-volume[93469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93469) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 23 16:26:22 devstack cinder-volume[93469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93469) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 23 16:26:23 devstack cinder-volume[93469]: INFO dbcounter [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] Registered counter for database cinder Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_db.sqlalchemy.engines [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93469) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG dbcounter [-] [93469] Writer thread running {{(pid=93469) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 23 16:26:23 devstack cinder-volume[93469]: INFO cinder.rpc [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 23 16:26:23 devstack cinder-volume[93469]: INFO cinder.rpc [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_db.sqlalchemy.engines [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93469) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 16:26:23 devstack cinder-volume[93469]: INFO cinder.volume.manager [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] Determined volume DB was empty at startup. Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG cinder.volume.manager [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93469) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 23 16:26:23 devstack cinder-volume[93469]: WARNING stevedore.named [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 23 16:26:23 devstack cinder-volume[93469]: WARNING castellan.key_manager [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 23 16:26:23 devstack cinder-volume[93469]: WARNING cinder.keymgr.conf_key_mgr [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 23 16:26:23 devstack cinder-volume[93469]: INFO cinder.volume.manager [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_db.sqlalchemy.engines [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93469) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 16:26:23 devstack cinder-volume[93469]: INFO oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] Starting 1 workers Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] Started child 93788 {{(pid=93469) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] Full set of CONF: {{(pid=93469) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] ******************************************************************************** {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] Configuration options gathered from: {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] ================================================================================ {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 23 16:26:23 devstack cinder-volume[93788]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] allow_availability_zone_fallback = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] allow_compression_on_image_upload = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] allowed_direct_url_schemes = [] {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] api_rate_limit = True {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] auth_strategy = keystone {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_availability_zone = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_host = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_name = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_stats_polling_interval = 60 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backup_api_class = cinder.backup.api.API {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backup_name_template = backup-%s {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backup_use_same_host = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backup_use_temp_snapshot = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] chap_password = **** {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] chap_username = {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] cinder_internal_tenant_project_id = ad90cfdf66bd4d56a7bb44a6d5a966cd {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] cinder_internal_tenant_user_id = 31ba3bd9a53a4adb8ba5794ed3d268d3 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] cluster = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] compression_format = gzip {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] compute_api_class = cinder.compute.nova.API {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] config_dir = [] {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] config_source = [] {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] control_exchange = openstack {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] debug = True {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] default_availability_zone = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] default_group_type = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] default_volume_type = QuobyteHD {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] disk_geometry = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] driver_client_cert = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] driver_client_cert_key = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] driver_data_namespace = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] driver_ssl_cert_path = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] driver_ssl_cert_verify = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] driver_use_ssl = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] enable_new_services = True {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] enable_unsupported_driver = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] enabled_backends = ['QuobyteHD'] {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] enforce_multipath_for_image_xfer = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] filter_function = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] glance_api_insecure = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] glance_api_servers = ['http://192.168.122.106/image'] {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] glance_api_ssl_compression = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] glance_ca_certificates_file = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] glance_catalog_info = image:glance:publicURL {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] glance_certfile = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] glance_keyfile = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] glance_num_retries = 3 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] glance_request_timeout = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] goodness_function = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] graceful_shutdown_timeout = 5 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] group_api_class = cinder.group.api.API {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] host = devstack {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] image_compress_on_upload = True {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] image_conversion_address_space_limit = 1 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] image_conversion_cpu_limit = 60 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] image_conversion_disable = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] image_upload_use_cinder_backend = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] image_upload_use_internal_tenant = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] image_volume_cache_enabled = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] image_volume_cache_max_count = 0 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] image_volume_cache_max_size_gb = 0 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] init_host_max_objects_retrieval = 0 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] instance_format = [instance: %(uuid)s] {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] iscsi_target_flags = {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] iscsi_write_cache = on {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] iser_helper = tgtadm {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] iser_ip_address = 192.168.122.106 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] iser_port = 3260 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] log_color = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] log_config_append = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] log_dir = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] log_file = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] log_options = True {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] log_rotate_interval = 1 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] log_rotate_interval_type = days {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] log_rotation_type = none {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-8a8ad7b2-cd2d-4375-af6b-4bf97974d9ba None None] Starting volume driver QuobyteDriver (1.1.14) Jun 23 16:26:23 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-8a8ad7b2-cd2d-4375-af6b-4bf97974d9ba None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93788) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] max_age = 0 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] max_logfile_count = 30 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] max_logfile_size_mb = 200 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] max_over_subscription_ratio = 20.0 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] message_reap_interval = 86400 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] message_ttl = 2592000 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] migration_create_volume_timeout_secs = 300 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] monkey_patch = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] monkey_patch_modules = [] {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] my_ip = 192.168.122.106 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] no_snapshot_gb_quota = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] num_iser_scan_tries = 3 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] num_shell_tries = 3 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] num_volume_device_scan_tries = 3 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] nvmeof_conn_info_version = 1 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] nvmet_ns_id = 10 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] nvmet_port_id = 1 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] osapi_max_limit = 1000 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] osapi_volume_ext_list = [] {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] osapi_volume_listen = 0.0.0.0 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] osapi_volume_listen_port = 8776 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] osapi_volume_use_ssl = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] osapi_volume_workers = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] per_volume_size_limit = -1 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] periodic_fuzzy_delay = 60 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] periodic_interval = 60 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] project_id_regex = [0-9a-f\-]+ {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] public_endpoint = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] publish_errors = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] quota_backup_gigabytes = 1000 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] quota_backups = 10 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] quota_gigabytes = 1000 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] quota_groups = 10 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] quota_snapshots = 10 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] quota_volumes = 10 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] rate_limit_burst = 0 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] rate_limit_except_level = CRITICAL {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] rate_limit_interval = 0 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] reinit_driver_count = 3 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] replication_device = **** {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] report_discard_supported = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] report_interval = 120 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] reservation_clean_interval = 86400 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] reservation_expire = 86400 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] reserved_image_namespaces = [] {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] reserved_percentage = 0 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] rpc_response_timeout = 120 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] run_external_periodic_tasks = True {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] scst_target_driver = iscsi {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] scst_target_iqn_name = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] service_down_time = 720 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] shell_completion = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] snapshot_name_template = snapshot-%s {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] split_loggers = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] state_path = /opt/stack/data/cinder {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] storage_availability_zone = nova {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] storage_protocol = iSCSI {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] syslog_log_facility = LOG_USER {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] target_helper = lioadm {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] target_ip_address = 192.168.122.106 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] target_port = 3260 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] target_protocol = iscsi {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] target_secondary_ip_addresses = [] {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] trace_flags = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] transfer_api_class = cinder.transfer.api.API {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] transport_url = **** {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] until_refresh = 0 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] use_chap_auth = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] use_default_quota_class = True {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] use_journal = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] use_json = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] use_multipath_for_image_xfer = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] use_stderr = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] use_syslog = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] verify_glance_signatures = enabled {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] volume_api_class = cinder.volume.api.API {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] volume_backend_name = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] volume_clear = zero {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] volume_clear_ionice = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] volume_clear_size = 0 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] volume_copy_bps_limit = 0 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] volume_dd_blocksize = 1M {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] volume_name_template = volume-%s {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] volume_service_inithost_offload = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] volume_usage_audit_period = month {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] zoning_mode = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_concurrency.disable_process_locking = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] keystone_authtoken.auth_section = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] keystone_authtoken.auth_type = password {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] keystone_authtoken.auth_version = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] keystone_authtoken.cache = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] keystone_authtoken.certfile = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] keystone_authtoken.delay_auth_decision = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] keystone_authtoken.http_connect_timeout = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] keystone_authtoken.include_service_catalog = True {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] keystone_authtoken.insecure = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-8a8ad7b2-cd2d-4375-af6b-4bf97974d9ba None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93788) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] keystone_authtoken.interface = public {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.quobyte [None req-8a8ad7b2-cd2d-4375-af6b-4bf97974d9ba None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] keystone_authtoken.keyfile = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.quobyte [None req-8a8ad7b2-cd2d-4375-af6b-4bf97974d9ba None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] keystone_authtoken.memcache_password = {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8a8ad7b2-cd2d-4375-af6b-4bf97974d9ba None None] Running cmd (subprocess): mount.quobyte {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] keystone_authtoken.memcache_username = {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] keystone_authtoken.region_name = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] keystone_authtoken.service_token_roles_required = True {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] keystone_authtoken.service_type = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] keystone_authtoken.token_cache_time = 300 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.106/identity {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] cache.backend = dogpile.cache.null {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] cache.backend_argument = **** {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] cache.backend_expiration_time = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] cache.config_prefix = cache.oslo {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] cache.debug_cache_backend = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] cache.enable_retry_client = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] cache.enable_socket_keepalive = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] cache.enabled = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] cache.expiration_time = 600 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] cache.hashclient_retry_attempts = 2 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] cache.memcache_dead_retry = 300 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] cache.memcache_pool_maxsize = 10 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] cache.memcache_sasl_enabled = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] cache.password = **** {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:23 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] cache.proxies = [] {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] cache.redis_db = 0 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] cache.redis_sentinel_service_name = mymaster {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] cache.redis_server = localhost:6379 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] cache.retry_attempts = 2 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] cache.retry_delay = 0.0 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] cache.socket_keepalive_count = 1 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] cache.socket_keepalive_idle = 1 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] cache.socket_keepalive_interval = 1 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] cache.socket_timeout = 1.0 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] cache.tls_allowed_ciphers = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] cache.tls_cafile = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] cache.tls_certfile = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] cache.tls_enabled = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] cache.tls_keyfile = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] cache.username = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] coordination.backend_url = **** {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] database.asyncio_connection = **** {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] database.asyncio_slave_connection = **** {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] database.backend = sqlalchemy {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] database.connection = **** {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] database.connection_debug = 0 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] database.connection_parameters = {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] database.connection_recycle_time = 3600 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] database.connection_trace = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] database.db_inc_retry_interval = True {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] database.db_max_retries = 20 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] database.db_max_retry_interval = 10 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] database.db_retry_interval = 1 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] database.max_overflow = 50 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] database.max_pool_size = 5 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] database.max_retries = 10 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack quobyte-client[93791]: Reading configuration file: /etc/quobyte/client.cfg Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] database.mysql_wsrep_sync_wait = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] database.pool_timeout = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack quobyte-client[93791]: Invalid parameters found, error: missing mount point. Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] database.retry_interval = 10 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] database.slave_connection = **** {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] database.sqlite_synchronous = True {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] database.synchronous_reader = True {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] database.use_db_reconnect = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack quobyte-client[93791]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 23 16:26:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8a8ad7b2-cd2d-4375-af6b-4bf97974d9ba None None] CMD "mount.quobyte" returned: 1 in 0.067s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:26:24 devstack quobyte-client[93791]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8a8ad7b2-cd2d-4375-af6b-4bf97974d9ba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] profiler.connection_string = messaging:// {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] profiler.enabled = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] profiler.es_doc_type = notification {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8a8ad7b2-cd2d-4375-af6b-4bf97974d9ba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] profiler.es_scroll_size = 10000 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-8a8ad7b2-cd2d-4375-af6b-4bf97974d9ba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] profiler.es_scroll_time = 2m {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] profiler.filter_error_trace = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] profiler.hmac_keys = **** {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] profiler.sentinel_service_name = mymaster {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] profiler.socket_timeout = 0.1 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] profiler.trace_requests = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] profiler.trace_sqlalchemy = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] profiler_jaeger.process_tags = {} {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] profiler_jaeger.service_name_prefix = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] profiler_otlp.service_name_prefix = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_policy.enforce_new_defaults = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: WARNING oslo_config.cfg [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_policy.enforce_scope = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_policy.policy_default_rule = default {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_policy.policy_file = policy.yaml {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-8a8ad7b2-cd2d-4375-af6b-4bf97974d9ba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:26:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8a8ad7b2-cd2d-4375-af6b-4bf97974d9ba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:26:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8a8ad7b2-cd2d-4375-af6b-4bf97974d9ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_policy.remote_timeout = 60.0 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] privsep_osbrick.group = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] privsep_osbrick.helper_command = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] privsep_osbrick.user = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] cinder_sys_admin.group = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] cinder_sys_admin.helper_command = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] cinder_sys_admin.user = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] service_user.auth_section = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] service_user.auth_type = password {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] service_user.cafile = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] service_user.certfile = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] service_user.collect_timing = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] service_user.insecure = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] service_user.keyfile = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] service_user.send_service_user_token = True {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] service_user.split_loggers = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] service_user.timeout = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] glance.auth_section = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] glance.auth_type = password {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] glance.certfile = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] glance.collect_timing = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] glance.insecure = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] glance.keyfile = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] glance.region_name = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] glance.split_loggers = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] glance.timeout = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.backend_availability_zone = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.chap_password = **** {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack sudo[93799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.chap_username = {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.disk_geometry = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack sudo[93799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.driver_client_cert = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.driver_client_cert_key = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.driver_data_namespace = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.driver_use_ssl = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.enable_unsupported_driver = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.extra_capabilities = {} {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.filter_function = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.goodness_function = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.iscsi_target_flags = {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.iscsi_write_cache = on {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.iser_helper = tgtadm {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.iser_ip_address = 192.168.122.106 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.iser_port = 3260 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.nas_host = {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.nas_login = admin {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.nas_mount_options = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.nas_password = **** {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.nas_private_key = {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.nas_share_path = {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.nas_ssh_port = 22 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.num_shell_tries = 3 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.nvmet_port_id = 1 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.quobyte_client_cfg = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.quobyte_volume_url = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.replication_device = **** {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.report_discard_supported = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.reserved_percentage = 0 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.scst_target_driver = iscsi {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.scst_target_iqn_name = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.storage_protocol = iSCSI {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.target_helper = tgtadm {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.target_ip_address = 192.168.122.106 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.target_port = 3260 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.target_protocol = iscsi {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.trace_flags = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.unique_fqdn_network = True {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.use_chap_auth = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.volume_backend_name = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.volume_clear = zero {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.volume_clear_ionice = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.volume_clear_size = 0 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_reports.file_event_handler = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_reports.log_dir = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.backend_availability_zone = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.backend_host = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.chap_password = **** {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.chap_username = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.chiscsi_conf = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.disk_geometry = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.driver_client_cert = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.driver_client_cert_key = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.driver_data_namespace = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.driver_use_ssl = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.enable_unsupported_driver = True {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.extra_capabilities = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.filter_function = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.goodness_function = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.iscsi_target_flags = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.iscsi_write_cache = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.iser_helper = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.iser_ip_address = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.iser_port = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.iser_target_prefix = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.nas_host = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.nas_login = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.nas_mount_options = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.nas_password = **** {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.nas_private_key = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.nas_share_path = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.nas_ssh_port = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.num_iser_scan_tries = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.num_shell_tries = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.nvmet_ns_id = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.nvmet_port_id = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.replication_device = **** {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.report_discard_supported = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.reserved_percentage = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.scst_target_driver = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.storage_protocol = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.target_helper = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.target_ip_address = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.target_port = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.target_prefix = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.target_protocol = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.trace_flags = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.unique_fqdn_network = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.use_chap_auth = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.volume_clear = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.volume_clear_ionice = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.volume_clear_size = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.volume_dd_blocksize = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] QuobyteHD.volumes_dir = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_messaging_rabbit.ssl = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_messaging_rabbit.ssl_version = {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_messaging_notifications.driver = [] {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_messaging_notifications.retry = -1 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] oslo_messaging_notifications.transport_url = **** {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] key_manager.fixed_key = **** {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] barbican.barbican_api_version = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] barbican.barbican_endpoint = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] barbican.barbican_endpoint_type = public {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] barbican.barbican_region_name = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] barbican.cafile = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] barbican.certfile = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] barbican.collect_timing = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] barbican.insecure = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] barbican.keyfile = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] barbican.number_of_retries = 60 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] barbican.retry_delay = 1 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] barbican.send_service_user_token = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] barbican.split_loggers = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] barbican.timeout = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] barbican.verify_ssl = True {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] barbican.verify_ssl_path = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] barbican_service_user.auth_section = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] barbican_service_user.auth_type = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] barbican_service_user.cafile = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] barbican_service_user.certfile = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] barbican_service_user.collect_timing = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] barbican_service_user.insecure = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] barbican_service_user.keyfile = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] barbican_service_user.split_loggers = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] barbican_service_user.timeout = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] vault.approle_role_id = **** {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] vault.approle_secret_id = **** {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] vault.kv_mountpoint = secret {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] vault.kv_path = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] vault.kv_version = 2 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] vault.namespace = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] vault.root_token_id = **** {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] vault.ssl_ca_crt_file = None {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] vault.timeout = 60.0 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] vault.use_ssl = False {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 16:26:24 devstack cinder-volume[93469]: DEBUG oslo_service.backend._eventlet.service [None req-4ca2e3cb-d5d9-4d5c-a014-373cd213858f None None] ******************************************************************************** {{(pid=93469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 23 16:26:24 devstack sudo[93799]: pam_unix(sudo:session): session closed for user root Jun 23 16:26:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8a8ad7b2-cd2d-4375-af6b-4bf97974d9ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.662s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:26:24 devstack cinder-volume[93788]: INFO cinder.volume.driver [None req-8a8ad7b2-cd2d-4375-af6b-4bf97974d9ba None None] Driver hasn't implemented _init_vendor_properties() Jun 23 16:26:24 devstack cinder-volume[93788]: DEBUG cinder.volume.driver [None req-8a8ad7b2-cd2d-4375-af6b-4bf97974d9ba None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5866012573242, 'free_capacity_gb': 1775.5866012573242, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93788) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 23 16:26:24 devstack cinder-volume[93788]: DEBUG oslo_db.sqlalchemy.engines [None req-8a8ad7b2-cd2d-4375-af6b-4bf97974d9ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93788) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 16:26:24 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writer thread running {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 23 16:26:24 devstack cinder-volume[93788]: DEBUG cinder.db.api [None req-8a8ad7b2-cd2d-4375-af6b-4bf97974d9ba None None] Building query based on filter {{(pid=93788) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 23 16:26:24 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-8a8ad7b2-cd2d-4375-af6b-4bf97974d9ba None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93788) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 23 16:26:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8a8ad7b2-cd2d-4375-af6b-4bf97974d9ba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:26:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8a8ad7b2-cd2d-4375-af6b-4bf97974d9ba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:26:24 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-8a8ad7b2-cd2d-4375-af6b-4bf97974d9ba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:26:24 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-8a8ad7b2-cd2d-4375-af6b-4bf97974d9ba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:26:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8a8ad7b2-cd2d-4375-af6b-4bf97974d9ba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:26:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8a8ad7b2-cd2d-4375-af6b-4bf97974d9ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:26:24 devstack cinder-volume[93788]: INFO cinder.keymgr.migration [None req-ed6142be-7554-4834-867f-755fa15c2ead None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 23 16:26:24 devstack sudo[93812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:26:24 devstack sudo[93812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:26:25 devstack sudo[93812]: pam_unix(sudo:session): session closed for user root Jun 23 16:26:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8a8ad7b2-cd2d-4375-af6b-4bf97974d9ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.624s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:26:25 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-8a8ad7b2-cd2d-4375-af6b-4bf97974d9ba None None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:26:25 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-8a8ad7b2-cd2d-4375-af6b-4bf97974d9ba None None] Driver initialization completed successfully. Jun 23 16:26:25 devstack cinder-volume[93788]: INFO cinder.manager [None req-8a8ad7b2-cd2d-4375-af6b-4bf97974d9ba None None] Initiating service 3 cleanup Jun 23 16:26:25 devstack cinder-volume[93788]: INFO cinder.manager [None req-8a8ad7b2-cd2d-4375-af6b-4bf97974d9ba None None] Service 3 cleanup completed. Jun 23 16:26:25 devstack cinder-volume[93788]: DEBUG cinder.service [None req-8a8ad7b2-cd2d-4375-af6b-4bf97974d9ba None None] Creating RPC server for service cinder-volume {{(pid=93788) start /opt/stack/cinder/cinder/service.py:231}} Jun 23 16:26:25 devstack cinder-volume[93788]: DEBUG cinder.service [None req-8a8ad7b2-cd2d-4375-af6b-4bf97974d9ba None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93788) start /opt/stack/cinder/cinder/service.py:237}} Jun 23 16:26:25 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-8a8ad7b2-cd2d-4375-af6b-4bf97974d9ba None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 23 16:26:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8a8ad7b2-cd2d-4375-af6b-4bf97974d9ba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:26:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8a8ad7b2-cd2d-4375-af6b-4bf97974d9ba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:26:25 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-8a8ad7b2-cd2d-4375-af6b-4bf97974d9ba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:26:25 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-8a8ad7b2-cd2d-4375-af6b-4bf97974d9ba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:26:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8a8ad7b2-cd2d-4375-af6b-4bf97974d9ba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:26:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8a8ad7b2-cd2d-4375-af6b-4bf97974d9ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:26:25 devstack sudo[93831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:26:25 devstack sudo[93831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:26:26 devstack sudo[93831]: pam_unix(sudo:session): session closed for user root Jun 23 16:26:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8a8ad7b2-cd2d-4375-af6b-4bf97974d9ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.615s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:26:26 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-8a8ad7b2-cd2d-4375-af6b-4bf97974d9ba None None] Driver post RPC initialization completed successfully. Jun 23 16:26:33 devstack cinder-volume[93469]: DEBUG dbcounter [-] [93469] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=93469) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:26:35 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:26:36 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:SELECT=3 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:27:01 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager._thread_info {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:27:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread count: 6 {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 16:27:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread info: [<_MainThread(MainThread, started 126303828988032)>, , , , , ] {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 16:27:56 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-12eacee8-5540-4b23-bae3-44dc3b9c811a tempest-DeleteServersTestJSON-507913475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:27:56 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-12eacee8-5540-4b23-bae3-44dc3b9c811a tempest-DeleteServersTestJSON-507913475 None] Flow 'volume_create_manager' (9b97dbee-8b95-46af-93e9-71e704487e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:27:56 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-12eacee8-5540-4b23-bae3-44dc3b9c811a tempest-DeleteServersTestJSON-507913475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b07edea-b317-493e-8b4f-b6a568b58949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:27:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-12eacee8-5540-4b23-bae3-44dc3b9c811a tempest-DeleteServersTestJSON-507913475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b07edea-b317-493e-8b4f-b6a568b58949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:27:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-250823389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a94ad49a-43d1-43bd-9116-0acf1c5f8df0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4edb77cadbd94096ba74b1ae7ac64493',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:27:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:27:57Z,use_quota=True,user_id='93da1d362f0c4a97a6f72513bef7f631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:27:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-12eacee8-5540-4b23-bae3-44dc3b9c811a tempest-DeleteServersTestJSON-507913475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b7848db-3577-49ea-891b-13fa8eb787d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:27:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-12eacee8-5540-4b23-bae3-44dc3b9c811a tempest-DeleteServersTestJSON-507913475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b7848db-3577-49ea-891b-13fa8eb787d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:27:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-12eacee8-5540-4b23-bae3-44dc3b9c811a tempest-DeleteServersTestJSON-507913475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7937d5a6-8dbb-4ba2-8778-0ad7fde54900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:27:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-12eacee8-5540-4b23-bae3-44dc3b9c811a tempest-DeleteServersTestJSON-507913475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7937d5a6-8dbb-4ba2-8778-0ad7fde54900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a94ad49a-43d1-43bd-9116-0acf1c5f8df0', 'volume_name': 'volume-a94ad49a-43d1-43bd-9116-0acf1c5f8df0', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:27:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-12eacee8-5540-4b23-bae3-44dc3b9c811a tempest-DeleteServersTestJSON-507913475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c21fb81b-71c1-48a2-965c-702ec29d9552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:27:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-12eacee8-5540-4b23-bae3-44dc3b9c811a tempest-DeleteServersTestJSON-507913475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c21fb81b-71c1-48a2-965c-702ec29d9552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:27:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-12eacee8-5540-4b23-bae3-44dc3b9c811a tempest-DeleteServersTestJSON-507913475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d82492b3-1392-4d0a-a098-eb75ac5c64d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:27:57 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-12eacee8-5540-4b23-bae3-44dc3b9c811a tempest-DeleteServersTestJSON-507913475 None] Volume a94ad49a-43d1-43bd-9116-0acf1c5f8df0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a94ad49a-43d1-43bd-9116-0acf1c5f8df0', 'volume_size': 1} Jun 23 16:27:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-12eacee8-5540-4b23-bae3-44dc3b9c811a tempest-DeleteServersTestJSON-507913475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:27:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-12eacee8-5540-4b23-bae3-44dc3b9c811a tempest-DeleteServersTestJSON-507913475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:27:57 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-12eacee8-5540-4b23-bae3-44dc3b9c811a tempest-DeleteServersTestJSON-507913475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:27:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-250823389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a94ad49a-43d1-43bd-9116-0acf1c5f8df0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4edb77cadbd94096ba74b1ae7ac64493',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:27:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:27:57Z,use_quota=True,user_id='93da1d362f0c4a97a6f72513bef7f631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:27:57 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-12eacee8-5540-4b23-bae3-44dc3b9c811a tempest-DeleteServersTestJSON-507913475 None] Creating volume a94ad49a-43d1-43bd-9116-0acf1c5f8df0 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:27:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-12eacee8-5540-4b23-bae3-44dc3b9c811a tempest-DeleteServersTestJSON-507913475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:27:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-12eacee8-5540-4b23-bae3-44dc3b9c811a tempest-DeleteServersTestJSON-507913475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:27:57 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-12eacee8-5540-4b23-bae3-44dc3b9c811a tempest-DeleteServersTestJSON-507913475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:27:57 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-12eacee8-5540-4b23-bae3-44dc3b9c811a tempest-DeleteServersTestJSON-507913475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:27:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-12eacee8-5540-4b23-bae3-44dc3b9c811a tempest-DeleteServersTestJSON-507913475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:27:57 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-12eacee8-5540-4b23-bae3-44dc3b9c811a tempest-DeleteServersTestJSON-507913475 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:27:57 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-12eacee8-5540-4b23-bae3-44dc3b9c811a tempest-DeleteServersTestJSON-507913475 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:27:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-12eacee8-5540-4b23-bae3-44dc3b9c811a tempest-DeleteServersTestJSON-507913475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-a94ad49a-43d1-43bd-9116-0acf1c5f8df0 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:27:57 devstack sudo[94627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-a94ad49a-43d1-43bd-9116-0acf1c5f8df0 1073741824 Jun 23 16:27:57 devstack sudo[94627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:27:59 devstack sudo[94627]: pam_unix(sudo:session): session closed for user root Jun 23 16:27:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-12eacee8-5540-4b23-bae3-44dc3b9c811a tempest-DeleteServersTestJSON-507913475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-a94ad49a-43d1-43bd-9116-0acf1c5f8df0 1073741824" returned: 0 in 1.932s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:27:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-12eacee8-5540-4b23-bae3-44dc3b9c811a tempest-DeleteServersTestJSON-507913475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-a94ad49a-43d1-43bd-9116-0acf1c5f8df0 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:27:59 devstack sudo[94948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-a94ad49a-43d1-43bd-9116-0acf1c5f8df0 Jun 23 16:27:59 devstack sudo[94948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:28:00 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8e36c98-263a-4130-b67c-fcf995476c71 tempest-VolumesAdminNegativeTest-1833502262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:28:00 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d8e36c98-263a-4130-b67c-fcf995476c71 tempest-VolumesAdminNegativeTest-1833502262 None] Flow 'volume_create_manager' (d78c8006-08c2-4291-b9fb-f2a1b83b4771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:28:00 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d8e36c98-263a-4130-b67c-fcf995476c71 tempest-VolumesAdminNegativeTest-1833502262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4464693-9ca8-43c9-8655-69585a74713a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:28:00 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d8e36c98-263a-4130-b67c-fcf995476c71 tempest-VolumesAdminNegativeTest-1833502262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4464693-9ca8-43c9-8655-69585a74713a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-520342164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ceb4777-89a3-4026-9c41-203abd6f6acb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b866ce50348246c5965a9331c17b8b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:28:00Z,use_quota=True,user_id='40e73e6f7c444bad82bc27b3ed314b0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:28:00 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d8e36c98-263a-4130-b67c-fcf995476c71 tempest-VolumesAdminNegativeTest-1833502262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41311ef9-e5c3-468a-875e-6e2dd62d3304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:28:00 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d8e36c98-263a-4130-b67c-fcf995476c71 tempest-VolumesAdminNegativeTest-1833502262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41311ef9-e5c3-468a-875e-6e2dd62d3304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:28:00 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d8e36c98-263a-4130-b67c-fcf995476c71 tempest-VolumesAdminNegativeTest-1833502262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ca53cdd-4996-44e4-94ea-15b6c1fdfebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:28:00 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d8e36c98-263a-4130-b67c-fcf995476c71 tempest-VolumesAdminNegativeTest-1833502262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ca53cdd-4996-44e4-94ea-15b6c1fdfebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ceb4777-89a3-4026-9c41-203abd6f6acb', 'volume_name': 'volume-0ceb4777-89a3-4026-9c41-203abd6f6acb', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:28:00 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d8e36c98-263a-4130-b67c-fcf995476c71 tempest-VolumesAdminNegativeTest-1833502262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0652932e-1895-4769-81f2-d7ab2231bc3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:28:00 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d8e36c98-263a-4130-b67c-fcf995476c71 tempest-VolumesAdminNegativeTest-1833502262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0652932e-1895-4769-81f2-d7ab2231bc3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:28:00 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d8e36c98-263a-4130-b67c-fcf995476c71 tempest-VolumesAdminNegativeTest-1833502262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daaca5af-7f5d-4ab9-8e46-33d8e11987ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:28:00 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-d8e36c98-263a-4130-b67c-fcf995476c71 tempest-VolumesAdminNegativeTest-1833502262 None] Volume 0ceb4777-89a3-4026-9c41-203abd6f6acb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ceb4777-89a3-4026-9c41-203abd6f6acb', 'volume_size': 1} Jun 23 16:28:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d8e36c98-263a-4130-b67c-fcf995476c71 tempest-VolumesAdminNegativeTest-1833502262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:28:00 devstack sudo[94948]: pam_unix(sudo:session): session closed for user root Jun 23 16:28:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-12eacee8-5540-4b23-bae3-44dc3b9c811a tempest-DeleteServersTestJSON-507913475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-a94ad49a-43d1-43bd-9116-0acf1c5f8df0" returned: 0 in 1.079s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:28:00 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-12eacee8-5540-4b23-bae3-44dc3b9c811a tempest-DeleteServersTestJSON-507913475 None] <== create_volume: return (3215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:28:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-12eacee8-5540-4b23-bae3-44dc3b9c811a tempest-DeleteServersTestJSON-507913475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.225s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:28:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d8e36c98-263a-4130-b67c-fcf995476c71 tempest-VolumesAdminNegativeTest-1833502262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.377s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:28:00 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-d8e36c98-263a-4130-b67c-fcf995476c71 tempest-VolumesAdminNegativeTest-1833502262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-520342164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ceb4777-89a3-4026-9c41-203abd6f6acb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b866ce50348246c5965a9331c17b8b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:28:00Z,use_quota=True,user_id='40e73e6f7c444bad82bc27b3ed314b0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:28:00 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-d8e36c98-263a-4130-b67c-fcf995476c71 tempest-VolumesAdminNegativeTest-1833502262 None] Creating volume 0ceb4777-89a3-4026-9c41-203abd6f6acb {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:28:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d8e36c98-263a-4130-b67c-fcf995476c71 tempest-VolumesAdminNegativeTest-1833502262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:28:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d8e36c98-263a-4130-b67c-fcf995476c71 tempest-VolumesAdminNegativeTest-1833502262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:28:00 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-d8e36c98-263a-4130-b67c-fcf995476c71 tempest-VolumesAdminNegativeTest-1833502262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:28:00 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-d8e36c98-263a-4130-b67c-fcf995476c71 tempest-VolumesAdminNegativeTest-1833502262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:28:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d8e36c98-263a-4130-b67c-fcf995476c71 tempest-VolumesAdminNegativeTest-1833502262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:28:00 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-d8e36c98-263a-4130-b67c-fcf995476c71 tempest-VolumesAdminNegativeTest-1833502262 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:28:00 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-d8e36c98-263a-4130-b67c-fcf995476c71 tempest-VolumesAdminNegativeTest-1833502262 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:28:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d8e36c98-263a-4130-b67c-fcf995476c71 tempest-VolumesAdminNegativeTest-1833502262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ceb4777-89a3-4026-9c41-203abd6f6acb 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:28:00 devstack sudo[94951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ceb4777-89a3-4026-9c41-203abd6f6acb 1073741824 Jun 23 16:28:00 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-12eacee8-5540-4b23-bae3-44dc3b9c811a tempest-DeleteServersTestJSON-507913475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d82492b3-1392-4d0a-a098-eb75ac5c64d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a94ad49a-43d1-43bd-9116-0acf1c5f8df0', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:28:00 devstack sudo[94951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:28:00 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-12eacee8-5540-4b23-bae3-44dc3b9c811a tempest-DeleteServersTestJSON-507913475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4696efc2-8047-4217-8fb7-4b3095e2aa39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:28:00 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-12eacee8-5540-4b23-bae3-44dc3b9c811a tempest-DeleteServersTestJSON-507913475 None] Volume volume-a94ad49a-43d1-43bd-9116-0acf1c5f8df0 (a94ad49a-43d1-43bd-9116-0acf1c5f8df0): created successfully Jun 23 16:28:00 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-12eacee8-5540-4b23-bae3-44dc3b9c811a tempest-DeleteServersTestJSON-507913475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4696efc2-8047-4217-8fb7-4b3095e2aa39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:28:00 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-12eacee8-5540-4b23-bae3-44dc3b9c811a tempest-DeleteServersTestJSON-507913475 None] Flow 'volume_create_manager' (9b97dbee-8b95-46af-93e9-71e704487e3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:28:00 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-12eacee8-5540-4b23-bae3-44dc3b9c811a tempest-DeleteServersTestJSON-507913475 None] Created volume successfully. Jun 23 16:28:01 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:28:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:28:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:28:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:28:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:28:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:28:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:28:01 devstack sudo[94953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:28:01 devstack sudo[94953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:28:02 devstack sudo[94951]: pam_unix(sudo:session): session closed for user root Jun 23 16:28:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d8e36c98-263a-4130-b67c-fcf995476c71 tempest-VolumesAdminNegativeTest-1833502262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ceb4777-89a3-4026-9c41-203abd6f6acb 1073741824" returned: 0 in 2.319s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:28:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d8e36c98-263a-4130-b67c-fcf995476c71 tempest-VolumesAdminNegativeTest-1833502262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ceb4777-89a3-4026-9c41-203abd6f6acb {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:28:03 devstack sudo[94953]: pam_unix(sudo:session): session closed for user root Jun 23 16:28:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.754s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:28:03 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:28:03 devstack sudo[95000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ceb4777-89a3-4026-9c41-203abd6f6acb Jun 23 16:28:03 devstack sudo[95000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:28:03 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager._thread_info {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:28:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread count: 6 {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 16:28:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread info: [<_MainThread(MainThread, started 126303828988032)>, , , , , ] {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 16:28:04 devstack sudo[95000]: pam_unix(sudo:session): session closed for user root Jun 23 16:28:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d8e36c98-263a-4130-b67c-fcf995476c71 tempest-VolumesAdminNegativeTest-1833502262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ceb4777-89a3-4026-9c41-203abd6f6acb" returned: 0 in 1.281s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:28:04 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-d8e36c98-263a-4130-b67c-fcf995476c71 tempest-VolumesAdminNegativeTest-1833502262 None] <== create_volume: return (3693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:28:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d8e36c98-263a-4130-b67c-fcf995476c71 tempest-VolumesAdminNegativeTest-1833502262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.700s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:28:04 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d8e36c98-263a-4130-b67c-fcf995476c71 tempest-VolumesAdminNegativeTest-1833502262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daaca5af-7f5d-4ab9-8e46-33d8e11987ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ceb4777-89a3-4026-9c41-203abd6f6acb', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:28:04 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d8e36c98-263a-4130-b67c-fcf995476c71 tempest-VolumesAdminNegativeTest-1833502262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9fa6aa2-567e-468b-a50a-25f0f82303e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:28:04 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-d8e36c98-263a-4130-b67c-fcf995476c71 tempest-VolumesAdminNegativeTest-1833502262 None] Volume volume-0ceb4777-89a3-4026-9c41-203abd6f6acb (0ceb4777-89a3-4026-9c41-203abd6f6acb): created successfully Jun 23 16:28:04 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d8e36c98-263a-4130-b67c-fcf995476c71 tempest-VolumesAdminNegativeTest-1833502262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9fa6aa2-567e-468b-a50a-25f0f82303e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:28:04 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d8e36c98-263a-4130-b67c-fcf995476c71 tempest-VolumesAdminNegativeTest-1833502262 None] Flow 'volume_create_manager' (d78c8006-08c2-4291-b9fb-f2a1b83b4771) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:28:04 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-d8e36c98-263a-4130-b67c-fcf995476c71 tempest-VolumesAdminNegativeTest-1833502262 None] Created volume successfully. Jun 23 16:28:06 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-89b8b51e-d8ce-469e-ae2e-48879e7b5506 tempest-VolumesAdminNegativeTest-1833502262 None] Acquiring lock "cinder-0ceb4777-89a3-4026-9c41-203abd6f6acb-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:28:06 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-89b8b51e-d8ce-469e-ae2e-48879e7b5506 tempest-VolumesAdminNegativeTest-1833502262 None] Lock "cinder-0ceb4777-89a3-4026-9c41-203abd6f6acb-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:28:06 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-89b8b51e-d8ce-469e-ae2e-48879e7b5506 tempest-VolumesAdminNegativeTest-1833502262 None] Acquiring lock "cinder-quobyte-0ceb4777-89a3-4026-9c41-203abd6f6acb" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:28:06 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-89b8b51e-d8ce-469e-ae2e-48879e7b5506 tempest-VolumesAdminNegativeTest-1833502262 None] Lock "cinder-quobyte-0ceb4777-89a3-4026-9c41-203abd6f6acb" acquired by "delete_volume" :: waited 0.030s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:28:06 devstack cinder-volume[93788]: INFO oslo.privsep.daemon [None req-89b8b51e-d8ce-469e-ae2e-48879e7b5506 tempest-VolumesAdminNegativeTest-1833502262 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmps9nyk66a/privsep.sock'] Jun 23 16:28:06 devstack sudo[95041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmps9nyk66a/privsep.sock Jun 23 16:28:06 devstack sudo[95041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:28:06 devstack cinder-volume[93788]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jun 23 16:28:06 devstack cinder-volume[93788]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 23 16:28:06 devstack cinder-volume[93788]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 23 16:28:06 devstack cinder-volume[93788]: WARNING oslo.privsep.daemon [-] privsep log: Jun 23 16:28:06 devstack cinder-volume[93788]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 23 16:28:06 devstack cinder-volume[93788]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 23 16:28:06 devstack cinder-volume[93788]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 23 16:28:06 devstack cinder-volume[93788]: WARNING oslo.privsep.daemon [-] privsep log: Jun 23 16:28:06 devstack cinder-volume[93788]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jun 23 16:28:07 devstack cinder-volume[93788]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jun 23 16:28:07 devstack cinder-volume[93788]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 23 16:28:07 devstack cinder-volume[93788]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 23 16:28:07 devstack cinder-volume[93788]: WARNING oslo.privsep.daemon [-] privsep log: Jun 23 16:28:07 devstack cinder-volume[93788]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 23 16:28:07 devstack cinder-volume[93788]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 23 16:28:07 devstack cinder-volume[93788]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 23 16:28:07 devstack cinder-volume[93788]: WARNING oslo.privsep.daemon [-] privsep log: Jun 23 16:28:07 devstack cinder-volume[93788]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jun 23 16:28:08 devstack cinder-volume[93788]: WARNING py.warnings [req-ca13677e-7601-4de0-98ae-0a8be73d16e1 req-8c5a9efd-2eee-493d-a78b-510ffad4437b tempest-DeleteServersTestJSON-507913475 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jun 23 16:28:08 devstack cinder-volume[93788]: .first() Jun 23 16:28:08 devstack cinder-volume[93788]: Jun 23 16:28:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-ca13677e-7601-4de0-98ae-0a8be73d16e1 req-8c5a9efd-2eee-493d-a78b-510ffad4437b tempest-DeleteServersTestJSON-507913475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:28:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-ca13677e-7601-4de0-98ae-0a8be73d16e1 req-8c5a9efd-2eee-493d-a78b-510ffad4437b tempest-DeleteServersTestJSON-507913475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:28:08 devstack sudo[95041]: pam_unix(sudo:session): session closed for user root Jun 23 16:28:08 devstack cinder-volume[93788]: INFO oslo.privsep.daemon [None req-89b8b51e-d8ce-469e-ae2e-48879e7b5506 tempest-VolumesAdminNegativeTest-1833502262 None] Spawned new privsep daemon via rootwrap Jun 23 16:28:08 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [None req-89b8b51e-d8ce-469e-ae2e-48879e7b5506 tempest-VolumesAdminNegativeTest-1833502262 None] Accepted privsep connection to /tmp/tmps9nyk66a/privsep.sock {{(pid=93788) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jun 23 16:28:08 devstack cinder-volume[93788]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 23 16:28:08 devstack cinder-volume[93788]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 23 16:28:08 devstack cinder-volume[93788]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jun 23 16:28:08 devstack cinder-volume[93788]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 95055 Jun 23 16:28:08 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6d6698-8248-49c6-9bb0-89bd6114bc3a]: (2,) {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:28:08 devstack cinder-volume[93788]: WARNING oslo_privsep.priv_context [req-ca13677e-7601-4de0-98ae-0a8be73d16e1 req-8c5a9efd-2eee-493d-a78b-510ffad4437b tempest-DeleteServersTestJSON-507913475 None] privsep daemon already running Jun 23 16:28:08 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0239dc7-8319-4e01-9228-0030d9e87726]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:28:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-ca13677e-7601-4de0-98ae-0a8be73d16e1 req-8c5a9efd-2eee-493d-a78b-510ffad4437b tempest-DeleteServersTestJSON-507913475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-a94ad49a-43d1-43bd-9116-0acf1c5f8df0 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:28:08 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86c2cea-f4f1-49ee-98df-604ea882d943]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:28:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-89b8b51e-d8ce-469e-ae2e-48879e7b5506 tempest-VolumesAdminNegativeTest-1833502262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ceb4777-89a3-4026-9c41-203abd6f6acb {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:28:08 devstack sudo[95061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ceb4777-89a3-4026-9c41-203abd6f6acb Jun 23 16:28:08 devstack sudo[95061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:28:08 devstack sudo[95060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-a94ad49a-43d1-43bd-9116-0acf1c5f8df0 Jun 23 16:28:08 devstack sudo[95060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:28:09 devstack sudo[95061]: pam_unix(sudo:session): session closed for user root Jun 23 16:28:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-89b8b51e-d8ce-469e-ae2e-48879e7b5506 tempest-VolumesAdminNegativeTest-1833502262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ceb4777-89a3-4026-9c41-203abd6f6acb" returned: 0 in 1.245s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:28:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-89b8b51e-d8ce-469e-ae2e-48879e7b5506 tempest-VolumesAdminNegativeTest-1833502262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ceb4777-89a3-4026-9c41-203abd6f6acb {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:28:09 devstack sudo[95072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ceb4777-89a3-4026-9c41-203abd6f6acb Jun 23 16:28:09 devstack sudo[95072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:28:09 devstack sudo[95060]: pam_unix(sudo:session): session closed for user root Jun 23 16:28:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-ca13677e-7601-4de0-98ae-0a8be73d16e1 req-8c5a9efd-2eee-493d-a78b-510ffad4437b tempest-DeleteServersTestJSON-507913475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-a94ad49a-43d1-43bd-9116-0acf1c5f8df0" returned: 0 in 1.433s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:28:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-ca13677e-7601-4de0-98ae-0a8be73d16e1 req-8c5a9efd-2eee-493d-a78b-510ffad4437b tempest-DeleteServersTestJSON-507913475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.723s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:28:09 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-ca13677e-7601-4de0-98ae-0a8be73d16e1 req-8c5a9efd-2eee-493d-a78b-510ffad4437b tempest-DeleteServersTestJSON-507913475 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e', 'name': 'volume-a94ad49a-43d1-43bd-9116-0acf1c5f8df0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '71576a19-b9e0-4475-a894-607a213b3892', 'enforce_multipath': True} {{(pid=93788) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 16:28:10 devstack cinder-volume[93788]: INFO cinder.volume.manager [req-ca13677e-7601-4de0-98ae-0a8be73d16e1 req-8c5a9efd-2eee-493d-a78b-510ffad4437b tempest-DeleteServersTestJSON-507913475 None] attachment_update completed successfully. Jun 23 16:28:10 devstack sudo[95072]: pam_unix(sudo:session): session closed for user root Jun 23 16:28:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-89b8b51e-d8ce-469e-ae2e-48879e7b5506 tempest-VolumesAdminNegativeTest-1833502262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ceb4777-89a3-4026-9c41-203abd6f6acb" returned: 0 in 0.935s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:28:10 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-89b8b51e-d8ce-469e-ae2e-48879e7b5506 tempest-VolumesAdminNegativeTest-1833502262 None] Lock "cinder-quobyte-0ceb4777-89a3-4026-9c41-203abd6f6acb" released by "delete_volume" :: held 4.475s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:28:10 devstack cinder-volume[93788]: WARNING cinder.quota [None req-89b8b51e-d8ce-469e-ae2e-48879e7b5506 tempest-VolumesAdminNegativeTest-1833502262 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:28:10 devstack cinder-volume[93788]: WARNING cinder.quota [None req-89b8b51e-d8ce-469e-ae2e-48879e7b5506 tempest-VolumesAdminNegativeTest-1833502262 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:28:10 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-89b8b51e-d8ce-469e-ae2e-48879e7b5506 tempest-VolumesAdminNegativeTest-1833502262 None] Created reservations ['dcd57fb1-edef-4cbe-8dad-2ae3c45b6975', '0523d4e4-0a0a-40c3-bb20-a65005eb3ee1', '62391a40-ffa6-4837-8f4a-831ba1da5134', 'aea1a2cf-6c1a-4d8e-a03d-8fe84f189499'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:28:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-89b8b51e-d8ce-469e-ae2e-48879e7b5506 tempest-VolumesAdminNegativeTest-1833502262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:28:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-89b8b51e-d8ce-469e-ae2e-48879e7b5506 tempest-VolumesAdminNegativeTest-1833502262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:28:11 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-89b8b51e-d8ce-469e-ae2e-48879e7b5506 tempest-VolumesAdminNegativeTest-1833502262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:28:11 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-89b8b51e-d8ce-469e-ae2e-48879e7b5506 tempest-VolumesAdminNegativeTest-1833502262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:28:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-89b8b51e-d8ce-469e-ae2e-48879e7b5506 tempest-VolumesAdminNegativeTest-1833502262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:28:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-89b8b51e-d8ce-469e-ae2e-48879e7b5506 tempest-VolumesAdminNegativeTest-1833502262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:28:11 devstack sudo[95077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:28:11 devstack sudo[95077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:28:12 devstack sudo[95077]: pam_unix(sudo:session): session closed for user root Jun 23 16:28:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-89b8b51e-d8ce-469e-ae2e-48879e7b5506 tempest-VolumesAdminNegativeTest-1833502262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.527s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:28:12 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-89b8b51e-d8ce-469e-ae2e-48879e7b5506 tempest-VolumesAdminNegativeTest-1833502262 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:28:12 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-89b8b51e-d8ce-469e-ae2e-48879e7b5506 tempest-VolumesAdminNegativeTest-1833502262 None] Deleted volume successfully. Jun 23 16:28:12 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-89b8b51e-d8ce-469e-ae2e-48879e7b5506 tempest-VolumesAdminNegativeTest-1833502262 None] Lock "cinder-0ceb4777-89a3-4026-9c41-203abd6f6acb-delete_volume" released by "delete_volume" :: held 6.628s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:28:21 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:SELECT=13,cinder:UPDATE=15,cinder:INSERT=2 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:28:21 devstack cinder-volume[93788]: INFO cinder.volume.manager [req-d7f7ea67-7b3b-4fe5-863a-bb6813c5922d req-541e4847-d6b2-4a9a-be05-3aa70f0ce6ba tempest-DeleteServersTestJSON-507913475 None] Terminate volume connection completed successfully. Jun 23 16:28:21 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-d7f7ea67-7b3b-4fe5-863a-bb6813c5922d req-541e4847-d6b2-4a9a-be05-3aa70f0ce6ba tempest-DeleteServersTestJSON-507913475 None] Deleting attachment 71576a19-b9e0-4475-a894-607a213b3892. {{(pid=93788) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 16:28:25 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e8616904-f17e-43cf-b55e-36cd60110e15 tempest-DeleteServersTestJSON-507913475 None] Acquiring lock "cinder-a94ad49a-43d1-43bd-9116-0acf1c5f8df0-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:28:25 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e8616904-f17e-43cf-b55e-36cd60110e15 tempest-DeleteServersTestJSON-507913475 None] Lock "cinder-a94ad49a-43d1-43bd-9116-0acf1c5f8df0-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:28:25 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e8616904-f17e-43cf-b55e-36cd60110e15 tempest-DeleteServersTestJSON-507913475 None] Acquiring lock "cinder-quobyte-a94ad49a-43d1-43bd-9116-0acf1c5f8df0" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:28:25 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e8616904-f17e-43cf-b55e-36cd60110e15 tempest-DeleteServersTestJSON-507913475 None] Lock "cinder-quobyte-a94ad49a-43d1-43bd-9116-0acf1c5f8df0" acquired by "delete_volume" :: waited 0.015s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:28:25 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[29106654-917c-4c36-9de9-ed40d8d3897b]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:28:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e8616904-f17e-43cf-b55e-36cd60110e15 tempest-DeleteServersTestJSON-507913475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-a94ad49a-43d1-43bd-9116-0acf1c5f8df0 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:28:25 devstack sudo[95665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-a94ad49a-43d1-43bd-9116-0acf1c5f8df0 Jun 23 16:28:25 devstack sudo[95665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:28:26 devstack sudo[95665]: pam_unix(sudo:session): session closed for user root Jun 23 16:28:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e8616904-f17e-43cf-b55e-36cd60110e15 tempest-DeleteServersTestJSON-507913475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-a94ad49a-43d1-43bd-9116-0acf1c5f8df0" returned: 0 in 0.922s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:28:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e8616904-f17e-43cf-b55e-36cd60110e15 tempest-DeleteServersTestJSON-507913475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-a94ad49a-43d1-43bd-9116-0acf1c5f8df0 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:28:26 devstack sudo[95671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-a94ad49a-43d1-43bd-9116-0acf1c5f8df0 Jun 23 16:28:26 devstack sudo[95671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:28:27 devstack sudo[95671]: pam_unix(sudo:session): session closed for user root Jun 23 16:28:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e8616904-f17e-43cf-b55e-36cd60110e15 tempest-DeleteServersTestJSON-507913475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-a94ad49a-43d1-43bd-9116-0acf1c5f8df0" returned: 0 in 0.977s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:28:27 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e8616904-f17e-43cf-b55e-36cd60110e15 tempest-DeleteServersTestJSON-507913475 None] Lock "cinder-quobyte-a94ad49a-43d1-43bd-9116-0acf1c5f8df0" released by "delete_volume" :: held 1.951s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:28:27 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-e8616904-f17e-43cf-b55e-36cd60110e15 tempest-DeleteServersTestJSON-507913475 None] Created reservations ['a0c0f295-febe-425a-9506-8e0706f262e7', 'decbeeca-fad1-4123-9462-377ec3d9992b', '37e92e31-ed61-47ac-a0fd-4977f2092259', 'da8cda03-4670-4bdc-9bb2-7c378b468b30'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:28:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e8616904-f17e-43cf-b55e-36cd60110e15 tempest-DeleteServersTestJSON-507913475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:28:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e8616904-f17e-43cf-b55e-36cd60110e15 tempest-DeleteServersTestJSON-507913475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:28:27 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e8616904-f17e-43cf-b55e-36cd60110e15 tempest-DeleteServersTestJSON-507913475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:28:27 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e8616904-f17e-43cf-b55e-36cd60110e15 tempest-DeleteServersTestJSON-507913475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:28:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e8616904-f17e-43cf-b55e-36cd60110e15 tempest-DeleteServersTestJSON-507913475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:28:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e8616904-f17e-43cf-b55e-36cd60110e15 tempest-DeleteServersTestJSON-507913475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:28:27 devstack sudo[95677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:28:27 devstack sudo[95677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:28:27 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-edda4546-eae3-4472-8b22-8ce5284a2719 tempest-AttachVolumeNegativeTest-727363408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:28:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-edda4546-eae3-4472-8b22-8ce5284a2719 tempest-AttachVolumeNegativeTest-727363408 None] Flow 'volume_create_manager' (b0700a4d-f03b-488f-b1ea-37fabd7e0203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:28:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-edda4546-eae3-4472-8b22-8ce5284a2719 tempest-AttachVolumeNegativeTest-727363408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (738d4a05-7b04-4ab0-96ce-c2df907950b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:28:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-edda4546-eae3-4472-8b22-8ce5284a2719 tempest-AttachVolumeNegativeTest-727363408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (738d4a05-7b04-4ab0-96ce-c2df907950b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-230222251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f141109-4eee-4811-9011-3ee89d30e83b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46203c955aba4e6d92ed58267fdb7d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:28:28Z,use_quota=True,user_id='d3fc74608e0644a58d45eb57dee0082c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:28:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-edda4546-eae3-4472-8b22-8ce5284a2719 tempest-AttachVolumeNegativeTest-727363408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5ff22e5-c7df-4060-9556-08108c6c63f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:28:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-edda4546-eae3-4472-8b22-8ce5284a2719 tempest-AttachVolumeNegativeTest-727363408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5ff22e5-c7df-4060-9556-08108c6c63f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:28:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-edda4546-eae3-4472-8b22-8ce5284a2719 tempest-AttachVolumeNegativeTest-727363408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa0cb141-c632-461e-b10e-2a6a07d9dda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:28:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-edda4546-eae3-4472-8b22-8ce5284a2719 tempest-AttachVolumeNegativeTest-727363408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa0cb141-c632-461e-b10e-2a6a07d9dda3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f141109-4eee-4811-9011-3ee89d30e83b', 'volume_name': 'volume-4f141109-4eee-4811-9011-3ee89d30e83b', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:28:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-edda4546-eae3-4472-8b22-8ce5284a2719 tempest-AttachVolumeNegativeTest-727363408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8ffa4b7-903f-48ed-9156-dee343366ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:28:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-edda4546-eae3-4472-8b22-8ce5284a2719 tempest-AttachVolumeNegativeTest-727363408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8ffa4b7-903f-48ed-9156-dee343366ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:28:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-edda4546-eae3-4472-8b22-8ce5284a2719 tempest-AttachVolumeNegativeTest-727363408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a73414c7-e824-4956-a56f-07bb75b5aae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:28:27 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-edda4546-eae3-4472-8b22-8ce5284a2719 tempest-AttachVolumeNegativeTest-727363408 None] Volume 4f141109-4eee-4811-9011-3ee89d30e83b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f141109-4eee-4811-9011-3ee89d30e83b', 'volume_size': 1} Jun 23 16:28:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-edda4546-eae3-4472-8b22-8ce5284a2719 tempest-AttachVolumeNegativeTest-727363408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:28:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-edda4546-eae3-4472-8b22-8ce5284a2719 tempest-AttachVolumeNegativeTest-727363408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:28:27 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-edda4546-eae3-4472-8b22-8ce5284a2719 tempest-AttachVolumeNegativeTest-727363408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-230222251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f141109-4eee-4811-9011-3ee89d30e83b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46203c955aba4e6d92ed58267fdb7d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:28:28Z,use_quota=True,user_id='d3fc74608e0644a58d45eb57dee0082c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:28:27 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-edda4546-eae3-4472-8b22-8ce5284a2719 tempest-AttachVolumeNegativeTest-727363408 None] Creating volume 4f141109-4eee-4811-9011-3ee89d30e83b {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:28:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-edda4546-eae3-4472-8b22-8ce5284a2719 tempest-AttachVolumeNegativeTest-727363408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:28:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-edda4546-eae3-4472-8b22-8ce5284a2719 tempest-AttachVolumeNegativeTest-727363408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:28:27 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-edda4546-eae3-4472-8b22-8ce5284a2719 tempest-AttachVolumeNegativeTest-727363408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:28:27 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-edda4546-eae3-4472-8b22-8ce5284a2719 tempest-AttachVolumeNegativeTest-727363408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:28:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-edda4546-eae3-4472-8b22-8ce5284a2719 tempest-AttachVolumeNegativeTest-727363408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:28:27 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-edda4546-eae3-4472-8b22-8ce5284a2719 tempest-AttachVolumeNegativeTest-727363408 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:28:27 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-edda4546-eae3-4472-8b22-8ce5284a2719 tempest-AttachVolumeNegativeTest-727363408 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:28:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-edda4546-eae3-4472-8b22-8ce5284a2719 tempest-AttachVolumeNegativeTest-727363408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4f141109-4eee-4811-9011-3ee89d30e83b 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:28:27 devstack sudo[95679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4f141109-4eee-4811-9011-3ee89d30e83b 1073741824 Jun 23 16:28:27 devstack sudo[95679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:28:28 devstack sudo[95677]: pam_unix(sudo:session): session closed for user root Jun 23 16:28:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e8616904-f17e-43cf-b55e-36cd60110e15 tempest-DeleteServersTestJSON-507913475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.731s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:28:28 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-e8616904-f17e-43cf-b55e-36cd60110e15 tempest-DeleteServersTestJSON-507913475 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:28:28 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-e8616904-f17e-43cf-b55e-36cd60110e15 tempest-DeleteServersTestJSON-507913475 None] Deleted volume successfully. Jun 23 16:28:28 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e8616904-f17e-43cf-b55e-36cd60110e15 tempest-DeleteServersTestJSON-507913475 None] Lock "cinder-a94ad49a-43d1-43bd-9116-0acf1c5f8df0-delete_volume" released by "delete_volume" :: held 3.056s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:28:29 devstack sudo[95679]: pam_unix(sudo:session): session closed for user root Jun 23 16:28:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-edda4546-eae3-4472-8b22-8ce5284a2719 tempest-AttachVolumeNegativeTest-727363408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4f141109-4eee-4811-9011-3ee89d30e83b 1073741824" returned: 0 in 1.212s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:28:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-edda4546-eae3-4472-8b22-8ce5284a2719 tempest-AttachVolumeNegativeTest-727363408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4f141109-4eee-4811-9011-3ee89d30e83b {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:28:29 devstack sudo[95688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4f141109-4eee-4811-9011-3ee89d30e83b Jun 23 16:28:29 devstack sudo[95688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:28:29 devstack sudo[95688]: pam_unix(sudo:session): session closed for user root Jun 23 16:28:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-edda4546-eae3-4472-8b22-8ce5284a2719 tempest-AttachVolumeNegativeTest-727363408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4f141109-4eee-4811-9011-3ee89d30e83b" returned: 0 in 0.684s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:28:29 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-edda4546-eae3-4472-8b22-8ce5284a2719 tempest-AttachVolumeNegativeTest-727363408 None] <== create_volume: return (1966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:28:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-edda4546-eae3-4472-8b22-8ce5284a2719 tempest-AttachVolumeNegativeTest-727363408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.970s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:28:29 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-edda4546-eae3-4472-8b22-8ce5284a2719 tempest-AttachVolumeNegativeTest-727363408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a73414c7-e824-4956-a56f-07bb75b5aae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f141109-4eee-4811-9011-3ee89d30e83b', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:28:29 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-edda4546-eae3-4472-8b22-8ce5284a2719 tempest-AttachVolumeNegativeTest-727363408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f0b477b-cb5a-4cea-bedb-134dbe447609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:28:29 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-edda4546-eae3-4472-8b22-8ce5284a2719 tempest-AttachVolumeNegativeTest-727363408 None] Volume volume-4f141109-4eee-4811-9011-3ee89d30e83b (4f141109-4eee-4811-9011-3ee89d30e83b): created successfully Jun 23 16:28:29 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-edda4546-eae3-4472-8b22-8ce5284a2719 tempest-AttachVolumeNegativeTest-727363408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f0b477b-cb5a-4cea-bedb-134dbe447609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:28:29 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-edda4546-eae3-4472-8b22-8ce5284a2719 tempest-AttachVolumeNegativeTest-727363408 None] Flow 'volume_create_manager' (b0700a4d-f03b-488f-b1ea-37fabd7e0203) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:28:29 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-edda4546-eae3-4472-8b22-8ce5284a2719 tempest-AttachVolumeNegativeTest-727363408 None] Created volume successfully. Jun 23 16:28:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-8a5f2b2a-85bd-460f-87a2-16ceeaa23e07 req-dc668527-8744-4b84-aef0-47aed8616635 tempest-AttachVolumeNegativeTest-727363408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:28:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-8a5f2b2a-85bd-460f-87a2-16ceeaa23e07 req-dc668527-8744-4b84-aef0-47aed8616635 tempest-AttachVolumeNegativeTest-727363408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:28:34 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e93a59d-07ca-46f3-b6c1-83fc4f89b64e]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:28:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-8a5f2b2a-85bd-460f-87a2-16ceeaa23e07 req-dc668527-8744-4b84-aef0-47aed8616635 tempest-AttachVolumeNegativeTest-727363408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4f141109-4eee-4811-9011-3ee89d30e83b {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:28:34 devstack sudo[95710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4f141109-4eee-4811-9011-3ee89d30e83b Jun 23 16:28:34 devstack sudo[95710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:28:35 devstack sudo[95710]: pam_unix(sudo:session): session closed for user root Jun 23 16:28:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-8a5f2b2a-85bd-460f-87a2-16ceeaa23e07 req-dc668527-8744-4b84-aef0-47aed8616635 tempest-AttachVolumeNegativeTest-727363408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4f141109-4eee-4811-9011-3ee89d30e83b" returned: 0 in 1.114s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:28:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-8a5f2b2a-85bd-460f-87a2-16ceeaa23e07 req-dc668527-8744-4b84-aef0-47aed8616635 tempest-AttachVolumeNegativeTest-727363408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.142s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:28:35 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-8a5f2b2a-85bd-460f-87a2-16ceeaa23e07 req-dc668527-8744-4b84-aef0-47aed8616635 tempest-AttachVolumeNegativeTest-727363408 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e', 'name': 'volume-4f141109-4eee-4811-9011-3ee89d30e83b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e9058348-a997-4c69-bc6d-46a75b82c27b', 'enforce_multipath': True} {{(pid=93788) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 16:28:35 devstack cinder-volume[93788]: INFO cinder.volume.manager [req-8a5f2b2a-85bd-460f-87a2-16ceeaa23e07 req-dc668527-8744-4b84-aef0-47aed8616635 tempest-AttachVolumeNegativeTest-727363408 None] attachment_update completed successfully. Jun 23 16:28:41 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d759a3e-af6e-405d-aba1-061c3228aa33 tempest-TaggedAttachmentsTest-2123601688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:28:41 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-9d759a3e-af6e-405d-aba1-061c3228aa33 tempest-TaggedAttachmentsTest-2123601688 None] Flow 'volume_create_manager' (726f0bdc-91b8-4ca4-93ab-72608a292565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:28:41 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-9d759a3e-af6e-405d-aba1-061c3228aa33 tempest-TaggedAttachmentsTest-2123601688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b531e01-4d08-4a6b-9fb9-deca5903eea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:28:41 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-9d759a3e-af6e-405d-aba1-061c3228aa33 tempest-TaggedAttachmentsTest-2123601688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b531e01-4d08-4a6b-9fb9-deca5903eea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:28:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2077276747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c05698c-1ec0-4e19-ac8c-1028bab6f17a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd5c08f2676a4c1ba6d537eea8f8fead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:28:41Z,use_quota=True,user_id='b81a1139d450432982822a457458ea90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:28:41 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-9d759a3e-af6e-405d-aba1-061c3228aa33 tempest-TaggedAttachmentsTest-2123601688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09fc9f06-1adb-4482-9134-0437f69e5d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:28:41 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-9d759a3e-af6e-405d-aba1-061c3228aa33 tempest-TaggedAttachmentsTest-2123601688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09fc9f06-1adb-4482-9134-0437f69e5d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:28:41 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-9d759a3e-af6e-405d-aba1-061c3228aa33 tempest-TaggedAttachmentsTest-2123601688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c105f531-b325-4d23-88bb-56d2539aa265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:28:41 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-9d759a3e-af6e-405d-aba1-061c3228aa33 tempest-TaggedAttachmentsTest-2123601688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c105f531-b325-4d23-88bb-56d2539aa265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c05698c-1ec0-4e19-ac8c-1028bab6f17a', 'volume_name': 'volume-7c05698c-1ec0-4e19-ac8c-1028bab6f17a', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:28:41 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-9d759a3e-af6e-405d-aba1-061c3228aa33 tempest-TaggedAttachmentsTest-2123601688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83c9570e-3257-4895-81bd-ab50310c550e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:28:41 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-9d759a3e-af6e-405d-aba1-061c3228aa33 tempest-TaggedAttachmentsTest-2123601688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83c9570e-3257-4895-81bd-ab50310c550e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:28:41 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-9d759a3e-af6e-405d-aba1-061c3228aa33 tempest-TaggedAttachmentsTest-2123601688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f010663-95c5-4bbc-a9db-e9b3a1370dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:28:41 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-9d759a3e-af6e-405d-aba1-061c3228aa33 tempest-TaggedAttachmentsTest-2123601688 None] Volume 7c05698c-1ec0-4e19-ac8c-1028bab6f17a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c05698c-1ec0-4e19-ac8c-1028bab6f17a', 'volume_size': 1} Jun 23 16:28:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-9d759a3e-af6e-405d-aba1-061c3228aa33 tempest-TaggedAttachmentsTest-2123601688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:28:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-9d759a3e-af6e-405d-aba1-061c3228aa33 tempest-TaggedAttachmentsTest-2123601688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:28:41 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-9d759a3e-af6e-405d-aba1-061c3228aa33 tempest-TaggedAttachmentsTest-2123601688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:28:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2077276747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c05698c-1ec0-4e19-ac8c-1028bab6f17a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd5c08f2676a4c1ba6d537eea8f8fead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:28:41Z,use_quota=True,user_id='b81a1139d450432982822a457458ea90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:28:41 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-9d759a3e-af6e-405d-aba1-061c3228aa33 tempest-TaggedAttachmentsTest-2123601688 None] Creating volume 7c05698c-1ec0-4e19-ac8c-1028bab6f17a {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:28:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-9d759a3e-af6e-405d-aba1-061c3228aa33 tempest-TaggedAttachmentsTest-2123601688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:28:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-9d759a3e-af6e-405d-aba1-061c3228aa33 tempest-TaggedAttachmentsTest-2123601688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:28:41 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-9d759a3e-af6e-405d-aba1-061c3228aa33 tempest-TaggedAttachmentsTest-2123601688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:28:41 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-9d759a3e-af6e-405d-aba1-061c3228aa33 tempest-TaggedAttachmentsTest-2123601688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:28:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-9d759a3e-af6e-405d-aba1-061c3228aa33 tempest-TaggedAttachmentsTest-2123601688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:28:41 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-9d759a3e-af6e-405d-aba1-061c3228aa33 tempest-TaggedAttachmentsTest-2123601688 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:28:41 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-9d759a3e-af6e-405d-aba1-061c3228aa33 tempest-TaggedAttachmentsTest-2123601688 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:28:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-9d759a3e-af6e-405d-aba1-061c3228aa33 tempest-TaggedAttachmentsTest-2123601688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7c05698c-1ec0-4e19-ac8c-1028bab6f17a 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:28:41 devstack sudo[96104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7c05698c-1ec0-4e19-ac8c-1028bab6f17a 1073741824 Jun 23 16:28:41 devstack sudo[96104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:28:42 devstack sudo[96104]: pam_unix(sudo:session): session closed for user root Jun 23 16:28:42 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-9d759a3e-af6e-405d-aba1-061c3228aa33 tempest-TaggedAttachmentsTest-2123601688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7c05698c-1ec0-4e19-ac8c-1028bab6f17a 1073741824" returned: 0 in 1.102s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:28:42 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-9d759a3e-af6e-405d-aba1-061c3228aa33 tempest-TaggedAttachmentsTest-2123601688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7c05698c-1ec0-4e19-ac8c-1028bab6f17a {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:28:42 devstack sudo[96110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7c05698c-1ec0-4e19-ac8c-1028bab6f17a Jun 23 16:28:42 devstack sudo[96110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:28:43 devstack sudo[96110]: pam_unix(sudo:session): session closed for user root Jun 23 16:28:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-9d759a3e-af6e-405d-aba1-061c3228aa33 tempest-TaggedAttachmentsTest-2123601688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7c05698c-1ec0-4e19-ac8c-1028bab6f17a" returned: 0 in 0.763s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:28:43 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-9d759a3e-af6e-405d-aba1-061c3228aa33 tempest-TaggedAttachmentsTest-2123601688 None] <== create_volume: return (1925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:28:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-9d759a3e-af6e-405d-aba1-061c3228aa33 tempest-TaggedAttachmentsTest-2123601688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.929s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:28:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-9d759a3e-af6e-405d-aba1-061c3228aa33 tempest-TaggedAttachmentsTest-2123601688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f010663-95c5-4bbc-a9db-e9b3a1370dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c05698c-1ec0-4e19-ac8c-1028bab6f17a', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:28:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-9d759a3e-af6e-405d-aba1-061c3228aa33 tempest-TaggedAttachmentsTest-2123601688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (076b9082-38f2-4420-8518-59d7bb2791e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:28:43 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-9d759a3e-af6e-405d-aba1-061c3228aa33 tempest-TaggedAttachmentsTest-2123601688 None] Volume volume-7c05698c-1ec0-4e19-ac8c-1028bab6f17a (7c05698c-1ec0-4e19-ac8c-1028bab6f17a): created successfully Jun 23 16:28:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-9d759a3e-af6e-405d-aba1-061c3228aa33 tempest-TaggedAttachmentsTest-2123601688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (076b9082-38f2-4420-8518-59d7bb2791e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:28:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-9d759a3e-af6e-405d-aba1-061c3228aa33 tempest-TaggedAttachmentsTest-2123601688 None] Flow 'volume_create_manager' (726f0bdc-91b8-4ca4-93ab-72608a292565) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:28:43 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-9d759a3e-af6e-405d-aba1-061c3228aa33 tempest-TaggedAttachmentsTest-2123601688 None] Created volume successfully. Jun 23 16:28:53 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:SELECT=13,cinder:INSERT=2,cinder:UPDATE=16,cinder:DELETE=1 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:28:53 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:UPDATE=32,cinder:SELECT=35,cinder:INSERT=8,cinder:DELETE=5 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:29:01 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:29:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:29:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:29:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:29:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:29:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:29:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:29:01 devstack sudo[96186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:29:01 devstack sudo[96186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:29:02 devstack sudo[96186]: pam_unix(sudo:session): session closed for user root Jun 23 16:29:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.892s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:29:02 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:29:44 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-f84a4e2c-ff9b-4654-84f8-dda18f24d51b tempest-ServerRescueNegativeTestJSON-494154758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:29:44 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f84a4e2c-ff9b-4654-84f8-dda18f24d51b tempest-ServerRescueNegativeTestJSON-494154758 None] Flow 'volume_create_manager' (69d58876-4e09-43aa-91b5-ec7671037d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:29:44 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f84a4e2c-ff9b-4654-84f8-dda18f24d51b tempest-ServerRescueNegativeTestJSON-494154758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c89052b-338e-495b-bbe7-1b1cbe7ec5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:29:45 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f84a4e2c-ff9b-4654-84f8-dda18f24d51b tempest-ServerRescueNegativeTestJSON-494154758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c89052b-338e-495b-bbe7-1b1cbe7ec5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-130364230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4651670a-c10f-4280-abf1-e5ba976daf00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a40c80f11ab14850bbbcef1f67fb97f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:29:45Z,use_quota=True,user_id='6d766fd100774ca4a6801fcb9d30b88d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:29:45 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f84a4e2c-ff9b-4654-84f8-dda18f24d51b tempest-ServerRescueNegativeTestJSON-494154758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43ac16c2-d6d1-49ba-a91c-fcf30e04ae9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:29:45 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f84a4e2c-ff9b-4654-84f8-dda18f24d51b tempest-ServerRescueNegativeTestJSON-494154758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43ac16c2-d6d1-49ba-a91c-fcf30e04ae9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:29:45 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f84a4e2c-ff9b-4654-84f8-dda18f24d51b tempest-ServerRescueNegativeTestJSON-494154758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23586567-6f29-4cd6-bb71-cb34a87fc004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:29:45 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f84a4e2c-ff9b-4654-84f8-dda18f24d51b tempest-ServerRescueNegativeTestJSON-494154758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23586567-6f29-4cd6-bb71-cb34a87fc004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4651670a-c10f-4280-abf1-e5ba976daf00', 'volume_name': 'volume-4651670a-c10f-4280-abf1-e5ba976daf00', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:29:45 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f84a4e2c-ff9b-4654-84f8-dda18f24d51b tempest-ServerRescueNegativeTestJSON-494154758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54c01b7f-ac5c-40e1-a661-e5514ac9a302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:29:45 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f84a4e2c-ff9b-4654-84f8-dda18f24d51b tempest-ServerRescueNegativeTestJSON-494154758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54c01b7f-ac5c-40e1-a661-e5514ac9a302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:29:45 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f84a4e2c-ff9b-4654-84f8-dda18f24d51b tempest-ServerRescueNegativeTestJSON-494154758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc70f918-7680-4219-b2ea-72d242abb7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:29:45 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-f84a4e2c-ff9b-4654-84f8-dda18f24d51b tempest-ServerRescueNegativeTestJSON-494154758 None] Volume 4651670a-c10f-4280-abf1-e5ba976daf00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4651670a-c10f-4280-abf1-e5ba976daf00', 'volume_size': 1} Jun 23 16:29:45 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f84a4e2c-ff9b-4654-84f8-dda18f24d51b tempest-ServerRescueNegativeTestJSON-494154758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:29:45 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f84a4e2c-ff9b-4654-84f8-dda18f24d51b tempest-ServerRescueNegativeTestJSON-494154758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:29:45 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-f84a4e2c-ff9b-4654-84f8-dda18f24d51b tempest-ServerRescueNegativeTestJSON-494154758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-130364230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4651670a-c10f-4280-abf1-e5ba976daf00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a40c80f11ab14850bbbcef1f67fb97f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:29:45Z,use_quota=True,user_id='6d766fd100774ca4a6801fcb9d30b88d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:29:45 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-f84a4e2c-ff9b-4654-84f8-dda18f24d51b tempest-ServerRescueNegativeTestJSON-494154758 None] Creating volume 4651670a-c10f-4280-abf1-e5ba976daf00 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:29:45 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f84a4e2c-ff9b-4654-84f8-dda18f24d51b tempest-ServerRescueNegativeTestJSON-494154758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:29:45 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f84a4e2c-ff9b-4654-84f8-dda18f24d51b tempest-ServerRescueNegativeTestJSON-494154758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:29:45 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-f84a4e2c-ff9b-4654-84f8-dda18f24d51b tempest-ServerRescueNegativeTestJSON-494154758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:29:45 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-f84a4e2c-ff9b-4654-84f8-dda18f24d51b tempest-ServerRescueNegativeTestJSON-494154758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:29:45 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f84a4e2c-ff9b-4654-84f8-dda18f24d51b tempest-ServerRescueNegativeTestJSON-494154758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:29:45 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-f84a4e2c-ff9b-4654-84f8-dda18f24d51b tempest-ServerRescueNegativeTestJSON-494154758 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:29:45 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-f84a4e2c-ff9b-4654-84f8-dda18f24d51b tempest-ServerRescueNegativeTestJSON-494154758 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:29:45 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f84a4e2c-ff9b-4654-84f8-dda18f24d51b tempest-ServerRescueNegativeTestJSON-494154758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4651670a-c10f-4280-abf1-e5ba976daf00 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:29:45 devstack sudo[97103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4651670a-c10f-4280-abf1-e5ba976daf00 1073741824 Jun 23 16:29:45 devstack sudo[97103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:29:46 devstack sudo[97103]: pam_unix(sudo:session): session closed for user root Jun 23 16:29:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f84a4e2c-ff9b-4654-84f8-dda18f24d51b tempest-ServerRescueNegativeTestJSON-494154758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4651670a-c10f-4280-abf1-e5ba976daf00 1073741824" returned: 0 in 1.024s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:29:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f84a4e2c-ff9b-4654-84f8-dda18f24d51b tempest-ServerRescueNegativeTestJSON-494154758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4651670a-c10f-4280-abf1-e5ba976daf00 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:29:46 devstack sudo[97115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4651670a-c10f-4280-abf1-e5ba976daf00 Jun 23 16:29:46 devstack sudo[97115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:29:47 devstack sudo[97115]: pam_unix(sudo:session): session closed for user root Jun 23 16:29:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f84a4e2c-ff9b-4654-84f8-dda18f24d51b tempest-ServerRescueNegativeTestJSON-494154758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4651670a-c10f-4280-abf1-e5ba976daf00" returned: 0 in 0.990s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:29:47 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-f84a4e2c-ff9b-4654-84f8-dda18f24d51b tempest-ServerRescueNegativeTestJSON-494154758 None] <== create_volume: return (2114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:29:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f84a4e2c-ff9b-4654-84f8-dda18f24d51b tempest-ServerRescueNegativeTestJSON-494154758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.120s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:29:47 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f84a4e2c-ff9b-4654-84f8-dda18f24d51b tempest-ServerRescueNegativeTestJSON-494154758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc70f918-7680-4219-b2ea-72d242abb7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4651670a-c10f-4280-abf1-e5ba976daf00', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:29:47 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f84a4e2c-ff9b-4654-84f8-dda18f24d51b tempest-ServerRescueNegativeTestJSON-494154758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f2db608-2ec9-4057-ba4c-e673289ff917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:29:47 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-f84a4e2c-ff9b-4654-84f8-dda18f24d51b tempest-ServerRescueNegativeTestJSON-494154758 None] Volume volume-4651670a-c10f-4280-abf1-e5ba976daf00 (4651670a-c10f-4280-abf1-e5ba976daf00): created successfully Jun 23 16:29:47 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f84a4e2c-ff9b-4654-84f8-dda18f24d51b tempest-ServerRescueNegativeTestJSON-494154758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f2db608-2ec9-4057-ba4c-e673289ff917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:29:47 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f84a4e2c-ff9b-4654-84f8-dda18f24d51b tempest-ServerRescueNegativeTestJSON-494154758 None] Flow 'volume_create_manager' (69d58876-4e09-43aa-91b5-ec7671037d25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:29:47 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-f84a4e2c-ff9b-4654-84f8-dda18f24d51b tempest-ServerRescueNegativeTestJSON-494154758 None] Created volume successfully. Jun 23 16:29:52 devstack cinder-volume[93788]: INFO cinder.volume.manager [req-489df2d7-528d-45f7-84f8-06f3d4f40a96 req-1abc99f9-4885-4a51-ae9d-9d8fe2eab734 tempest-AttachVolumeNegativeTest-727363408 None] Terminate volume connection completed successfully. Jun 23 16:29:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-489df2d7-528d-45f7-84f8-06f3d4f40a96 req-1abc99f9-4885-4a51-ae9d-9d8fe2eab734 tempest-AttachVolumeNegativeTest-727363408 None] Deleting attachment e9058348-a997-4c69-bc6d-46a75b82c27b. {{(pid=93788) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 16:29:57 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-473f3d9c-6411-476c-88f0-755913048fba tempest-AttachVolumeShelveTestJSON-427631815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:29:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-473f3d9c-6411-476c-88f0-755913048fba tempest-AttachVolumeShelveTestJSON-427631815 None] Flow 'volume_create_manager' (cf95f96f-73c8-4dbf-8132-d61ca76502da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:29:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-473f3d9c-6411-476c-88f0-755913048fba tempest-AttachVolumeShelveTestJSON-427631815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d63afa21-b2b4-4024-ad1f-f3baf532ba9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:29:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-473f3d9c-6411-476c-88f0-755913048fba tempest-AttachVolumeShelveTestJSON-427631815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d63afa21-b2b4-4024-ad1f-f3baf532ba9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-955267007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=653dd402-5c3c-4dec-8946-19422626ff89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8d7846c66294fb3acd88070431721cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:29:57Z,use_quota=True,user_id='6e54b9cc55be43ea8fdb3ab6b8cde1f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:29:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-473f3d9c-6411-476c-88f0-755913048fba tempest-AttachVolumeShelveTestJSON-427631815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6836ddc4-a2b3-4694-9880-2988e85485b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:29:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-473f3d9c-6411-476c-88f0-755913048fba tempest-AttachVolumeShelveTestJSON-427631815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6836ddc4-a2b3-4694-9880-2988e85485b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:29:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-473f3d9c-6411-476c-88f0-755913048fba tempest-AttachVolumeShelveTestJSON-427631815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eea4db51-c0b0-4699-a8af-2bb4273e5ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:29:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-473f3d9c-6411-476c-88f0-755913048fba tempest-AttachVolumeShelveTestJSON-427631815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eea4db51-c0b0-4699-a8af-2bb4273e5ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '653dd402-5c3c-4dec-8946-19422626ff89', 'volume_name': 'volume-653dd402-5c3c-4dec-8946-19422626ff89', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:29:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-473f3d9c-6411-476c-88f0-755913048fba tempest-AttachVolumeShelveTestJSON-427631815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69fcef3e-6126-4ab5-87ba-bbe830d27b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:29:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-473f3d9c-6411-476c-88f0-755913048fba tempest-AttachVolumeShelveTestJSON-427631815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69fcef3e-6126-4ab5-87ba-bbe830d27b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:29:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-473f3d9c-6411-476c-88f0-755913048fba tempest-AttachVolumeShelveTestJSON-427631815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dc1afc1-3b45-4f2c-951a-e46cd0042b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:29:57 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-473f3d9c-6411-476c-88f0-755913048fba tempest-AttachVolumeShelveTestJSON-427631815 None] Volume 653dd402-5c3c-4dec-8946-19422626ff89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-653dd402-5c3c-4dec-8946-19422626ff89', 'volume_size': 1} Jun 23 16:29:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-473f3d9c-6411-476c-88f0-755913048fba tempest-AttachVolumeShelveTestJSON-427631815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:29:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-473f3d9c-6411-476c-88f0-755913048fba tempest-AttachVolumeShelveTestJSON-427631815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:29:57 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-473f3d9c-6411-476c-88f0-755913048fba tempest-AttachVolumeShelveTestJSON-427631815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-955267007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=653dd402-5c3c-4dec-8946-19422626ff89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8d7846c66294fb3acd88070431721cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:29:57Z,use_quota=True,user_id='6e54b9cc55be43ea8fdb3ab6b8cde1f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:29:57 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-473f3d9c-6411-476c-88f0-755913048fba tempest-AttachVolumeShelveTestJSON-427631815 None] Creating volume 653dd402-5c3c-4dec-8946-19422626ff89 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:29:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-473f3d9c-6411-476c-88f0-755913048fba tempest-AttachVolumeShelveTestJSON-427631815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:29:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-473f3d9c-6411-476c-88f0-755913048fba tempest-AttachVolumeShelveTestJSON-427631815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:29:57 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-473f3d9c-6411-476c-88f0-755913048fba tempest-AttachVolumeShelveTestJSON-427631815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:29:57 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-473f3d9c-6411-476c-88f0-755913048fba tempest-AttachVolumeShelveTestJSON-427631815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:29:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-473f3d9c-6411-476c-88f0-755913048fba tempest-AttachVolumeShelveTestJSON-427631815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:29:57 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-473f3d9c-6411-476c-88f0-755913048fba tempest-AttachVolumeShelveTestJSON-427631815 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:29:57 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-473f3d9c-6411-476c-88f0-755913048fba tempest-AttachVolumeShelveTestJSON-427631815 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:29:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-473f3d9c-6411-476c-88f0-755913048fba tempest-AttachVolumeShelveTestJSON-427631815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-653dd402-5c3c-4dec-8946-19422626ff89 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:29:57 devstack sudo[97285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-653dd402-5c3c-4dec-8946-19422626ff89 1073741824 Jun 23 16:29:57 devstack sudo[97285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:29:58 devstack sudo[97285]: pam_unix(sudo:session): session closed for user root Jun 23 16:29:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-473f3d9c-6411-476c-88f0-755913048fba tempest-AttachVolumeShelveTestJSON-427631815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-653dd402-5c3c-4dec-8946-19422626ff89 1073741824" returned: 0 in 1.073s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:29:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-473f3d9c-6411-476c-88f0-755913048fba tempest-AttachVolumeShelveTestJSON-427631815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-653dd402-5c3c-4dec-8946-19422626ff89 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:29:58 devstack sudo[97310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-653dd402-5c3c-4dec-8946-19422626ff89 Jun 23 16:29:58 devstack sudo[97310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:29:59 devstack sudo[97310]: pam_unix(sudo:session): session closed for user root Jun 23 16:29:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-473f3d9c-6411-476c-88f0-755913048fba tempest-AttachVolumeShelveTestJSON-427631815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-653dd402-5c3c-4dec-8946-19422626ff89" returned: 0 in 0.955s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:29:59 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-473f3d9c-6411-476c-88f0-755913048fba tempest-AttachVolumeShelveTestJSON-427631815 None] <== create_volume: return (2075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:29:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-473f3d9c-6411-476c-88f0-755913048fba tempest-AttachVolumeShelveTestJSON-427631815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.077s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:29:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-473f3d9c-6411-476c-88f0-755913048fba tempest-AttachVolumeShelveTestJSON-427631815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dc1afc1-3b45-4f2c-951a-e46cd0042b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-653dd402-5c3c-4dec-8946-19422626ff89', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:29:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-473f3d9c-6411-476c-88f0-755913048fba tempest-AttachVolumeShelveTestJSON-427631815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e82d9d99-c30e-4bd1-9c18-1c25d67dbc34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:29:59 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-473f3d9c-6411-476c-88f0-755913048fba tempest-AttachVolumeShelveTestJSON-427631815 None] Volume volume-653dd402-5c3c-4dec-8946-19422626ff89 (653dd402-5c3c-4dec-8946-19422626ff89): created successfully Jun 23 16:29:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-473f3d9c-6411-476c-88f0-755913048fba tempest-AttachVolumeShelveTestJSON-427631815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e82d9d99-c30e-4bd1-9c18-1c25d67dbc34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:29:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-473f3d9c-6411-476c-88f0-755913048fba tempest-AttachVolumeShelveTestJSON-427631815 None] Flow 'volume_create_manager' (cf95f96f-73c8-4dbf-8132-d61ca76502da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:29:59 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-473f3d9c-6411-476c-88f0-755913048fba tempest-AttachVolumeShelveTestJSON-427631815 None] Created volume successfully. Jun 23 16:30:01 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:30:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:30:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:30:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:30:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:30:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:30:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:30:01 devstack sudo[97360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:30:01 devstack sudo[97360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:30:02 devstack sudo[97360]: pam_unix(sudo:session): session closed for user root Jun 23 16:30:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.990s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:30:02 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:30:02 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager._thread_info {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:30:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread count: 8 {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 16:30:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread info: [<_MainThread(MainThread, started 126303828988032)>, , , , , , , ] {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 16:30:09 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:SELECT=4,cinder:INSERT=2,cinder:UPDATE=5 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:30:09 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:SELECT=6,cinder:UPDATE=7,cinder:DELETE=2 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:30:11 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-8c7f54d2-107c-40eb-ac18-6d9efd17c6da tempest-ServerRescueNegativeTestJSON-494154758 None] Acquiring lock "cinder-4651670a-c10f-4280-abf1-e5ba976daf00-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:30:11 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-8c7f54d2-107c-40eb-ac18-6d9efd17c6da tempest-ServerRescueNegativeTestJSON-494154758 None] Lock "cinder-4651670a-c10f-4280-abf1-e5ba976daf00-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:30:11 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-8c7f54d2-107c-40eb-ac18-6d9efd17c6da tempest-ServerRescueNegativeTestJSON-494154758 None] Acquiring lock "cinder-quobyte-4651670a-c10f-4280-abf1-e5ba976daf00" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:30:11 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-8c7f54d2-107c-40eb-ac18-6d9efd17c6da tempest-ServerRescueNegativeTestJSON-494154758 None] Lock "cinder-quobyte-4651670a-c10f-4280-abf1-e5ba976daf00" acquired by "delete_volume" :: waited 0.047s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:30:11 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67954c9-b506-4911-ae17-f5130afdb090]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:30:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8c7f54d2-107c-40eb-ac18-6d9efd17c6da tempest-ServerRescueNegativeTestJSON-494154758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4651670a-c10f-4280-abf1-e5ba976daf00 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:30:11 devstack sudo[97554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4651670a-c10f-4280-abf1-e5ba976daf00 Jun 23 16:30:11 devstack sudo[97554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:30:13 devstack sudo[97554]: pam_unix(sudo:session): session closed for user root Jun 23 16:30:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8c7f54d2-107c-40eb-ac18-6d9efd17c6da tempest-ServerRescueNegativeTestJSON-494154758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4651670a-c10f-4280-abf1-e5ba976daf00" returned: 0 in 1.437s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:30:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8c7f54d2-107c-40eb-ac18-6d9efd17c6da tempest-ServerRescueNegativeTestJSON-494154758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4651670a-c10f-4280-abf1-e5ba976daf00 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:30:13 devstack sudo[97562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4651670a-c10f-4280-abf1-e5ba976daf00 Jun 23 16:30:13 devstack sudo[97562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:30:13 devstack sudo[97562]: pam_unix(sudo:session): session closed for user root Jun 23 16:30:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8c7f54d2-107c-40eb-ac18-6d9efd17c6da tempest-ServerRescueNegativeTestJSON-494154758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4651670a-c10f-4280-abf1-e5ba976daf00" returned: 0 in 0.726s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:30:13 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-8c7f54d2-107c-40eb-ac18-6d9efd17c6da tempest-ServerRescueNegativeTestJSON-494154758 None] Lock "cinder-quobyte-4651670a-c10f-4280-abf1-e5ba976daf00" released by "delete_volume" :: held 2.271s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:30:13 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-8c7f54d2-107c-40eb-ac18-6d9efd17c6da tempest-ServerRescueNegativeTestJSON-494154758 None] Created reservations ['8705352a-e45a-47c0-a485-57b82870cae9', '63d2e48f-3128-4d78-9a42-62c6ae7c2d6a', 'beb28377-b867-4353-9d95-2d08330d44cb', '817bfb38-35ca-41ad-976e-17ffc4b4ce24'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:30:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8c7f54d2-107c-40eb-ac18-6d9efd17c6da tempest-ServerRescueNegativeTestJSON-494154758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:30:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8c7f54d2-107c-40eb-ac18-6d9efd17c6da tempest-ServerRescueNegativeTestJSON-494154758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:30:13 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-8c7f54d2-107c-40eb-ac18-6d9efd17c6da tempest-ServerRescueNegativeTestJSON-494154758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:30:13 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-8c7f54d2-107c-40eb-ac18-6d9efd17c6da tempest-ServerRescueNegativeTestJSON-494154758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:30:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8c7f54d2-107c-40eb-ac18-6d9efd17c6da tempest-ServerRescueNegativeTestJSON-494154758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:30:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8c7f54d2-107c-40eb-ac18-6d9efd17c6da tempest-ServerRescueNegativeTestJSON-494154758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:30:13 devstack sudo[97566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:30:13 devstack sudo[97566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:30:14 devstack sudo[97566]: pam_unix(sudo:session): session closed for user root Jun 23 16:30:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8c7f54d2-107c-40eb-ac18-6d9efd17c6da tempest-ServerRescueNegativeTestJSON-494154758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.771s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:30:14 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-8c7f54d2-107c-40eb-ac18-6d9efd17c6da tempest-ServerRescueNegativeTestJSON-494154758 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:30:14 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-8c7f54d2-107c-40eb-ac18-6d9efd17c6da tempest-ServerRescueNegativeTestJSON-494154758 None] Deleted volume successfully. Jun 23 16:30:14 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-8c7f54d2-107c-40eb-ac18-6d9efd17c6da tempest-ServerRescueNegativeTestJSON-494154758 None] Lock "cinder-4651670a-c10f-4280-abf1-e5ba976daf00-delete_volume" released by "delete_volume" :: held 3.460s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:30:22 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-56d2c6f2-e90d-4a4e-adb6-780991459ae9 req-606acc4f-6d49-42b2-a55b-35ee686454ad tempest-AttachVolumeShelveTestJSON-427631815 None] No connector for attachment 0b0f2de7-f8f6-40db-a0c6-ff679bd0a79d; skipping storage backend terminate_connection call. {{(pid=93788) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jun 23 16:30:22 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-56d2c6f2-e90d-4a4e-adb6-780991459ae9 req-606acc4f-6d49-42b2-a55b-35ee686454ad tempest-AttachVolumeShelveTestJSON-427631815 None] Deleting attachment 0b0f2de7-f8f6-40db-a0c6-ff679bd0a79d. {{(pid=93788) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 16:30:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-37acf5e6-a44a-49c8-9454-d7e7cfa6c5b8 req-13f3484d-087b-489a-b7cd-5186a9f49a2e tempest-TaggedAttachmentsTest-2123601688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:30:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-37acf5e6-a44a-49c8-9454-d7e7cfa6c5b8 req-13f3484d-087b-489a-b7cd-5186a9f49a2e tempest-TaggedAttachmentsTest-2123601688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:30:23 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[85852912-bc37-432d-b7d3-44ff730c7f42]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:30:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-37acf5e6-a44a-49c8-9454-d7e7cfa6c5b8 req-13f3484d-087b-489a-b7cd-5186a9f49a2e tempest-TaggedAttachmentsTest-2123601688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7c05698c-1ec0-4e19-ac8c-1028bab6f17a {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:30:24 devstack sudo[97772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7c05698c-1ec0-4e19-ac8c-1028bab6f17a Jun 23 16:30:24 devstack sudo[97772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:30:24 devstack sudo[97772]: pam_unix(sudo:session): session closed for user root Jun 23 16:30:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-37acf5e6-a44a-49c8-9454-d7e7cfa6c5b8 req-13f3484d-087b-489a-b7cd-5186a9f49a2e tempest-TaggedAttachmentsTest-2123601688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7c05698c-1ec0-4e19-ac8c-1028bab6f17a" returned: 0 in 0.940s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:30:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-37acf5e6-a44a-49c8-9454-d7e7cfa6c5b8 req-13f3484d-087b-489a-b7cd-5186a9f49a2e tempest-TaggedAttachmentsTest-2123601688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.965s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:30:24 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-37acf5e6-a44a-49c8-9454-d7e7cfa6c5b8 req-13f3484d-087b-489a-b7cd-5186a9f49a2e tempest-TaggedAttachmentsTest-2123601688 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e', 'name': 'volume-7c05698c-1ec0-4e19-ac8c-1028bab6f17a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0cb1cc9c-db11-4c3b-bd58-0814d8bda267', 'enforce_multipath': True} {{(pid=93788) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 16:30:24 devstack cinder-volume[93788]: INFO cinder.volume.manager [req-37acf5e6-a44a-49c8-9454-d7e7cfa6c5b8 req-13f3484d-087b-489a-b7cd-5186a9f49a2e tempest-TaggedAttachmentsTest-2123601688 None] attachment_update completed successfully. Jun 23 16:30:32 devstack cinder-volume[93788]: INFO cinder.volume.manager [req-9a3d99a4-d34d-4033-9fd0-7f5c8602b8f0 req-959ed411-021b-4b2e-a23e-542e6b5a301e tempest-TaggedAttachmentsTest-2123601688 None] Terminate volume connection completed successfully. Jun 23 16:30:32 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-9a3d99a4-d34d-4033-9fd0-7f5c8602b8f0 req-959ed411-021b-4b2e-a23e-542e6b5a301e tempest-TaggedAttachmentsTest-2123601688 None] Deleting attachment 0cb1cc9c-db11-4c3b-bd58-0814d8bda267. {{(pid=93788) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 16:30:36 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:SELECT=11,cinder:INSERT=3,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:30:42 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:SELECT=15,cinder:UPDATE=11,cinder:INSERT=1 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:30:52 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-e10abff4-8129-4a24-80ef-2f97d0bb4875 tempest-AttachVolumeNegativeTest-727363408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:30:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e10abff4-8129-4a24-80ef-2f97d0bb4875 tempest-AttachVolumeNegativeTest-727363408 None] Flow 'volume_create_manager' (0e7cff85-a6ea-4af3-b227-4b260bf882ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:30:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e10abff4-8129-4a24-80ef-2f97d0bb4875 tempest-AttachVolumeNegativeTest-727363408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f98701a-5eaa-46d4-bbc7-3b3f2be688b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:30:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e10abff4-8129-4a24-80ef-2f97d0bb4875 tempest-AttachVolumeNegativeTest-727363408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f98701a-5eaa-46d4-bbc7-3b3f2be688b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:30:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-496280167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51dd9291-63e3-4e12-abc0-35adcb4357ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46203c955aba4e6d92ed58267fdb7d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:30:52Z,use_quota=True,user_id='d3fc74608e0644a58d45eb57dee0082c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:30:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e10abff4-8129-4a24-80ef-2f97d0bb4875 tempest-AttachVolumeNegativeTest-727363408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc8c1010-a1ff-483c-ad0e-95f0239b292b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:30:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e10abff4-8129-4a24-80ef-2f97d0bb4875 tempest-AttachVolumeNegativeTest-727363408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc8c1010-a1ff-483c-ad0e-95f0239b292b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:30:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e10abff4-8129-4a24-80ef-2f97d0bb4875 tempest-AttachVolumeNegativeTest-727363408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab42a80c-ba51-4635-adec-54a93f1d244d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:30:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e10abff4-8129-4a24-80ef-2f97d0bb4875 tempest-AttachVolumeNegativeTest-727363408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab42a80c-ba51-4635-adec-54a93f1d244d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51dd9291-63e3-4e12-abc0-35adcb4357ab', 'volume_name': 'volume-51dd9291-63e3-4e12-abc0-35adcb4357ab', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:30:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e10abff4-8129-4a24-80ef-2f97d0bb4875 tempest-AttachVolumeNegativeTest-727363408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d16f752-f40c-4a3f-8d2d-1c4de8689bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:30:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e10abff4-8129-4a24-80ef-2f97d0bb4875 tempest-AttachVolumeNegativeTest-727363408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d16f752-f40c-4a3f-8d2d-1c4de8689bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:30:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e10abff4-8129-4a24-80ef-2f97d0bb4875 tempest-AttachVolumeNegativeTest-727363408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8944cefd-fe0c-45f5-be6c-1a922b678469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:30:52 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-e10abff4-8129-4a24-80ef-2f97d0bb4875 tempest-AttachVolumeNegativeTest-727363408 None] Volume 51dd9291-63e3-4e12-abc0-35adcb4357ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51dd9291-63e3-4e12-abc0-35adcb4357ab', 'volume_size': 1} Jun 23 16:30:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e10abff4-8129-4a24-80ef-2f97d0bb4875 tempest-AttachVolumeNegativeTest-727363408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:30:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e10abff4-8129-4a24-80ef-2f97d0bb4875 tempest-AttachVolumeNegativeTest-727363408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:30:52 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e10abff4-8129-4a24-80ef-2f97d0bb4875 tempest-AttachVolumeNegativeTest-727363408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:30:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-496280167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51dd9291-63e3-4e12-abc0-35adcb4357ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46203c955aba4e6d92ed58267fdb7d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:30:52Z,use_quota=True,user_id='d3fc74608e0644a58d45eb57dee0082c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:30:52 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-e10abff4-8129-4a24-80ef-2f97d0bb4875 tempest-AttachVolumeNegativeTest-727363408 None] Creating volume 51dd9291-63e3-4e12-abc0-35adcb4357ab {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:30:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e10abff4-8129-4a24-80ef-2f97d0bb4875 tempest-AttachVolumeNegativeTest-727363408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:30:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e10abff4-8129-4a24-80ef-2f97d0bb4875 tempest-AttachVolumeNegativeTest-727363408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:30:52 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e10abff4-8129-4a24-80ef-2f97d0bb4875 tempest-AttachVolumeNegativeTest-727363408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:30:52 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e10abff4-8129-4a24-80ef-2f97d0bb4875 tempest-AttachVolumeNegativeTest-727363408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:30:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e10abff4-8129-4a24-80ef-2f97d0bb4875 tempest-AttachVolumeNegativeTest-727363408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:30:52 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e10abff4-8129-4a24-80ef-2f97d0bb4875 tempest-AttachVolumeNegativeTest-727363408 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:30:52 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-e10abff4-8129-4a24-80ef-2f97d0bb4875 tempest-AttachVolumeNegativeTest-727363408 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:30:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e10abff4-8129-4a24-80ef-2f97d0bb4875 tempest-AttachVolumeNegativeTest-727363408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-51dd9291-63e3-4e12-abc0-35adcb4357ab 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:30:52 devstack sudo[98655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-51dd9291-63e3-4e12-abc0-35adcb4357ab 1073741824 Jun 23 16:30:52 devstack sudo[98655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:30:54 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-76d89c01-67c4-4cc1-ad56-eadb911ca2d2 tempest-TaggedAttachmentsTest-2123601688 None] Acquiring lock "cinder-7c05698c-1ec0-4e19-ac8c-1028bab6f17a-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:30:54 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-76d89c01-67c4-4cc1-ad56-eadb911ca2d2 tempest-TaggedAttachmentsTest-2123601688 None] Lock "cinder-7c05698c-1ec0-4e19-ac8c-1028bab6f17a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:30:54 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-76d89c01-67c4-4cc1-ad56-eadb911ca2d2 tempest-TaggedAttachmentsTest-2123601688 None] Acquiring lock "cinder-quobyte-7c05698c-1ec0-4e19-ac8c-1028bab6f17a" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:30:54 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-76d89c01-67c4-4cc1-ad56-eadb911ca2d2 tempest-TaggedAttachmentsTest-2123601688 None] Lock "cinder-quobyte-7c05698c-1ec0-4e19-ac8c-1028bab6f17a" acquired by "delete_volume" :: waited 0.019s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:30:54 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[da226e72-d402-4f04-9dbe-762ae937a470]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:30:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-76d89c01-67c4-4cc1-ad56-eadb911ca2d2 tempest-TaggedAttachmentsTest-2123601688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7c05698c-1ec0-4e19-ac8c-1028bab6f17a {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:30:54 devstack sudo[98655]: pam_unix(sudo:session): session closed for user root Jun 23 16:30:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e10abff4-8129-4a24-80ef-2f97d0bb4875 tempest-AttachVolumeNegativeTest-727363408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-51dd9291-63e3-4e12-abc0-35adcb4357ab 1073741824" returned: 0 in 1.568s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:30:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e10abff4-8129-4a24-80ef-2f97d0bb4875 tempest-AttachVolumeNegativeTest-727363408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-51dd9291-63e3-4e12-abc0-35adcb4357ab {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:30:54 devstack sudo[98663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-51dd9291-63e3-4e12-abc0-35adcb4357ab Jun 23 16:30:54 devstack sudo[98663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:30:54 devstack sudo[98662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7c05698c-1ec0-4e19-ac8c-1028bab6f17a Jun 23 16:30:54 devstack sudo[98662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:30:55 devstack sudo[98663]: pam_unix(sudo:session): session closed for user root Jun 23 16:30:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e10abff4-8129-4a24-80ef-2f97d0bb4875 tempest-AttachVolumeNegativeTest-727363408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-51dd9291-63e3-4e12-abc0-35adcb4357ab" returned: 0 in 0.870s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:30:55 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e10abff4-8129-4a24-80ef-2f97d0bb4875 tempest-AttachVolumeNegativeTest-727363408 None] <== create_volume: return (2552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:30:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e10abff4-8129-4a24-80ef-2f97d0bb4875 tempest-AttachVolumeNegativeTest-727363408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.557s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:30:55 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e10abff4-8129-4a24-80ef-2f97d0bb4875 tempest-AttachVolumeNegativeTest-727363408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8944cefd-fe0c-45f5-be6c-1a922b678469) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51dd9291-63e3-4e12-abc0-35adcb4357ab', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:30:55 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e10abff4-8129-4a24-80ef-2f97d0bb4875 tempest-AttachVolumeNegativeTest-727363408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f77d90c-6f0f-4e73-a31a-866320ff8085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:30:55 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-e10abff4-8129-4a24-80ef-2f97d0bb4875 tempest-AttachVolumeNegativeTest-727363408 None] Volume volume-51dd9291-63e3-4e12-abc0-35adcb4357ab (51dd9291-63e3-4e12-abc0-35adcb4357ab): created successfully Jun 23 16:30:55 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e10abff4-8129-4a24-80ef-2f97d0bb4875 tempest-AttachVolumeNegativeTest-727363408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f77d90c-6f0f-4e73-a31a-866320ff8085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:30:55 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e10abff4-8129-4a24-80ef-2f97d0bb4875 tempest-AttachVolumeNegativeTest-727363408 None] Flow 'volume_create_manager' (0e7cff85-a6ea-4af3-b227-4b260bf882ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:30:55 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-e10abff4-8129-4a24-80ef-2f97d0bb4875 tempest-AttachVolumeNegativeTest-727363408 None] Created volume successfully. Jun 23 16:30:55 devstack sudo[98662]: pam_unix(sudo:session): session closed for user root Jun 23 16:30:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-76d89c01-67c4-4cc1-ad56-eadb911ca2d2 tempest-TaggedAttachmentsTest-2123601688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7c05698c-1ec0-4e19-ac8c-1028bab6f17a" returned: 0 in 1.170s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:30:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-76d89c01-67c4-4cc1-ad56-eadb911ca2d2 tempest-TaggedAttachmentsTest-2123601688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7c05698c-1ec0-4e19-ac8c-1028bab6f17a {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:30:55 devstack sudo[98670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7c05698c-1ec0-4e19-ac8c-1028bab6f17a Jun 23 16:30:55 devstack sudo[98670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:30:56 devstack sudo[98670]: pam_unix(sudo:session): session closed for user root Jun 23 16:30:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-76d89c01-67c4-4cc1-ad56-eadb911ca2d2 tempest-TaggedAttachmentsTest-2123601688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7c05698c-1ec0-4e19-ac8c-1028bab6f17a" returned: 0 in 0.868s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:30:56 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-76d89c01-67c4-4cc1-ad56-eadb911ca2d2 tempest-TaggedAttachmentsTest-2123601688 None] Lock "cinder-quobyte-7c05698c-1ec0-4e19-ac8c-1028bab6f17a" released by "delete_volume" :: held 2.120s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:30:56 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-76d89c01-67c4-4cc1-ad56-eadb911ca2d2 tempest-TaggedAttachmentsTest-2123601688 None] Created reservations ['6f67ce74-31d6-4048-9855-e7bcd4a25d45', 'f3c175aa-f0c1-4a64-8e1d-b754c1bd9493', '8cc94b2b-6423-4c73-82db-d74ceeadeb09', '5c8bf05d-b3dc-4eec-b7de-40e2c50c1437'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:30:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-76d89c01-67c4-4cc1-ad56-eadb911ca2d2 tempest-TaggedAttachmentsTest-2123601688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:30:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-76d89c01-67c4-4cc1-ad56-eadb911ca2d2 tempest-TaggedAttachmentsTest-2123601688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:30:56 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-76d89c01-67c4-4cc1-ad56-eadb911ca2d2 tempest-TaggedAttachmentsTest-2123601688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:30:56 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-76d89c01-67c4-4cc1-ad56-eadb911ca2d2 tempest-TaggedAttachmentsTest-2123601688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:30:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-76d89c01-67c4-4cc1-ad56-eadb911ca2d2 tempest-TaggedAttachmentsTest-2123601688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:30:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-76d89c01-67c4-4cc1-ad56-eadb911ca2d2 tempest-TaggedAttachmentsTest-2123601688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:30:56 devstack sudo[98678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:30:56 devstack sudo[98678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:30:57 devstack sudo[98678]: pam_unix(sudo:session): session closed for user root Jun 23 16:30:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-76d89c01-67c4-4cc1-ad56-eadb911ca2d2 tempest-TaggedAttachmentsTest-2123601688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.784s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:30:57 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-76d89c01-67c4-4cc1-ad56-eadb911ca2d2 tempest-TaggedAttachmentsTest-2123601688 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:30:57 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-76d89c01-67c4-4cc1-ad56-eadb911ca2d2 tempest-TaggedAttachmentsTest-2123601688 None] Deleted volume successfully. Jun 23 16:30:57 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-76d89c01-67c4-4cc1-ad56-eadb911ca2d2 tempest-TaggedAttachmentsTest-2123601688 None] Lock "cinder-7c05698c-1ec0-4e19-ac8c-1028bab6f17a-delete_volume" released by "delete_volume" :: held 3.273s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:30:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-fe593f39-c24e-41f9-9db7-c6d1fe11d3ea req-98bbe0a4-1d7a-4e9d-903d-fb82e0d63b2d tempest-AttachVolumeNegativeTest-727363408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:30:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-fe593f39-c24e-41f9-9db7-c6d1fe11d3ea req-98bbe0a4-1d7a-4e9d-903d-fb82e0d63b2d tempest-AttachVolumeNegativeTest-727363408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:30:59 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10a7a26-c21f-4609-9a56-c35a34772477]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:30:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-fe593f39-c24e-41f9-9db7-c6d1fe11d3ea req-98bbe0a4-1d7a-4e9d-903d-fb82e0d63b2d tempest-AttachVolumeNegativeTest-727363408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-51dd9291-63e3-4e12-abc0-35adcb4357ab {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:30:59 devstack sudo[98691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-51dd9291-63e3-4e12-abc0-35adcb4357ab Jun 23 16:30:59 devstack sudo[98691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:31:00 devstack sudo[98691]: pam_unix(sudo:session): session closed for user root Jun 23 16:31:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-fe593f39-c24e-41f9-9db7-c6d1fe11d3ea req-98bbe0a4-1d7a-4e9d-903d-fb82e0d63b2d tempest-AttachVolumeNegativeTest-727363408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-51dd9291-63e3-4e12-abc0-35adcb4357ab" returned: 0 in 1.251s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:31:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-fe593f39-c24e-41f9-9db7-c6d1fe11d3ea req-98bbe0a4-1d7a-4e9d-903d-fb82e0d63b2d tempest-AttachVolumeNegativeTest-727363408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.280s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:31:00 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-fe593f39-c24e-41f9-9db7-c6d1fe11d3ea req-98bbe0a4-1d7a-4e9d-903d-fb82e0d63b2d tempest-AttachVolumeNegativeTest-727363408 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e', 'name': 'volume-51dd9291-63e3-4e12-abc0-35adcb4357ab', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cc919971-b90d-42f7-b4cb-e2cc3a7ed814', 'enforce_multipath': True} {{(pid=93788) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 16:31:00 devstack cinder-volume[93788]: INFO cinder.volume.manager [req-fe593f39-c24e-41f9-9db7-c6d1fe11d3ea req-98bbe0a4-1d7a-4e9d-903d-fb82e0d63b2d tempest-AttachVolumeNegativeTest-727363408 None] attachment_update completed successfully. Jun 23 16:31:01 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:31:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:31:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:31:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:31:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:31:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:31:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:31:01 devstack sudo[98767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:31:01 devstack sudo[98767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:31:02 devstack sudo[98767]: pam_unix(sudo:session): session closed for user root Jun 23 16:31:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.016s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:31:02 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:31:02 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager._thread_info {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:31:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread count: 8 {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 16:31:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread info: [<_MainThread(MainThread, started 126303828988032)>, , , , , , , ] {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 16:31:08 devstack cinder-volume[93788]: INFO cinder.volume.manager [req-8c5cfd9d-14c7-4db4-bc40-116836ce169d req-2ad6d1da-87a4-4fd3-abb3-4c3c194ecba9 tempest-AttachVolumeNegativeTest-727363408 None] Terminate volume connection completed successfully. Jun 23 16:31:08 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-8c5cfd9d-14c7-4db4-bc40-116836ce169d req-2ad6d1da-87a4-4fd3-abb3-4c3c194ecba9 tempest-AttachVolumeNegativeTest-727363408 None] Deleting attachment cc919971-b90d-42f7-b4cb-e2cc3a7ed814. {{(pid=93788) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 16:31:18 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:SELECT=14,cinder:UPDATE=13,cinder:DELETE=2,cinder:INSERT=2 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:31:18 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:SELECT=13,cinder:UPDATE=12,cinder:INSERT=3 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:31:22 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-0e71c418-b1b0-4e5d-a1dd-e1912a90b26d tempest-AttachVolumeShelveTestJSON-427631815 None] Acquiring lock "cinder-653dd402-5c3c-4dec-8946-19422626ff89-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:31:22 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-0e71c418-b1b0-4e5d-a1dd-e1912a90b26d tempest-AttachVolumeShelveTestJSON-427631815 None] Lock "cinder-653dd402-5c3c-4dec-8946-19422626ff89-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:31:22 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-0e71c418-b1b0-4e5d-a1dd-e1912a90b26d tempest-AttachVolumeShelveTestJSON-427631815 None] Acquiring lock "cinder-quobyte-653dd402-5c3c-4dec-8946-19422626ff89" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:31:22 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-0e71c418-b1b0-4e5d-a1dd-e1912a90b26d tempest-AttachVolumeShelveTestJSON-427631815 None] Lock "cinder-quobyte-653dd402-5c3c-4dec-8946-19422626ff89" acquired by "delete_volume" :: waited 0.030s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:31:22 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1815d354-480c-42ab-9427-9d9bda07a60d]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:31:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0e71c418-b1b0-4e5d-a1dd-e1912a90b26d tempest-AttachVolumeShelveTestJSON-427631815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-653dd402-5c3c-4dec-8946-19422626ff89 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:31:22 devstack sudo[99329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-653dd402-5c3c-4dec-8946-19422626ff89 Jun 23 16:31:22 devstack sudo[99329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:31:24 devstack sudo[99329]: pam_unix(sudo:session): session closed for user root Jun 23 16:31:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0e71c418-b1b0-4e5d-a1dd-e1912a90b26d tempest-AttachVolumeShelveTestJSON-427631815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-653dd402-5c3c-4dec-8946-19422626ff89" returned: 0 in 1.562s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:31:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0e71c418-b1b0-4e5d-a1dd-e1912a90b26d tempest-AttachVolumeShelveTestJSON-427631815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-653dd402-5c3c-4dec-8946-19422626ff89 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:31:24 devstack sudo[99335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-653dd402-5c3c-4dec-8946-19422626ff89 Jun 23 16:31:24 devstack sudo[99335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:31:25 devstack sudo[99335]: pam_unix(sudo:session): session closed for user root Jun 23 16:31:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0e71c418-b1b0-4e5d-a1dd-e1912a90b26d tempest-AttachVolumeShelveTestJSON-427631815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-653dd402-5c3c-4dec-8946-19422626ff89" returned: 0 in 1.248s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:31:25 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-0e71c418-b1b0-4e5d-a1dd-e1912a90b26d tempest-AttachVolumeShelveTestJSON-427631815 None] Lock "cinder-quobyte-653dd402-5c3c-4dec-8946-19422626ff89" released by "delete_volume" :: held 2.896s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:31:25 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-0e71c418-b1b0-4e5d-a1dd-e1912a90b26d tempest-AttachVolumeShelveTestJSON-427631815 None] Created reservations ['a2bdb429-12bd-4973-8255-c93064caf494', 'dbde4f30-2d97-4e33-a83d-3504910f599f', '8b28ab0f-0db0-455a-b16f-e1edd25c7d7c', '1e082f79-eaee-4dbe-9061-0ce27f30e40c'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:31:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-0e71c418-b1b0-4e5d-a1dd-e1912a90b26d tempest-AttachVolumeShelveTestJSON-427631815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:31:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-0e71c418-b1b0-4e5d-a1dd-e1912a90b26d tempest-AttachVolumeShelveTestJSON-427631815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:31:25 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-0e71c418-b1b0-4e5d-a1dd-e1912a90b26d tempest-AttachVolumeShelveTestJSON-427631815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:31:25 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-0e71c418-b1b0-4e5d-a1dd-e1912a90b26d tempest-AttachVolumeShelveTestJSON-427631815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:31:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-0e71c418-b1b0-4e5d-a1dd-e1912a90b26d tempest-AttachVolumeShelveTestJSON-427631815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:31:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0e71c418-b1b0-4e5d-a1dd-e1912a90b26d tempest-AttachVolumeShelveTestJSON-427631815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:31:25 devstack sudo[99346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:31:25 devstack sudo[99346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:31:26 devstack sudo[99346]: pam_unix(sudo:session): session closed for user root Jun 23 16:31:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0e71c418-b1b0-4e5d-a1dd-e1912a90b26d tempest-AttachVolumeShelveTestJSON-427631815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.001s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:31:26 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-0e71c418-b1b0-4e5d-a1dd-e1912a90b26d tempest-AttachVolumeShelveTestJSON-427631815 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:31:26 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-0e71c418-b1b0-4e5d-a1dd-e1912a90b26d tempest-AttachVolumeShelveTestJSON-427631815 None] Deleted volume successfully. Jun 23 16:31:26 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-0e71c418-b1b0-4e5d-a1dd-e1912a90b26d tempest-AttachVolumeShelveTestJSON-427631815 None] Lock "cinder-653dd402-5c3c-4dec-8946-19422626ff89-delete_volume" released by "delete_volume" :: held 4.314s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:31:35 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:UPDATE=10,cinder:SELECT=3,cinder:INSERT=2 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:31:36 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:31:44 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-7fa2684e-1c49-4ccd-9ad6-5e9d9cd8a7bb tempest-BackendsCapabilitiesAdminTestsJSON-1653083323 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5866012573242, 'free_capacity_gb': 1775.5866012573242, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93788) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 23 16:31:45 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-70e38a30-964a-49c4-9ed8-cfc08644b7f9 tempest-BackendsCapabilitiesAdminTestsJSON-1653083323 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5866012573242, 'free_capacity_gb': 1775.5866012573242, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93788) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 23 16:31:58 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-a94a57f0-fea2-4947-8fc1-b681701f15c5 tempest-GroupSnapshotsV319Test-1165004876 None] Group tempest-GroupSnapshotsV319Test-Group-2026885756: creating Jun 23 16:31:58 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-a94a57f0-fea2-4947-8fc1-b681701f15c5 tempest-GroupSnapshotsV319Test-1165004876 None] Group tempest-GroupSnapshotsV319Test-Group-2026885756: created successfully Jun 23 16:31:58 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-a94a57f0-fea2-4947-8fc1-b681701f15c5 tempest-GroupSnapshotsV319Test-1165004876 None] Create group completed successfully. Jun 23 16:31:59 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba5c9644-198e-4b29-93b8-290f42c0decb tempest-ServersNegativeTestJSON-886109420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:31:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ba5c9644-198e-4b29-93b8-290f42c0decb tempest-ServersNegativeTestJSON-886109420 None] Flow 'volume_create_manager' (e620bc4e-5c2f-49b6-bd9f-0ee1f9691c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:31:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ba5c9644-198e-4b29-93b8-290f42c0decb tempest-ServersNegativeTestJSON-886109420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37a5fabf-d439-48a9-ab5b-6cba9ad782eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:31:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ba5c9644-198e-4b29-93b8-290f42c0decb tempest-ServersNegativeTestJSON-886109420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37a5fabf-d439-48a9-ab5b-6cba9ad782eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1615554004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd4d4391-2ace-4ce7-8aa9-3d9501f7b771,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='306d3bdaf56a4e9c8df789e9a6c569ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:31:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:31:59Z,use_quota=True,user_id='fb52d3f06ea3455a8c87f359d438cdbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:31:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ba5c9644-198e-4b29-93b8-290f42c0decb tempest-ServersNegativeTestJSON-886109420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdd425cc-007f-4152-995b-d44ab1175962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:31:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ba5c9644-198e-4b29-93b8-290f42c0decb tempest-ServersNegativeTestJSON-886109420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdd425cc-007f-4152-995b-d44ab1175962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:31:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ba5c9644-198e-4b29-93b8-290f42c0decb tempest-ServersNegativeTestJSON-886109420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bc4a3d3-a96c-4a55-b9ad-e2f14ea2596b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:31:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ba5c9644-198e-4b29-93b8-290f42c0decb tempest-ServersNegativeTestJSON-886109420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bc4a3d3-a96c-4a55-b9ad-e2f14ea2596b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd4d4391-2ace-4ce7-8aa9-3d9501f7b771', 'volume_name': 'volume-bd4d4391-2ace-4ce7-8aa9-3d9501f7b771', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:31:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ba5c9644-198e-4b29-93b8-290f42c0decb tempest-ServersNegativeTestJSON-886109420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24285ee6-fec9-4c6d-bc95-adbac1945d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:31:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ba5c9644-198e-4b29-93b8-290f42c0decb tempest-ServersNegativeTestJSON-886109420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24285ee6-fec9-4c6d-bc95-adbac1945d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:31:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ba5c9644-198e-4b29-93b8-290f42c0decb tempest-ServersNegativeTestJSON-886109420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc9ef1bb-33b7-4278-8e98-55aab3202939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:31:59 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-ba5c9644-198e-4b29-93b8-290f42c0decb tempest-ServersNegativeTestJSON-886109420 None] Volume bd4d4391-2ace-4ce7-8aa9-3d9501f7b771: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd4d4391-2ace-4ce7-8aa9-3d9501f7b771', 'volume_size': 1} Jun 23 16:31:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ba5c9644-198e-4b29-93b8-290f42c0decb tempest-ServersNegativeTestJSON-886109420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:31:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ba5c9644-198e-4b29-93b8-290f42c0decb tempest-ServersNegativeTestJSON-886109420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:31:59 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-ba5c9644-198e-4b29-93b8-290f42c0decb tempest-ServersNegativeTestJSON-886109420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1615554004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd4d4391-2ace-4ce7-8aa9-3d9501f7b771,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='306d3bdaf56a4e9c8df789e9a6c569ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:31:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:31:59Z,use_quota=True,user_id='fb52d3f06ea3455a8c87f359d438cdbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:31:59 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-ba5c9644-198e-4b29-93b8-290f42c0decb tempest-ServersNegativeTestJSON-886109420 None] Creating volume bd4d4391-2ace-4ce7-8aa9-3d9501f7b771 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:31:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ba5c9644-198e-4b29-93b8-290f42c0decb tempest-ServersNegativeTestJSON-886109420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:31:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ba5c9644-198e-4b29-93b8-290f42c0decb tempest-ServersNegativeTestJSON-886109420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:31:59 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-ba5c9644-198e-4b29-93b8-290f42c0decb tempest-ServersNegativeTestJSON-886109420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:31:59 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-ba5c9644-198e-4b29-93b8-290f42c0decb tempest-ServersNegativeTestJSON-886109420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:31:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ba5c9644-198e-4b29-93b8-290f42c0decb tempest-ServersNegativeTestJSON-886109420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:31:59 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-ba5c9644-198e-4b29-93b8-290f42c0decb tempest-ServersNegativeTestJSON-886109420 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:31:59 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-ba5c9644-198e-4b29-93b8-290f42c0decb tempest-ServersNegativeTestJSON-886109420 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:31:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ba5c9644-198e-4b29-93b8-290f42c0decb tempest-ServersNegativeTestJSON-886109420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bd4d4391-2ace-4ce7-8aa9-3d9501f7b771 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:31:59 devstack sudo[99783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bd4d4391-2ace-4ce7-8aa9-3d9501f7b771 1073741824 Jun 23 16:31:59 devstack sudo[99783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:32:00 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc8fbdc3-d019-4371-a408-1946384d069f tempest-GroupSnapshotsV319Test-1165004876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:32:00 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bc8fbdc3-d019-4371-a408-1946384d069f tempest-GroupSnapshotsV319Test-1165004876 None] Flow 'volume_create_manager' (47e06082-8d67-42a0-8a9f-280b93045ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:32:00 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bc8fbdc3-d019-4371-a408-1946384d069f tempest-GroupSnapshotsV319Test-1165004876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (839e007c-67b5-4315-b54f-8e99dc1f6a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:32:00 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bc8fbdc3-d019-4371-a408-1946384d069f tempest-GroupSnapshotsV319Test-1165004876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (839e007c-67b5-4315-b54f-8e99dc1f6a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:32:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1407825147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7ef26498-595b-469f-b9e0-e884254c455e,host='devstack@QuobyteHD#QuobyteHD',id=69dfdfab-47b3-49f3-92bd-d7927b6ac6ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d8f3ebad8a7461bad446d968e960eb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:32:00Z,use_quota=True,user_id='3d8ae04389a14d12af7507cbbf4cf8b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a7d4b4d-d545-4418-b8c0-d1ca767c14d1),volume_type_id=2a7d4b4d-d545-4418-b8c0-d1ca767c14d1)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:32:00 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bc8fbdc3-d019-4371-a408-1946384d069f tempest-GroupSnapshotsV319Test-1165004876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7320502d-2196-4964-9e84-f42410f7d3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:32:00 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bc8fbdc3-d019-4371-a408-1946384d069f tempest-GroupSnapshotsV319Test-1165004876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7320502d-2196-4964-9e84-f42410f7d3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:32:00 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bc8fbdc3-d019-4371-a408-1946384d069f tempest-GroupSnapshotsV319Test-1165004876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac525468-b19c-4a98-9f97-d5a8d60f57d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:32:00 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bc8fbdc3-d019-4371-a408-1946384d069f tempest-GroupSnapshotsV319Test-1165004876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac525468-b19c-4a98-9f97-d5a8d60f57d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69dfdfab-47b3-49f3-92bd-d7927b6ac6ee', 'volume_name': 'volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:32:00 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bc8fbdc3-d019-4371-a408-1946384d069f tempest-GroupSnapshotsV319Test-1165004876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c29100c3-d477-440e-92c4-c129e2bead80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:32:00 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bc8fbdc3-d019-4371-a408-1946384d069f tempest-GroupSnapshotsV319Test-1165004876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c29100c3-d477-440e-92c4-c129e2bead80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:32:00 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bc8fbdc3-d019-4371-a408-1946384d069f tempest-GroupSnapshotsV319Test-1165004876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8724786-3919-4f7c-a244-fddd305134e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:32:00 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-bc8fbdc3-d019-4371-a408-1946384d069f tempest-GroupSnapshotsV319Test-1165004876 None] Volume 69dfdfab-47b3-49f3-92bd-d7927b6ac6ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee', 'volume_size': 1} Jun 23 16:32:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-bc8fbdc3-d019-4371-a408-1946384d069f tempest-GroupSnapshotsV319Test-1165004876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:32:00 devstack sudo[99783]: pam_unix(sudo:session): session closed for user root Jun 23 16:32:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ba5c9644-198e-4b29-93b8-290f42c0decb tempest-ServersNegativeTestJSON-886109420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bd4d4391-2ace-4ce7-8aa9-3d9501f7b771 1073741824" returned: 0 in 1.411s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:32:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ba5c9644-198e-4b29-93b8-290f42c0decb tempest-ServersNegativeTestJSON-886109420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bd4d4391-2ace-4ce7-8aa9-3d9501f7b771 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:32:00 devstack sudo[99789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bd4d4391-2ace-4ce7-8aa9-3d9501f7b771 Jun 23 16:32:00 devstack sudo[99789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:32:01 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:32:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:32:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:32:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:32:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:32:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:32:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:32:01 devstack sudo[99792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:32:01 devstack sudo[99792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:32:01 devstack sudo[99789]: pam_unix(sudo:session): session closed for user root Jun 23 16:32:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ba5c9644-198e-4b29-93b8-290f42c0decb tempest-ServersNegativeTestJSON-886109420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bd4d4391-2ace-4ce7-8aa9-3d9501f7b771" returned: 0 in 0.882s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:32:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-ba5c9644-198e-4b29-93b8-290f42c0decb tempest-ServersNegativeTestJSON-886109420 None] <== create_volume: return (2344ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:32:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ba5c9644-198e-4b29-93b8-290f42c0decb tempest-ServersNegativeTestJSON-886109420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.349s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:32:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-bc8fbdc3-d019-4371-a408-1946384d069f tempest-GroupSnapshotsV319Test-1165004876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.145s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:32:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-bc8fbdc3-d019-4371-a408-1946384d069f tempest-GroupSnapshotsV319Test-1165004876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7ef26498-595b-469f-b9e0-e884254c455e,created_at=2026-06-23T14:32:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1407825147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7ef26498-595b-469f-b9e0-e884254c455e,host='devstack@QuobyteHD#QuobyteHD',id=69dfdfab-47b3-49f3-92bd-d7927b6ac6ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d8f3ebad8a7461bad446d968e960eb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:32:00Z,use_quota=True,user_id='3d8ae04389a14d12af7507cbbf4cf8b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a7d4b4d-d545-4418-b8c0-d1ca767c14d1),volume_type_id=2a7d4b4d-d545-4418-b8c0-d1ca767c14d1)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:32:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-bc8fbdc3-d019-4371-a408-1946384d069f tempest-GroupSnapshotsV319Test-1165004876 None] Creating volume 69dfdfab-47b3-49f3-92bd-d7927b6ac6ee {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:32:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-bc8fbdc3-d019-4371-a408-1946384d069f tempest-GroupSnapshotsV319Test-1165004876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:32:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-bc8fbdc3-d019-4371-a408-1946384d069f tempest-GroupSnapshotsV319Test-1165004876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:32:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-bc8fbdc3-d019-4371-a408-1946384d069f tempest-GroupSnapshotsV319Test-1165004876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:32:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-bc8fbdc3-d019-4371-a408-1946384d069f tempest-GroupSnapshotsV319Test-1165004876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:32:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-bc8fbdc3-d019-4371-a408-1946384d069f tempest-GroupSnapshotsV319Test-1165004876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:32:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-bc8fbdc3-d019-4371-a408-1946384d069f tempest-GroupSnapshotsV319Test-1165004876 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:32:01 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-bc8fbdc3-d019-4371-a408-1946384d069f tempest-GroupSnapshotsV319Test-1165004876 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:32:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-bc8fbdc3-d019-4371-a408-1946384d069f tempest-GroupSnapshotsV319Test-1165004876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:32:01 devstack sudo[99831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee 1073741824 Jun 23 16:32:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ba5c9644-198e-4b29-93b8-290f42c0decb tempest-ServersNegativeTestJSON-886109420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc9ef1bb-33b7-4278-8e98-55aab3202939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd4d4391-2ace-4ce7-8aa9-3d9501f7b771', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:32:01 devstack sudo[99831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:32:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ba5c9644-198e-4b29-93b8-290f42c0decb tempest-ServersNegativeTestJSON-886109420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d6a928d-8bf7-450c-9d83-c17dc786f46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:32:01 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-ba5c9644-198e-4b29-93b8-290f42c0decb tempest-ServersNegativeTestJSON-886109420 None] Volume volume-bd4d4391-2ace-4ce7-8aa9-3d9501f7b771 (bd4d4391-2ace-4ce7-8aa9-3d9501f7b771): created successfully Jun 23 16:32:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ba5c9644-198e-4b29-93b8-290f42c0decb tempest-ServersNegativeTestJSON-886109420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d6a928d-8bf7-450c-9d83-c17dc786f46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:32:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ba5c9644-198e-4b29-93b8-290f42c0decb tempest-ServersNegativeTestJSON-886109420 None] Flow 'volume_create_manager' (e620bc4e-5c2f-49b6-bd9f-0ee1f9691c43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:32:01 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-ba5c9644-198e-4b29-93b8-290f42c0decb tempest-ServersNegativeTestJSON-886109420 None] Created volume successfully. Jun 23 16:32:02 devstack sudo[99792]: pam_unix(sudo:session): session closed for user root Jun 23 16:32:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.903s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:32:02 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:32:02 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager._thread_info {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:32:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread count: 8 {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 16:32:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread info: [<_MainThread(MainThread, started 126303828988032)>, , , , , , , ] {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 16:32:02 devstack sudo[99831]: pam_unix(sudo:session): session closed for user root Jun 23 16:32:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-bc8fbdc3-d019-4371-a408-1946384d069f tempest-GroupSnapshotsV319Test-1165004876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee 1073741824" returned: 0 in 0.985s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:32:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-bc8fbdc3-d019-4371-a408-1946384d069f tempest-GroupSnapshotsV319Test-1165004876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:32:02 devstack sudo[99838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee Jun 23 16:32:02 devstack sudo[99838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:32:03 devstack sudo[99838]: pam_unix(sudo:session): session closed for user root Jun 23 16:32:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-bc8fbdc3-d019-4371-a408-1946384d069f tempest-GroupSnapshotsV319Test-1165004876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee" returned: 0 in 0.668s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:32:03 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-bc8fbdc3-d019-4371-a408-1946384d069f tempest-GroupSnapshotsV319Test-1165004876 None] <== create_volume: return (1728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:32:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-bc8fbdc3-d019-4371-a408-1946384d069f tempest-GroupSnapshotsV319Test-1165004876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.730s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:32:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bc8fbdc3-d019-4371-a408-1946384d069f tempest-GroupSnapshotsV319Test-1165004876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8724786-3919-4f7c-a244-fddd305134e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:32:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bc8fbdc3-d019-4371-a408-1946384d069f tempest-GroupSnapshotsV319Test-1165004876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc188abe-3bb3-4ba7-aa2d-ef0b512ef0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:32:03 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-bc8fbdc3-d019-4371-a408-1946384d069f tempest-GroupSnapshotsV319Test-1165004876 None] Volume volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee (69dfdfab-47b3-49f3-92bd-d7927b6ac6ee): created successfully Jun 23 16:32:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bc8fbdc3-d019-4371-a408-1946384d069f tempest-GroupSnapshotsV319Test-1165004876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc188abe-3bb3-4ba7-aa2d-ef0b512ef0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:32:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bc8fbdc3-d019-4371-a408-1946384d069f tempest-GroupSnapshotsV319Test-1165004876 None] Flow 'volume_create_manager' (47e06082-8d67-42a0-8a9f-280b93045ddb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:32:03 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-bc8fbdc3-d019-4371-a408-1946384d069f tempest-GroupSnapshotsV319Test-1165004876 None] Created volume successfully. Jun 23 16:32:04 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0e1d595-98b1-4101-9c58-dbb80ec9b435 tempest-ServersNegativeTestJSON-886109420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:32:04 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d0e1d595-98b1-4101-9c58-dbb80ec9b435 tempest-ServersNegativeTestJSON-886109420 None] Flow 'volume_create_manager' (47434be4-618d-4fb9-bd48-cb78dce1abbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:32:04 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d0e1d595-98b1-4101-9c58-dbb80ec9b435 tempest-ServersNegativeTestJSON-886109420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bb579ac-98d2-4f2d-ab6b-1b3268f74198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:32:04 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-9e086c0a-ceaf-4e1b-b77b-99710a15b885 tempest-GroupSnapshotsV319Test-1165004876 None] GroupSnapshot 4ca50d15-d599-4573-905b-adb91afc726a: creating. Jun 23 16:32:04 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d0e1d595-98b1-4101-9c58-dbb80ec9b435 tempest-ServersNegativeTestJSON-886109420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bb579ac-98d2-4f2d-ab6b-1b3268f74198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:32:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1103806473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0e7cd0b-39df-4bc7-b733-4e27630bfdd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='306d3bdaf56a4e9c8df789e9a6c569ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:32:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:32:04Z,use_quota=True,user_id='fb52d3f06ea3455a8c87f359d438cdbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:32:04 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d0e1d595-98b1-4101-9c58-dbb80ec9b435 tempest-ServersNegativeTestJSON-886109420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1959fd81-c6be-4731-800f-154f458dcb4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:32:04 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d0e1d595-98b1-4101-9c58-dbb80ec9b435 tempest-ServersNegativeTestJSON-886109420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1959fd81-c6be-4731-800f-154f458dcb4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:32:04 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d0e1d595-98b1-4101-9c58-dbb80ec9b435 tempest-ServersNegativeTestJSON-886109420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20c684dd-157e-40cb-bf61-658f6a88b302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:32:04 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d0e1d595-98b1-4101-9c58-dbb80ec9b435 tempest-ServersNegativeTestJSON-886109420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20c684dd-157e-40cb-bf61-658f6a88b302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0e7cd0b-39df-4bc7-b733-4e27630bfdd2', 'volume_name': 'volume-c0e7cd0b-39df-4bc7-b733-4e27630bfdd2', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:32:04 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d0e1d595-98b1-4101-9c58-dbb80ec9b435 tempest-ServersNegativeTestJSON-886109420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4413d7d3-a28f-4af1-9b9c-8ac2b9055120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:32:04 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d0e1d595-98b1-4101-9c58-dbb80ec9b435 tempest-ServersNegativeTestJSON-886109420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4413d7d3-a28f-4af1-9b9c-8ac2b9055120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:32:04 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d0e1d595-98b1-4101-9c58-dbb80ec9b435 tempest-ServersNegativeTestJSON-886109420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88ce94ad-99cc-4ac7-a7d2-67bb7f470cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:32:04 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-d0e1d595-98b1-4101-9c58-dbb80ec9b435 tempest-ServersNegativeTestJSON-886109420 None] Volume c0e7cd0b-39df-4bc7-b733-4e27630bfdd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0e7cd0b-39df-4bc7-b733-4e27630bfdd2', 'volume_size': 1} Jun 23 16:32:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d0e1d595-98b1-4101-9c58-dbb80ec9b435 tempest-ServersNegativeTestJSON-886109420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:32:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d0e1d595-98b1-4101-9c58-dbb80ec9b435 tempest-ServersNegativeTestJSON-886109420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:32:04 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-d0e1d595-98b1-4101-9c58-dbb80ec9b435 tempest-ServersNegativeTestJSON-886109420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:32:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1103806473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0e7cd0b-39df-4bc7-b733-4e27630bfdd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='306d3bdaf56a4e9c8df789e9a6c569ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:32:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:32:04Z,use_quota=True,user_id='fb52d3f06ea3455a8c87f359d438cdbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:32:04 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-d0e1d595-98b1-4101-9c58-dbb80ec9b435 tempest-ServersNegativeTestJSON-886109420 None] Creating volume c0e7cd0b-39df-4bc7-b733-4e27630bfdd2 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:32:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d0e1d595-98b1-4101-9c58-dbb80ec9b435 tempest-ServersNegativeTestJSON-886109420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:32:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d0e1d595-98b1-4101-9c58-dbb80ec9b435 tempest-ServersNegativeTestJSON-886109420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:32:04 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-d0e1d595-98b1-4101-9c58-dbb80ec9b435 tempest-ServersNegativeTestJSON-886109420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:32:04 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-d0e1d595-98b1-4101-9c58-dbb80ec9b435 tempest-ServersNegativeTestJSON-886109420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:32:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d0e1d595-98b1-4101-9c58-dbb80ec9b435 tempest-ServersNegativeTestJSON-886109420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:32:04 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-d0e1d595-98b1-4101-9c58-dbb80ec9b435 tempest-ServersNegativeTestJSON-886109420 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:32:04 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-d0e1d595-98b1-4101-9c58-dbb80ec9b435 tempest-ServersNegativeTestJSON-886109420 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:32:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d0e1d595-98b1-4101-9c58-dbb80ec9b435 tempest-ServersNegativeTestJSON-886109420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c0e7cd0b-39df-4bc7-b733-4e27630bfdd2 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:32:04 devstack sudo[99842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c0e7cd0b-39df-4bc7-b733-4e27630bfdd2 1073741824 Jun 23 16:32:04 devstack sudo[99842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:32:04 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-9e086c0a-ceaf-4e1b-b77b-99710a15b885 tempest-GroupSnapshotsV319Test-1165004876 None] Group snapshot 4ca50d15-d599-4573-905b-adb91afc726a: creating. {{(pid=93788) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 23 16:32:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-9e086c0a-ceaf-4e1b-b77b-99710a15b885 tempest-GroupSnapshotsV319Test-1165004876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:32:05 devstack sudo[99842]: pam_unix(sudo:session): session closed for user root Jun 23 16:32:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d0e1d595-98b1-4101-9c58-dbb80ec9b435 tempest-ServersNegativeTestJSON-886109420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c0e7cd0b-39df-4bc7-b733-4e27630bfdd2 1073741824" returned: 0 in 0.944s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:32:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d0e1d595-98b1-4101-9c58-dbb80ec9b435 tempest-ServersNegativeTestJSON-886109420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c0e7cd0b-39df-4bc7-b733-4e27630bfdd2 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:32:05 devstack sudo[99848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c0e7cd0b-39df-4bc7-b733-4e27630bfdd2 Jun 23 16:32:05 devstack sudo[99848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:32:06 devstack sudo[99848]: pam_unix(sudo:session): session closed for user root Jun 23 16:32:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d0e1d595-98b1-4101-9c58-dbb80ec9b435 tempest-ServersNegativeTestJSON-886109420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c0e7cd0b-39df-4bc7-b733-4e27630bfdd2" returned: 0 in 0.691s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:32:06 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-d0e1d595-98b1-4101-9c58-dbb80ec9b435 tempest-ServersNegativeTestJSON-886109420 None] <== create_volume: return (1684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:32:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d0e1d595-98b1-4101-9c58-dbb80ec9b435 tempest-ServersNegativeTestJSON-886109420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.686s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:32:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-9e086c0a-ceaf-4e1b-b77b-99710a15b885 tempest-GroupSnapshotsV319Test-1165004876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.604s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:32:06 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d0e1d595-98b1-4101-9c58-dbb80ec9b435 tempest-ServersNegativeTestJSON-886109420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88ce94ad-99cc-4ac7-a7d2-67bb7f470cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0e7cd0b-39df-4bc7-b733-4e27630bfdd2', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:32:06 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d0e1d595-98b1-4101-9c58-dbb80ec9b435 tempest-ServersNegativeTestJSON-886109420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41fb1080-3d55-4497-912f-14bc7b88412c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:32:06 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-9e086c0a-ceaf-4e1b-b77b-99710a15b885 tempest-GroupSnapshotsV319Test-1165004876 None] Creating offline snapshot b4dbe1dc-69e6-43ea-aca3-acaa4b9cbe88 of volume 69dfdfab-47b3-49f3-92bd-d7927b6ac6ee {{(pid=93788) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:32:06 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-d0e1d595-98b1-4101-9c58-dbb80ec9b435 tempest-ServersNegativeTestJSON-886109420 None] Volume volume-c0e7cd0b-39df-4bc7-b733-4e27630bfdd2 (c0e7cd0b-39df-4bc7-b733-4e27630bfdd2): created successfully Jun 23 16:32:06 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d0e1d595-98b1-4101-9c58-dbb80ec9b435 tempest-ServersNegativeTestJSON-886109420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41fb1080-3d55-4497-912f-14bc7b88412c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:32:06 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d0e1d595-98b1-4101-9c58-dbb80ec9b435 tempest-ServersNegativeTestJSON-886109420 None] Flow 'volume_create_manager' (47434be4-618d-4fb9-bd48-cb78dce1abbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:32:06 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[60eb32a9-4acd-4c4b-b177-e84b1a64b389]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:32:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-9e086c0a-ceaf-4e1b-b77b-99710a15b885 tempest-GroupSnapshotsV319Test-1165004876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:32:06 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-d0e1d595-98b1-4101-9c58-dbb80ec9b435 tempest-ServersNegativeTestJSON-886109420 None] Created volume successfully. Jun 23 16:32:06 devstack sudo[99851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee Jun 23 16:32:06 devstack sudo[99851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:32:06 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-edd4de6b-ef9a-49cc-be74-fcad6ec7b415 tempest-ServersNegativeTestJSON-886109420 None] Acquiring lock "cinder-c0e7cd0b-39df-4bc7-b733-4e27630bfdd2-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:32:07 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-edd4de6b-ef9a-49cc-be74-fcad6ec7b415 tempest-ServersNegativeTestJSON-886109420 None] Lock "cinder-c0e7cd0b-39df-4bc7-b733-4e27630bfdd2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:32:07 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-edd4de6b-ef9a-49cc-be74-fcad6ec7b415 tempest-ServersNegativeTestJSON-886109420 None] Acquiring lock "cinder-quobyte-c0e7cd0b-39df-4bc7-b733-4e27630bfdd2" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:32:07 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-edd4de6b-ef9a-49cc-be74-fcad6ec7b415 tempest-ServersNegativeTestJSON-886109420 None] Lock "cinder-quobyte-c0e7cd0b-39df-4bc7-b733-4e27630bfdd2" acquired by "delete_volume" :: waited 0.021s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:32:07 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53e69eb-da47-42d4-b420-d0fa1f578244]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:32:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-edd4de6b-ef9a-49cc-be74-fcad6ec7b415 tempest-ServersNegativeTestJSON-886109420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c0e7cd0b-39df-4bc7-b733-4e27630bfdd2 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:32:07 devstack sudo[99853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c0e7cd0b-39df-4bc7-b733-4e27630bfdd2 Jun 23 16:32:07 devstack sudo[99853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:32:07 devstack sudo[99851]: pam_unix(sudo:session): session closed for user root Jun 23 16:32:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-9e086c0a-ceaf-4e1b-b77b-99710a15b885 tempest-GroupSnapshotsV319Test-1165004876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee" returned: 0 in 0.937s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:32:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-9e086c0a-ceaf-4e1b-b77b-99710a15b885 tempest-GroupSnapshotsV319Test-1165004876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee.b4dbe1dc-69e6-43ea-aca3-acaa4b9cbe88 1G {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:32:07 devstack sudo[99858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee.b4dbe1dc-69e6-43ea-aca3-acaa4b9cbe88 1G Jun 23 16:32:07 devstack sudo[99858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:32:07 devstack sudo[99853]: pam_unix(sudo:session): session closed for user root Jun 23 16:32:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-edd4de6b-ef9a-49cc-be74-fcad6ec7b415 tempest-ServersNegativeTestJSON-886109420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c0e7cd0b-39df-4bc7-b733-4e27630bfdd2" returned: 0 in 0.841s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:32:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-edd4de6b-ef9a-49cc-be74-fcad6ec7b415 tempest-ServersNegativeTestJSON-886109420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c0e7cd0b-39df-4bc7-b733-4e27630bfdd2 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:32:07 devstack sudo[99863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c0e7cd0b-39df-4bc7-b733-4e27630bfdd2 Jun 23 16:32:07 devstack sudo[99863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:32:08 devstack sudo[99858]: pam_unix(sudo:session): session closed for user root Jun 23 16:32:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-9e086c0a-ceaf-4e1b-b77b-99710a15b885 tempest-GroupSnapshotsV319Test-1165004876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee.b4dbe1dc-69e6-43ea-aca3-acaa4b9cbe88 1G" returned: 0 in 0.912s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:32:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-9e086c0a-ceaf-4e1b-b77b-99710a15b885 tempest-GroupSnapshotsV319Test-1165004876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee.b4dbe1dc-69e6-43ea-aca3-acaa4b9cbe88 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:32:08 devstack sudo[99870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee.b4dbe1dc-69e6-43ea-aca3-acaa4b9cbe88 Jun 23 16:32:08 devstack sudo[99870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:32:08 devstack sudo[99863]: pam_unix(sudo:session): session closed for user root Jun 23 16:32:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-edd4de6b-ef9a-49cc-be74-fcad6ec7b415 tempest-ServersNegativeTestJSON-886109420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c0e7cd0b-39df-4bc7-b733-4e27630bfdd2" returned: 0 in 0.737s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:32:08 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-edd4de6b-ef9a-49cc-be74-fcad6ec7b415 tempest-ServersNegativeTestJSON-886109420 None] Lock "cinder-quobyte-c0e7cd0b-39df-4bc7-b733-4e27630bfdd2" released by "delete_volume" :: held 1.634s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:32:08 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-edd4de6b-ef9a-49cc-be74-fcad6ec7b415 tempest-ServersNegativeTestJSON-886109420 None] Created reservations ['7bdfe339-e117-4f66-ab57-8f5ed99bccd9', '5665888e-c7b6-4d5e-bfda-a225f6fbee04', '032c3227-f0b7-4b23-b0bb-2e5c62899538', '19b6a4e1-4310-4a3c-bb15-70c0ba4c862a'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:32:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-edd4de6b-ef9a-49cc-be74-fcad6ec7b415 tempest-ServersNegativeTestJSON-886109420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:32:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-edd4de6b-ef9a-49cc-be74-fcad6ec7b415 tempest-ServersNegativeTestJSON-886109420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:32:08 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-edd4de6b-ef9a-49cc-be74-fcad6ec7b415 tempest-ServersNegativeTestJSON-886109420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:32:08 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-edd4de6b-ef9a-49cc-be74-fcad6ec7b415 tempest-ServersNegativeTestJSON-886109420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:32:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-edd4de6b-ef9a-49cc-be74-fcad6ec7b415 tempest-ServersNegativeTestJSON-886109420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:32:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-edd4de6b-ef9a-49cc-be74-fcad6ec7b415 tempest-ServersNegativeTestJSON-886109420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:32:08 devstack sudo[99873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:32:08 devstack sudo[99873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:32:09 devstack sudo[99870]: pam_unix(sudo:session): session closed for user root Jun 23 16:32:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-9e086c0a-ceaf-4e1b-b77b-99710a15b885 tempest-GroupSnapshotsV319Test-1165004876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee.b4dbe1dc-69e6-43ea-aca3-acaa4b9cbe88" returned: 0 in 0.879s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:32:09 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-9e086c0a-ceaf-4e1b-b77b-99710a15b885 tempest-GroupSnapshotsV319Test-1165004876 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee.b4dbe1dc-69e6-43ea-aca3-acaa4b9cbe88 is being set with open permissions: ugo+rw: NotImplementedError Jun 23 16:32:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-9e086c0a-ceaf-4e1b-b77b-99710a15b885 tempest-GroupSnapshotsV319Test-1165004876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee.b4dbe1dc-69e6-43ea-aca3-acaa4b9cbe88 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:32:09 devstack sudo[99878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee.b4dbe1dc-69e6-43ea-aca3-acaa4b9cbe88 Jun 23 16:32:09 devstack sudo[99878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:32:09 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-408a387b-3453-4cba-bf27-fa3bfcc0d37b tempest-ServersNegativeTestJSON-886109420 None] Acquiring lock "cinder-bd4d4391-2ace-4ce7-8aa9-3d9501f7b771-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:32:09 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-408a387b-3453-4cba-bf27-fa3bfcc0d37b tempest-ServersNegativeTestJSON-886109420 None] Lock "cinder-bd4d4391-2ace-4ce7-8aa9-3d9501f7b771-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:32:09 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-408a387b-3453-4cba-bf27-fa3bfcc0d37b tempest-ServersNegativeTestJSON-886109420 None] Acquiring lock "cinder-quobyte-bd4d4391-2ace-4ce7-8aa9-3d9501f7b771" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:32:09 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-408a387b-3453-4cba-bf27-fa3bfcc0d37b tempest-ServersNegativeTestJSON-886109420 None] Lock "cinder-quobyte-bd4d4391-2ace-4ce7-8aa9-3d9501f7b771" acquired by "delete_volume" :: waited 0.027s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:32:09 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[317a2d81-bfb9-4538-9e24-276e5c8f713c]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:32:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-408a387b-3453-4cba-bf27-fa3bfcc0d37b tempest-ServersNegativeTestJSON-886109420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bd4d4391-2ace-4ce7-8aa9-3d9501f7b771 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:32:09 devstack sudo[99880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bd4d4391-2ace-4ce7-8aa9-3d9501f7b771 Jun 23 16:32:09 devstack sudo[99880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:32:10 devstack sudo[99873]: pam_unix(sudo:session): session closed for user root Jun 23 16:32:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-edd4de6b-ef9a-49cc-be74-fcad6ec7b415 tempest-ServersNegativeTestJSON-886109420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.202s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:32:10 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-edd4de6b-ef9a-49cc-be74-fcad6ec7b415 tempest-ServersNegativeTestJSON-886109420 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:32:10 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-edd4de6b-ef9a-49cc-be74-fcad6ec7b415 tempest-ServersNegativeTestJSON-886109420 None] Deleted volume successfully. Jun 23 16:32:10 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-edd4de6b-ef9a-49cc-be74-fcad6ec7b415 tempest-ServersNegativeTestJSON-886109420 None] Lock "cinder-c0e7cd0b-39df-4bc7-b733-4e27630bfdd2-delete_volume" released by "delete_volume" :: held 3.184s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:32:10 devstack sudo[99878]: pam_unix(sudo:session): session closed for user root Jun 23 16:32:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-9e086c0a-ceaf-4e1b-b77b-99710a15b885 tempest-GroupSnapshotsV319Test-1165004876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee.b4dbe1dc-69e6-43ea-aca3-acaa4b9cbe88" returned: 0 in 1.057s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:32:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-9e086c0a-ceaf-4e1b-b77b-99710a15b885 tempest-GroupSnapshotsV319Test-1165004876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:32:10 devstack sudo[99887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee.info Jun 23 16:32:10 devstack sudo[99887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:32:10 devstack sudo[99880]: pam_unix(sudo:session): session closed for user root Jun 23 16:32:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-408a387b-3453-4cba-bf27-fa3bfcc0d37b tempest-ServersNegativeTestJSON-886109420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bd4d4391-2ace-4ce7-8aa9-3d9501f7b771" returned: 0 in 1.000s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:32:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-408a387b-3453-4cba-bf27-fa3bfcc0d37b tempest-ServersNegativeTestJSON-886109420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bd4d4391-2ace-4ce7-8aa9-3d9501f7b771 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:32:10 devstack sudo[99924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bd4d4391-2ace-4ce7-8aa9-3d9501f7b771 Jun 23 16:32:10 devstack sudo[99924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:32:11 devstack sudo[99887]: pam_unix(sudo:session): session closed for user root Jun 23 16:32:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-9e086c0a-ceaf-4e1b-b77b-99710a15b885 tempest-GroupSnapshotsV319Test-1165004876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee.info" returned: 0 in 0.804s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:32:11 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-9e086c0a-ceaf-4e1b-b77b-99710a15b885 tempest-GroupSnapshotsV319Test-1165004876 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee.info is being set with open permissions: ugo+rw: NotImplementedError Jun 23 16:32:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-9e086c0a-ceaf-4e1b-b77b-99710a15b885 tempest-GroupSnapshotsV319Test-1165004876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:32:11 devstack sudo[99927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee.info Jun 23 16:32:11 devstack sudo[99927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:32:11 devstack sudo[99924]: pam_unix(sudo:session): session closed for user root Jun 23 16:32:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-408a387b-3453-4cba-bf27-fa3bfcc0d37b tempest-ServersNegativeTestJSON-886109420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bd4d4391-2ace-4ce7-8aa9-3d9501f7b771" returned: 0 in 0.705s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:32:11 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-408a387b-3453-4cba-bf27-fa3bfcc0d37b tempest-ServersNegativeTestJSON-886109420 None] Lock "cinder-quobyte-bd4d4391-2ace-4ce7-8aa9-3d9501f7b771" released by "delete_volume" :: held 1.753s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:32:11 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-408a387b-3453-4cba-bf27-fa3bfcc0d37b tempest-ServersNegativeTestJSON-886109420 None] Created reservations ['e28041d0-7050-4c73-8801-c2b7c6b7df9f', '403054cf-dd9f-4dd1-93fa-07e6ddea4826', 'bcd162c9-e35c-4bae-975f-f6f22a9f1011', 'e328876f-6d99-4328-af90-36661ab2c8ff'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:32:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-408a387b-3453-4cba-bf27-fa3bfcc0d37b tempest-ServersNegativeTestJSON-886109420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:32:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-408a387b-3453-4cba-bf27-fa3bfcc0d37b tempest-ServersNegativeTestJSON-886109420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:32:11 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-408a387b-3453-4cba-bf27-fa3bfcc0d37b tempest-ServersNegativeTestJSON-886109420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:32:11 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-408a387b-3453-4cba-bf27-fa3bfcc0d37b tempest-ServersNegativeTestJSON-886109420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:32:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-408a387b-3453-4cba-bf27-fa3bfcc0d37b tempest-ServersNegativeTestJSON-886109420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:32:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-408a387b-3453-4cba-bf27-fa3bfcc0d37b tempest-ServersNegativeTestJSON-886109420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:32:11 devstack sudo[99930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:32:11 devstack sudo[99930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:32:11 devstack sudo[99927]: pam_unix(sudo:session): session closed for user root Jun 23 16:32:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-9e086c0a-ceaf-4e1b-b77b-99710a15b885 tempest-GroupSnapshotsV319Test-1165004876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee.info" returned: 0 in 0.668s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:32:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-9e086c0a-ceaf-4e1b-b77b-99710a15b885 tempest-GroupSnapshotsV319Test-1165004876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.401s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:32:11 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-9e086c0a-ceaf-4e1b-b77b-99710a15b885 tempest-GroupSnapshotsV319Test-1165004876 None] group_snapshot 4ca50d15-d599-4573-905b-adb91afc726a: created successfully Jun 23 16:32:12 devstack sudo[99930]: pam_unix(sudo:session): session closed for user root Jun 23 16:32:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-408a387b-3453-4cba-bf27-fa3bfcc0d37b tempest-ServersNegativeTestJSON-886109420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.709s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:32:12 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-408a387b-3453-4cba-bf27-fa3bfcc0d37b tempest-ServersNegativeTestJSON-886109420 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:32:12 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-408a387b-3453-4cba-bf27-fa3bfcc0d37b tempest-ServersNegativeTestJSON-886109420 None] Deleted volume successfully. Jun 23 16:32:12 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-408a387b-3453-4cba-bf27-fa3bfcc0d37b tempest-ServersNegativeTestJSON-886109420 None] Lock "cinder-bd4d4391-2ace-4ce7-8aa9-3d9501f7b771-delete_volume" released by "delete_volume" :: held 2.739s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:32:12 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-ab3f83f4-715a-46f6-8a03-2c067672f575 tempest-GroupSnapshotsV319Test-1165004876 None] group_snapshot 4ca50d15-d599-4573-905b-adb91afc726a: deleting Jun 23 16:32:12 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ab3f83f4-715a-46f6-8a03-2c067672f575 tempest-GroupSnapshotsV319Test-1165004876 None] group_snapshot 4ca50d15-d599-4573-905b-adb91afc726a: deleting {{(pid=93788) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 23 16:32:12 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ab3f83f4-715a-46f6-8a03-2c067672f575 tempest-GroupSnapshotsV319Test-1165004876 None] Acquiring lock "cinder-quobyte-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:32:12 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ab3f83f4-715a-46f6-8a03-2c067672f575 tempest-GroupSnapshotsV319Test-1165004876 None] Lock "cinder-quobyte-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:32:12 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ab3f83f4-715a-46f6-8a03-2c067672f575 tempest-GroupSnapshotsV319Test-1165004876 None] Acquiring lock "cinder-quobyte-b4dbe1dc-69e6-43ea-aca3-acaa4b9cbe88" by "_delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:32:12 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ab3f83f4-715a-46f6-8a03-2c067672f575 tempest-GroupSnapshotsV319Test-1165004876 None] Lock "cinder-quobyte-b4dbe1dc-69e6-43ea-aca3-acaa4b9cbe88" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:32:12 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-ab3f83f4-715a-46f6-8a03-2c067672f575 tempest-GroupSnapshotsV319Test-1165004876 None] Deleting offline snapshot b4dbe1dc-69e6-43ea-aca3-acaa4b9cbe88 of volume 69dfdfab-47b3-49f3-92bd-d7927b6ac6ee {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:32:12 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-ab3f83f4-715a-46f6-8a03-2c067672f575 tempest-GroupSnapshotsV319Test-1165004876 None] snapshot_file for this snap is: volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee.b4dbe1dc-69e6-43ea-aca3-acaa4b9cbe88 {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:32:12 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[95aa8749-70cf-4459-bbaf-2ed62299b588]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:32:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ab3f83f4-715a-46f6-8a03-2c067672f575 tempest-GroupSnapshotsV319Test-1165004876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee.b4dbe1dc-69e6-43ea-aca3-acaa4b9cbe88 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:32:12 devstack sudo[99936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee.b4dbe1dc-69e6-43ea-aca3-acaa4b9cbe88 Jun 23 16:32:12 devstack sudo[99936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:32:13 devstack sudo[99936]: pam_unix(sudo:session): session closed for user root Jun 23 16:32:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ab3f83f4-715a-46f6-8a03-2c067672f575 tempest-GroupSnapshotsV319Test-1165004876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee.b4dbe1dc-69e6-43ea-aca3-acaa4b9cbe88" returned: 0 in 0.889s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:32:13 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-ab3f83f4-715a-46f6-8a03-2c067672f575 tempest-GroupSnapshotsV319Test-1165004876 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:32:13 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f11294a-9cd8-40e9-a140-79c5b5e7f948]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:32:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ab3f83f4-715a-46f6-8a03-2c067672f575 tempest-GroupSnapshotsV319Test-1165004876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:32:13 devstack sudo[99979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee Jun 23 16:32:13 devstack sudo[99979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:32:14 devstack sudo[99979]: pam_unix(sudo:session): session closed for user root Jun 23 16:32:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ab3f83f4-715a-46f6-8a03-2c067672f575 tempest-GroupSnapshotsV319Test-1165004876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee" returned: 0 in 0.748s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:32:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ab3f83f4-715a-46f6-8a03-2c067672f575 tempest-GroupSnapshotsV319Test-1165004876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee.b4dbe1dc-69e6-43ea-aca3-acaa4b9cbe88 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:32:14 devstack sudo[99987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee.b4dbe1dc-69e6-43ea-aca3-acaa4b9cbe88 Jun 23 16:32:14 devstack sudo[99987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:32:14 devstack sudo[99987]: pam_unix(sudo:session): session closed for user root Jun 23 16:32:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ab3f83f4-715a-46f6-8a03-2c067672f575 tempest-GroupSnapshotsV319Test-1165004876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee.b4dbe1dc-69e6-43ea-aca3-acaa4b9cbe88" returned: 0 in 0.810s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:32:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ab3f83f4-715a-46f6-8a03-2c067672f575 tempest-GroupSnapshotsV319Test-1165004876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee.b4dbe1dc-69e6-43ea-aca3-acaa4b9cbe88 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:32:14 devstack sudo[99994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee.b4dbe1dc-69e6-43ea-aca3-acaa4b9cbe88 Jun 23 16:32:14 devstack sudo[99994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:32:15 devstack sudo[99994]: pam_unix(sudo:session): session closed for user root Jun 23 16:32:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ab3f83f4-715a-46f6-8a03-2c067672f575 tempest-GroupSnapshotsV319Test-1165004876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee.b4dbe1dc-69e6-43ea-aca3-acaa4b9cbe88" returned: 0 in 0.721s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:32:15 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ab3f83f4-715a-46f6-8a03-2c067672f575 tempest-GroupSnapshotsV319Test-1165004876 None] Lock "cinder-quobyte-b4dbe1dc-69e6-43ea-aca3-acaa4b9cbe88" released by "_delete_snapshot" :: held 3.276s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:32:15 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ab3f83f4-715a-46f6-8a03-2c067672f575 tempest-GroupSnapshotsV319Test-1165004876 None] Lock "cinder-quobyte-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee" released by "delete_snapshot" :: held 3.301s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:32:15 devstack cinder-volume[93788]: WARNING cinder.quota [None req-ab3f83f4-715a-46f6-8a03-2c067672f575 tempest-GroupSnapshotsV319Test-1165004876 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1070942966 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1070942966, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:32:15 devstack cinder-volume[93788]: WARNING cinder.quota [None req-ab3f83f4-715a-46f6-8a03-2c067672f575 tempest-GroupSnapshotsV319Test-1165004876 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1070942966 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1070942966, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:32:15 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-ab3f83f4-715a-46f6-8a03-2c067672f575 tempest-GroupSnapshotsV319Test-1165004876 None] Created reservations ['f4ac5e38-2fad-40ca-b102-aca512c0b5e4', 'daee8e71-fd36-4be0-bb2e-cf8fcf8da980', 'dfe4c81f-7bf4-422b-8cc5-eff26ab131cd', 'a104640a-f781-47dc-bafb-b7efdf9271bf'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:32:15 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-ab3f83f4-715a-46f6-8a03-2c067672f575 tempest-GroupSnapshotsV319Test-1165004876 None] group_snapshot 4ca50d15-d599-4573-905b-adb91afc726a: deleted successfully Jun 23 16:32:16 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-57b2f8c1-bc7b-447e-b580-b2b3556572fa tempest-AttachVolumeNegativeTest-727363408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:32:16 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-57b2f8c1-bc7b-447e-b580-b2b3556572fa tempest-AttachVolumeNegativeTest-727363408 None] Flow 'volume_create_manager' (a5ef4bb0-0a4c-43a8-95a2-1090b1653c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:32:16 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-57b2f8c1-bc7b-447e-b580-b2b3556572fa tempest-AttachVolumeNegativeTest-727363408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2458ab2a-922b-4486-99e6-2edbb21b8669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:32:16 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-57b2f8c1-bc7b-447e-b580-b2b3556572fa tempest-AttachVolumeNegativeTest-727363408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2458ab2a-922b-4486-99e6-2edbb21b8669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:32:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1938326763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ce35cc1-2cb8-4e19-8ca5-93bb70b2a83a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46203c955aba4e6d92ed58267fdb7d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:32:16Z,use_quota=True,user_id='d3fc74608e0644a58d45eb57dee0082c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:32:16 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-57b2f8c1-bc7b-447e-b580-b2b3556572fa tempest-AttachVolumeNegativeTest-727363408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70ded052-82c8-4827-a12a-3726ed0e40fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:32:16 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-57b2f8c1-bc7b-447e-b580-b2b3556572fa tempest-AttachVolumeNegativeTest-727363408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70ded052-82c8-4827-a12a-3726ed0e40fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:32:16 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-57b2f8c1-bc7b-447e-b580-b2b3556572fa tempest-AttachVolumeNegativeTest-727363408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (186ba509-d939-4e32-b8bb-c3a6ad49557d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:32:16 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-57b2f8c1-bc7b-447e-b580-b2b3556572fa tempest-AttachVolumeNegativeTest-727363408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (186ba509-d939-4e32-b8bb-c3a6ad49557d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ce35cc1-2cb8-4e19-8ca5-93bb70b2a83a', 'volume_name': 'volume-1ce35cc1-2cb8-4e19-8ca5-93bb70b2a83a', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:32:16 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-57b2f8c1-bc7b-447e-b580-b2b3556572fa tempest-AttachVolumeNegativeTest-727363408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12dbdbdf-178d-4749-aed2-e78764f1dbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:32:16 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-57b2f8c1-bc7b-447e-b580-b2b3556572fa tempest-AttachVolumeNegativeTest-727363408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12dbdbdf-178d-4749-aed2-e78764f1dbd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:32:16 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-57b2f8c1-bc7b-447e-b580-b2b3556572fa tempest-AttachVolumeNegativeTest-727363408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e0ea7ca-74b3-4549-ba6a-7ed68e60ed9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:32:16 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-57b2f8c1-bc7b-447e-b580-b2b3556572fa tempest-AttachVolumeNegativeTest-727363408 None] Volume 1ce35cc1-2cb8-4e19-8ca5-93bb70b2a83a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ce35cc1-2cb8-4e19-8ca5-93bb70b2a83a', 'volume_size': 1} Jun 23 16:32:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-57b2f8c1-bc7b-447e-b580-b2b3556572fa tempest-AttachVolumeNegativeTest-727363408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:32:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-57b2f8c1-bc7b-447e-b580-b2b3556572fa tempest-AttachVolumeNegativeTest-727363408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:32:16 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-57b2f8c1-bc7b-447e-b580-b2b3556572fa tempest-AttachVolumeNegativeTest-727363408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:32:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1938326763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ce35cc1-2cb8-4e19-8ca5-93bb70b2a83a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46203c955aba4e6d92ed58267fdb7d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:32:16Z,use_quota=True,user_id='d3fc74608e0644a58d45eb57dee0082c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:32:16 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-57b2f8c1-bc7b-447e-b580-b2b3556572fa tempest-AttachVolumeNegativeTest-727363408 None] Creating volume 1ce35cc1-2cb8-4e19-8ca5-93bb70b2a83a {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:32:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-57b2f8c1-bc7b-447e-b580-b2b3556572fa tempest-AttachVolumeNegativeTest-727363408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:32:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-57b2f8c1-bc7b-447e-b580-b2b3556572fa tempest-AttachVolumeNegativeTest-727363408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:32:16 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-57b2f8c1-bc7b-447e-b580-b2b3556572fa tempest-AttachVolumeNegativeTest-727363408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:32:16 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-57b2f8c1-bc7b-447e-b580-b2b3556572fa tempest-AttachVolumeNegativeTest-727363408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:32:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-57b2f8c1-bc7b-447e-b580-b2b3556572fa tempest-AttachVolumeNegativeTest-727363408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:32:16 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-57b2f8c1-bc7b-447e-b580-b2b3556572fa tempest-AttachVolumeNegativeTest-727363408 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:32:16 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-57b2f8c1-bc7b-447e-b580-b2b3556572fa tempest-AttachVolumeNegativeTest-727363408 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:32:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-57b2f8c1-bc7b-447e-b580-b2b3556572fa tempest-AttachVolumeNegativeTest-727363408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1ce35cc1-2cb8-4e19-8ca5-93bb70b2a83a 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:32:16 devstack sudo[99999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1ce35cc1-2cb8-4e19-8ca5-93bb70b2a83a 1073741824 Jun 23 16:32:16 devstack sudo[99999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:32:17 devstack sudo[99999]: pam_unix(sudo:session): session closed for user root Jun 23 16:32:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-57b2f8c1-bc7b-447e-b580-b2b3556572fa tempest-AttachVolumeNegativeTest-727363408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1ce35cc1-2cb8-4e19-8ca5-93bb70b2a83a 1073741824" returned: 0 in 0.993s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:32:17 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-94d8323d-5bc7-47b3-bce4-2266c49f9784 tempest-GroupSnapshotsV319Test-1165004876 None] Acquiring lock "cinder-quobyte-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:32:17 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-94d8323d-5bc7-47b3-bce4-2266c49f9784 tempest-GroupSnapshotsV319Test-1165004876 None] Lock "cinder-quobyte-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee" acquired by "delete_volume" :: waited 0.017s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:32:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-57b2f8c1-bc7b-447e-b580-b2b3556572fa tempest-AttachVolumeNegativeTest-727363408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1ce35cc1-2cb8-4e19-8ca5-93bb70b2a83a {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:32:17 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[448e0cbc-49bb-424e-97d3-0762df4ac25c]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:32:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-94d8323d-5bc7-47b3-bce4-2266c49f9784 tempest-GroupSnapshotsV319Test-1165004876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:32:17 devstack sudo[100005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1ce35cc1-2cb8-4e19-8ca5-93bb70b2a83a Jun 23 16:32:17 devstack sudo[100005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:32:17 devstack sudo[100006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee Jun 23 16:32:17 devstack sudo[100006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:32:17 devstack sudo[100005]: pam_unix(sudo:session): session closed for user root Jun 23 16:32:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-57b2f8c1-bc7b-447e-b580-b2b3556572fa tempest-AttachVolumeNegativeTest-727363408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1ce35cc1-2cb8-4e19-8ca5-93bb70b2a83a" returned: 0 in 0.678s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:32:17 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-57b2f8c1-bc7b-447e-b580-b2b3556572fa tempest-AttachVolumeNegativeTest-727363408 None] <== create_volume: return (1753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:32:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-57b2f8c1-bc7b-447e-b580-b2b3556572fa tempest-AttachVolumeNegativeTest-727363408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.756s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:32:17 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-57b2f8c1-bc7b-447e-b580-b2b3556572fa tempest-AttachVolumeNegativeTest-727363408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e0ea7ca-74b3-4549-ba6a-7ed68e60ed9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ce35cc1-2cb8-4e19-8ca5-93bb70b2a83a', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:32:17 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-57b2f8c1-bc7b-447e-b580-b2b3556572fa tempest-AttachVolumeNegativeTest-727363408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23014034-4097-4e3d-9ed8-04a6d5cc9112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:32:17 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-57b2f8c1-bc7b-447e-b580-b2b3556572fa tempest-AttachVolumeNegativeTest-727363408 None] Volume volume-1ce35cc1-2cb8-4e19-8ca5-93bb70b2a83a (1ce35cc1-2cb8-4e19-8ca5-93bb70b2a83a): created successfully Jun 23 16:32:17 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-57b2f8c1-bc7b-447e-b580-b2b3556572fa tempest-AttachVolumeNegativeTest-727363408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23014034-4097-4e3d-9ed8-04a6d5cc9112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:32:18 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-57b2f8c1-bc7b-447e-b580-b2b3556572fa tempest-AttachVolumeNegativeTest-727363408 None] Flow 'volume_create_manager' (a5ef4bb0-0a4c-43a8-95a2-1090b1653c94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:32:18 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-57b2f8c1-bc7b-447e-b580-b2b3556572fa tempest-AttachVolumeNegativeTest-727363408 None] Created volume successfully. Jun 23 16:32:18 devstack sudo[100006]: pam_unix(sudo:session): session closed for user root Jun 23 16:32:18 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-94d8323d-5bc7-47b3-bce4-2266c49f9784 tempest-GroupSnapshotsV319Test-1165004876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee" returned: 0 in 0.772s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:32:18 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-94d8323d-5bc7-47b3-bce4-2266c49f9784 tempest-GroupSnapshotsV319Test-1165004876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:32:18 devstack sudo[100013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee Jun 23 16:32:18 devstack sudo[100013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:32:18 devstack sudo[100013]: pam_unix(sudo:session): session closed for user root Jun 23 16:32:18 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-94d8323d-5bc7-47b3-bce4-2266c49f9784 tempest-GroupSnapshotsV319Test-1165004876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee" returned: 0 in 0.834s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:32:18 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-94d8323d-5bc7-47b3-bce4-2266c49f9784 tempest-GroupSnapshotsV319Test-1165004876 None] Lock "cinder-quobyte-69dfdfab-47b3-49f3-92bd-d7927b6ac6ee" released by "delete_volume" :: held 1.678s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:32:19 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-94d8323d-5bc7-47b3-bce4-2266c49f9784 tempest-GroupSnapshotsV319Test-1165004876 None] Created reservations ['49be9ba8-afcf-46e2-bfea-3f2c3a49ea09'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:32:19 devstack cinder-volume[93788]: WARNING cinder.quota [None req-94d8323d-5bc7-47b3-bce4-2266c49f9784 tempest-GroupSnapshotsV319Test-1165004876 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1070942966 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1070942966, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:32:19 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-94d8323d-5bc7-47b3-bce4-2266c49f9784 tempest-GroupSnapshotsV319Test-1165004876 None] Created reservations ['6b543d48-7318-438d-b72e-5903efeb0e5f', '7e3b85f5-8499-4a6b-943b-33f9315ff3ba', 'bae42036-d554-4b00-9119-3108d8311ce8', 'd7a697ea-c19c-4a79-975c-9023532c28e8'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:32:19 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-94d8323d-5bc7-47b3-bce4-2266c49f9784 tempest-GroupSnapshotsV319Test-1165004876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:32:19 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-94d8323d-5bc7-47b3-bce4-2266c49f9784 tempest-GroupSnapshotsV319Test-1165004876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:32:19 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-94d8323d-5bc7-47b3-bce4-2266c49f9784 tempest-GroupSnapshotsV319Test-1165004876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:32:19 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-94d8323d-5bc7-47b3-bce4-2266c49f9784 tempest-GroupSnapshotsV319Test-1165004876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:32:19 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-94d8323d-5bc7-47b3-bce4-2266c49f9784 tempest-GroupSnapshotsV319Test-1165004876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:32:19 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-94d8323d-5bc7-47b3-bce4-2266c49f9784 tempest-GroupSnapshotsV319Test-1165004876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:32:19 devstack sudo[100021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:32:19 devstack sudo[100021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:32:19 devstack sudo[100021]: pam_unix(sudo:session): session closed for user root Jun 23 16:32:20 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-94d8323d-5bc7-47b3-bce4-2266c49f9784 tempest-GroupSnapshotsV319Test-1165004876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.833s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:32:20 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-94d8323d-5bc7-47b3-bce4-2266c49f9784 tempest-GroupSnapshotsV319Test-1165004876 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:32:20 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-94d8323d-5bc7-47b3-bce4-2266c49f9784 tempest-GroupSnapshotsV319Test-1165004876 None] Delete group completed successfully. Jun 23 16:32:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-1b000cc2-ac2c-412e-b087-8396356b9a39 req-1c01a590-496b-48de-9075-2cf2c7d0c661 tempest-AttachVolumeNegativeTest-727363408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:32:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-1b000cc2-ac2c-412e-b087-8396356b9a39 req-1c01a590-496b-48de-9075-2cf2c7d0c661 tempest-AttachVolumeNegativeTest-727363408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:32:21 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[401fa1b7-f2f9-4cce-84e5-25f14ecc9add]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:32:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-1b000cc2-ac2c-412e-b087-8396356b9a39 req-1c01a590-496b-48de-9075-2cf2c7d0c661 tempest-AttachVolumeNegativeTest-727363408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1ce35cc1-2cb8-4e19-8ca5-93bb70b2a83a {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:32:21 devstack sudo[100036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1ce35cc1-2cb8-4e19-8ca5-93bb70b2a83a Jun 23 16:32:21 devstack sudo[100036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:32:22 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddc4cb48-1a82-444c-b4ea-49bad964445f tempest-ServerActionsTestOtherA-1626454459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:32:22 devstack sudo[100036]: pam_unix(sudo:session): session closed for user root Jun 23 16:32:22 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ddc4cb48-1a82-444c-b4ea-49bad964445f tempest-ServerActionsTestOtherA-1626454459 None] Flow 'volume_create_manager' (830cf004-82d9-43ae-a0f5-26b38123b842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:32:22 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ddc4cb48-1a82-444c-b4ea-49bad964445f tempest-ServerActionsTestOtherA-1626454459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77633598-ffbf-4fd3-8716-ead1043329bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:32:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-1b000cc2-ac2c-412e-b087-8396356b9a39 req-1c01a590-496b-48de-9075-2cf2c7d0c661 tempest-AttachVolumeNegativeTest-727363408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1ce35cc1-2cb8-4e19-8ca5-93bb70b2a83a" returned: 0 in 1.138s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:32:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-1b000cc2-ac2c-412e-b087-8396356b9a39 req-1c01a590-496b-48de-9075-2cf2c7d0c661 tempest-AttachVolumeNegativeTest-727363408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.169s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:32:22 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ddc4cb48-1a82-444c-b4ea-49bad964445f tempest-ServerActionsTestOtherA-1626454459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77633598-ffbf-4fd3-8716-ead1043329bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2021724126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80319ecc-7a03-42da-8ae8-4d7d493a5066,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b5789d97a404aa2b613a2c6c09dc8a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:32:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:32:23Z,use_quota=True,user_id='46d8b127b0d94919925dff026f779d3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:32:22 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ddc4cb48-1a82-444c-b4ea-49bad964445f tempest-ServerActionsTestOtherA-1626454459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9979869-82cd-40f2-a60d-93a8a6fcb759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:32:22 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ddc4cb48-1a82-444c-b4ea-49bad964445f tempest-ServerActionsTestOtherA-1626454459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9979869-82cd-40f2-a60d-93a8a6fcb759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:32:22 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ddc4cb48-1a82-444c-b4ea-49bad964445f tempest-ServerActionsTestOtherA-1626454459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f81c02f4-9a00-4e53-a91f-40407ba8afba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:32:22 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ddc4cb48-1a82-444c-b4ea-49bad964445f tempest-ServerActionsTestOtherA-1626454459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f81c02f4-9a00-4e53-a91f-40407ba8afba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80319ecc-7a03-42da-8ae8-4d7d493a5066', 'volume_name': 'volume-80319ecc-7a03-42da-8ae8-4d7d493a5066', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:32:22 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ddc4cb48-1a82-444c-b4ea-49bad964445f tempest-ServerActionsTestOtherA-1626454459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4f2ede6-2a69-42ef-b81f-e9b7b28ac43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:32:22 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ddc4cb48-1a82-444c-b4ea-49bad964445f tempest-ServerActionsTestOtherA-1626454459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4f2ede6-2a69-42ef-b81f-e9b7b28ac43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:32:22 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ddc4cb48-1a82-444c-b4ea-49bad964445f tempest-ServerActionsTestOtherA-1626454459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10ee1f5d-24d0-4936-a97e-11e761d6ed24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:32:22 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-ddc4cb48-1a82-444c-b4ea-49bad964445f tempest-ServerActionsTestOtherA-1626454459 None] Volume 80319ecc-7a03-42da-8ae8-4d7d493a5066: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80319ecc-7a03-42da-8ae8-4d7d493a5066', 'volume_size': 1} Jun 23 16:32:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ddc4cb48-1a82-444c-b4ea-49bad964445f tempest-ServerActionsTestOtherA-1626454459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:32:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ddc4cb48-1a82-444c-b4ea-49bad964445f tempest-ServerActionsTestOtherA-1626454459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:32:22 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-ddc4cb48-1a82-444c-b4ea-49bad964445f tempest-ServerActionsTestOtherA-1626454459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2021724126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80319ecc-7a03-42da-8ae8-4d7d493a5066,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b5789d97a404aa2b613a2c6c09dc8a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:32:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:32:23Z,use_quota=True,user_id='46d8b127b0d94919925dff026f779d3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:32:22 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-ddc4cb48-1a82-444c-b4ea-49bad964445f tempest-ServerActionsTestOtherA-1626454459 None] Creating volume 80319ecc-7a03-42da-8ae8-4d7d493a5066 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:32:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ddc4cb48-1a82-444c-b4ea-49bad964445f tempest-ServerActionsTestOtherA-1626454459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:32:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ddc4cb48-1a82-444c-b4ea-49bad964445f tempest-ServerActionsTestOtherA-1626454459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:32:22 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-ddc4cb48-1a82-444c-b4ea-49bad964445f tempest-ServerActionsTestOtherA-1626454459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:32:22 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-ddc4cb48-1a82-444c-b4ea-49bad964445f tempest-ServerActionsTestOtherA-1626454459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:32:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ddc4cb48-1a82-444c-b4ea-49bad964445f tempest-ServerActionsTestOtherA-1626454459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:32:22 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-ddc4cb48-1a82-444c-b4ea-49bad964445f tempest-ServerActionsTestOtherA-1626454459 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:32:22 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-ddc4cb48-1a82-444c-b4ea-49bad964445f tempest-ServerActionsTestOtherA-1626454459 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:32:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ddc4cb48-1a82-444c-b4ea-49bad964445f tempest-ServerActionsTestOtherA-1626454459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-80319ecc-7a03-42da-8ae8-4d7d493a5066 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:32:22 devstack sudo[100041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-80319ecc-7a03-42da-8ae8-4d7d493a5066 1073741824 Jun 23 16:32:22 devstack sudo[100041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:32:22 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-1b000cc2-ac2c-412e-b087-8396356b9a39 req-1c01a590-496b-48de-9075-2cf2c7d0c661 tempest-AttachVolumeNegativeTest-727363408 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e', 'name': 'volume-1ce35cc1-2cb8-4e19-8ca5-93bb70b2a83a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '27984233-8e2c-4b1e-af2a-d9cd85576ac5', 'enforce_multipath': True} {{(pid=93788) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 16:32:22 devstack cinder-volume[93788]: INFO cinder.volume.manager [req-1b000cc2-ac2c-412e-b087-8396356b9a39 req-1c01a590-496b-48de-9075-2cf2c7d0c661 tempest-AttachVolumeNegativeTest-727363408 None] attachment_update completed successfully. Jun 23 16:32:24 devstack sudo[100041]: pam_unix(sudo:session): session closed for user root Jun 23 16:32:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ddc4cb48-1a82-444c-b4ea-49bad964445f tempest-ServerActionsTestOtherA-1626454459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-80319ecc-7a03-42da-8ae8-4d7d493a5066 1073741824" returned: 0 in 1.405s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:32:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ddc4cb48-1a82-444c-b4ea-49bad964445f tempest-ServerActionsTestOtherA-1626454459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-80319ecc-7a03-42da-8ae8-4d7d493a5066 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:32:24 devstack sudo[100430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-80319ecc-7a03-42da-8ae8-4d7d493a5066 Jun 23 16:32:24 devstack sudo[100430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:32:25 devstack sudo[100430]: pam_unix(sudo:session): session closed for user root Jun 23 16:32:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ddc4cb48-1a82-444c-b4ea-49bad964445f tempest-ServerActionsTestOtherA-1626454459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-80319ecc-7a03-42da-8ae8-4d7d493a5066" returned: 0 in 1.064s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:32:25 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-ddc4cb48-1a82-444c-b4ea-49bad964445f tempest-ServerActionsTestOtherA-1626454459 None] <== create_volume: return (2539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:32:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ddc4cb48-1a82-444c-b4ea-49bad964445f tempest-ServerActionsTestOtherA-1626454459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.541s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:32:25 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ddc4cb48-1a82-444c-b4ea-49bad964445f tempest-ServerActionsTestOtherA-1626454459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10ee1f5d-24d0-4936-a97e-11e761d6ed24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80319ecc-7a03-42da-8ae8-4d7d493a5066', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:32:25 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ddc4cb48-1a82-444c-b4ea-49bad964445f tempest-ServerActionsTestOtherA-1626454459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bd9bc6e-c429-4ab1-bbbf-d2304187eed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:32:25 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-ddc4cb48-1a82-444c-b4ea-49bad964445f tempest-ServerActionsTestOtherA-1626454459 None] Volume volume-80319ecc-7a03-42da-8ae8-4d7d493a5066 (80319ecc-7a03-42da-8ae8-4d7d493a5066): created successfully Jun 23 16:32:25 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ddc4cb48-1a82-444c-b4ea-49bad964445f tempest-ServerActionsTestOtherA-1626454459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bd9bc6e-c429-4ab1-bbbf-d2304187eed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:32:25 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ddc4cb48-1a82-444c-b4ea-49bad964445f tempest-ServerActionsTestOtherA-1626454459 None] Flow 'volume_create_manager' (830cf004-82d9-43ae-a0f5-26b38123b842) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:32:25 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-ddc4cb48-1a82-444c-b4ea-49bad964445f tempest-ServerActionsTestOtherA-1626454459 None] Created volume successfully. Jun 23 16:32:30 devstack cinder-volume[93788]: INFO cinder.volume.manager [req-78dc5451-ca8b-4d06-a3a7-5593115ffe62 req-9b76f8f2-40db-493b-8b0e-16f00055fb5d tempest-AttachVolumeNegativeTest-727363408 None] Terminate volume connection completed successfully. Jun 23 16:32:30 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-78dc5451-ca8b-4d06-a3a7-5593115ffe62 req-9b76f8f2-40db-493b-8b0e-16f00055fb5d tempest-AttachVolumeNegativeTest-727363408 None] Deleting attachment 27984233-8e2c-4b1e-af2a-d9cd85576ac5. {{(pid=93788) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 16:32:40 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:SELECT=49,cinder:UPDATE=55,cinder:INSERT=13,cinder:DELETE=3 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:32:40 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:SELECT=50,cinder:UPDATE=51,cinder:INSERT=10,cinder:DELETE=4 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:32:44 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-0adecdc4-b47a-4570-9406-94b41162c163 tempest-AttachVolumeNegativeTest-727363408 None] Acquiring lock "cinder-1ce35cc1-2cb8-4e19-8ca5-93bb70b2a83a-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:32:44 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-0adecdc4-b47a-4570-9406-94b41162c163 tempest-AttachVolumeNegativeTest-727363408 None] Lock "cinder-1ce35cc1-2cb8-4e19-8ca5-93bb70b2a83a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:32:44 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-0adecdc4-b47a-4570-9406-94b41162c163 tempest-AttachVolumeNegativeTest-727363408 None] Acquiring lock "cinder-quobyte-1ce35cc1-2cb8-4e19-8ca5-93bb70b2a83a" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:32:44 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-0adecdc4-b47a-4570-9406-94b41162c163 tempest-AttachVolumeNegativeTest-727363408 None] Lock "cinder-quobyte-1ce35cc1-2cb8-4e19-8ca5-93bb70b2a83a" acquired by "delete_volume" :: waited 0.023s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:32:44 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d85842-3c63-463d-b7e0-2aad85d4cd26]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:32:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0adecdc4-b47a-4570-9406-94b41162c163 tempest-AttachVolumeNegativeTest-727363408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1ce35cc1-2cb8-4e19-8ca5-93bb70b2a83a {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:32:44 devstack sudo[100587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1ce35cc1-2cb8-4e19-8ca5-93bb70b2a83a Jun 23 16:32:44 devstack sudo[100587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:32:45 devstack sudo[100587]: pam_unix(sudo:session): session closed for user root Jun 23 16:32:45 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0adecdc4-b47a-4570-9406-94b41162c163 tempest-AttachVolumeNegativeTest-727363408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1ce35cc1-2cb8-4e19-8ca5-93bb70b2a83a" returned: 0 in 1.090s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:32:45 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0adecdc4-b47a-4570-9406-94b41162c163 tempest-AttachVolumeNegativeTest-727363408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1ce35cc1-2cb8-4e19-8ca5-93bb70b2a83a {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:32:45 devstack sudo[100602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1ce35cc1-2cb8-4e19-8ca5-93bb70b2a83a Jun 23 16:32:45 devstack sudo[100602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:32:46 devstack sudo[100602]: pam_unix(sudo:session): session closed for user root Jun 23 16:32:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0adecdc4-b47a-4570-9406-94b41162c163 tempest-AttachVolumeNegativeTest-727363408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1ce35cc1-2cb8-4e19-8ca5-93bb70b2a83a" returned: 0 in 0.838s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:32:46 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-0adecdc4-b47a-4570-9406-94b41162c163 tempest-AttachVolumeNegativeTest-727363408 None] Lock "cinder-quobyte-1ce35cc1-2cb8-4e19-8ca5-93bb70b2a83a" released by "delete_volume" :: held 1.987s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:32:46 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-0adecdc4-b47a-4570-9406-94b41162c163 tempest-AttachVolumeNegativeTest-727363408 None] Created reservations ['bfc7d738-c99c-4673-b5d6-575a3636ebd1', '737bc3c9-ecd1-464d-aa6c-f33ec5b6bb20', '8a4ec5fd-5b4a-49c9-817d-89b192c45987', '12109236-368f-4392-aed3-29c917fc10bb'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:32:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-0adecdc4-b47a-4570-9406-94b41162c163 tempest-AttachVolumeNegativeTest-727363408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:32:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-0adecdc4-b47a-4570-9406-94b41162c163 tempest-AttachVolumeNegativeTest-727363408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:32:46 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-0adecdc4-b47a-4570-9406-94b41162c163 tempest-AttachVolumeNegativeTest-727363408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:32:46 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-0adecdc4-b47a-4570-9406-94b41162c163 tempest-AttachVolumeNegativeTest-727363408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:32:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-0adecdc4-b47a-4570-9406-94b41162c163 tempest-AttachVolumeNegativeTest-727363408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:32:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0adecdc4-b47a-4570-9406-94b41162c163 tempest-AttachVolumeNegativeTest-727363408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:32:46 devstack sudo[100605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:32:47 devstack sudo[100605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:32:47 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-79f853f1-1666-4a5e-b3f0-f877e09f70b1 tempest-AttachVolumeNegativeTest-727363408 None] Acquiring lock "cinder-51dd9291-63e3-4e12-abc0-35adcb4357ab-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:32:47 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-79f853f1-1666-4a5e-b3f0-f877e09f70b1 tempest-AttachVolumeNegativeTest-727363408 None] Lock "cinder-51dd9291-63e3-4e12-abc0-35adcb4357ab-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:32:47 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-79f853f1-1666-4a5e-b3f0-f877e09f70b1 tempest-AttachVolumeNegativeTest-727363408 None] Acquiring lock "cinder-quobyte-51dd9291-63e3-4e12-abc0-35adcb4357ab" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:32:47 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-79f853f1-1666-4a5e-b3f0-f877e09f70b1 tempest-AttachVolumeNegativeTest-727363408 None] Lock "cinder-quobyte-51dd9291-63e3-4e12-abc0-35adcb4357ab" acquired by "delete_volume" :: waited 0.030s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:32:47 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6e81f8-7ba7-403b-b43a-4719eb401d1e]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:32:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-79f853f1-1666-4a5e-b3f0-f877e09f70b1 tempest-AttachVolumeNegativeTest-727363408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-51dd9291-63e3-4e12-abc0-35adcb4357ab {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:32:47 devstack sudo[100615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-51dd9291-63e3-4e12-abc0-35adcb4357ab Jun 23 16:32:47 devstack sudo[100615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:32:47 devstack sudo[100605]: pam_unix(sudo:session): session closed for user root Jun 23 16:32:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0adecdc4-b47a-4570-9406-94b41162c163 tempest-AttachVolumeNegativeTest-727363408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.026s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:32:47 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-0adecdc4-b47a-4570-9406-94b41162c163 tempest-AttachVolumeNegativeTest-727363408 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:32:47 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-0adecdc4-b47a-4570-9406-94b41162c163 tempest-AttachVolumeNegativeTest-727363408 None] Deleted volume successfully. Jun 23 16:32:48 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-0adecdc4-b47a-4570-9406-94b41162c163 tempest-AttachVolumeNegativeTest-727363408 None] Lock "cinder-1ce35cc1-2cb8-4e19-8ca5-93bb70b2a83a-delete_volume" released by "delete_volume" :: held 3.310s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:32:49 devstack sudo[100615]: pam_unix(sudo:session): session closed for user root Jun 23 16:32:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-79f853f1-1666-4a5e-b3f0-f877e09f70b1 tempest-AttachVolumeNegativeTest-727363408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-51dd9291-63e3-4e12-abc0-35adcb4357ab" returned: 0 in 1.652s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:32:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-79f853f1-1666-4a5e-b3f0-f877e09f70b1 tempest-AttachVolumeNegativeTest-727363408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-51dd9291-63e3-4e12-abc0-35adcb4357ab {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:32:49 devstack sudo[100671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-51dd9291-63e3-4e12-abc0-35adcb4357ab Jun 23 16:32:49 devstack sudo[100671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:32:50 devstack sudo[100671]: pam_unix(sudo:session): session closed for user root Jun 23 16:32:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-79f853f1-1666-4a5e-b3f0-f877e09f70b1 tempest-AttachVolumeNegativeTest-727363408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-51dd9291-63e3-4e12-abc0-35adcb4357ab" returned: 0 in 1.078s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:32:50 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-79f853f1-1666-4a5e-b3f0-f877e09f70b1 tempest-AttachVolumeNegativeTest-727363408 None] Lock "cinder-quobyte-51dd9291-63e3-4e12-abc0-35adcb4357ab" released by "delete_volume" :: held 2.819s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:32:50 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-79f853f1-1666-4a5e-b3f0-f877e09f70b1 tempest-AttachVolumeNegativeTest-727363408 None] Created reservations ['533fe644-a56c-4277-95e2-568e4fffcea0', '5e3a758d-5bda-49a4-abb0-c11276b317d3', '0ca6c400-968f-414b-a94c-f5c461256a12', '27a16daf-d0af-4fbc-8a5b-dd52c4fd15b7'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:32:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-79f853f1-1666-4a5e-b3f0-f877e09f70b1 tempest-AttachVolumeNegativeTest-727363408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:32:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-79f853f1-1666-4a5e-b3f0-f877e09f70b1 tempest-AttachVolumeNegativeTest-727363408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:32:50 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-79f853f1-1666-4a5e-b3f0-f877e09f70b1 tempest-AttachVolumeNegativeTest-727363408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:32:50 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-79f853f1-1666-4a5e-b3f0-f877e09f70b1 tempest-AttachVolumeNegativeTest-727363408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:32:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-79f853f1-1666-4a5e-b3f0-f877e09f70b1 tempest-AttachVolumeNegativeTest-727363408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:32:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-79f853f1-1666-4a5e-b3f0-f877e09f70b1 tempest-AttachVolumeNegativeTest-727363408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:32:50 devstack sudo[100677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:32:50 devstack sudo[100677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:32:51 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-a530ddaf-e3ed-4590-b836-fb0ffef995d0 tempest-AttachVolumeNegativeTest-727363408 None] Acquiring lock "cinder-4f141109-4eee-4811-9011-3ee89d30e83b-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:32:51 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-a530ddaf-e3ed-4590-b836-fb0ffef995d0 tempest-AttachVolumeNegativeTest-727363408 None] Lock "cinder-4f141109-4eee-4811-9011-3ee89d30e83b-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:32:51 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-a530ddaf-e3ed-4590-b836-fb0ffef995d0 tempest-AttachVolumeNegativeTest-727363408 None] Acquiring lock "cinder-quobyte-4f141109-4eee-4811-9011-3ee89d30e83b" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:32:51 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-a530ddaf-e3ed-4590-b836-fb0ffef995d0 tempest-AttachVolumeNegativeTest-727363408 None] Lock "cinder-quobyte-4f141109-4eee-4811-9011-3ee89d30e83b" acquired by "delete_volume" :: waited 0.034s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:32:51 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[929ca73e-3614-42e1-b7ad-1fddbf94937b]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:32:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a530ddaf-e3ed-4590-b836-fb0ffef995d0 tempest-AttachVolumeNegativeTest-727363408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4f141109-4eee-4811-9011-3ee89d30e83b {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:32:51 devstack sudo[100677]: pam_unix(sudo:session): session closed for user root Jun 23 16:32:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-79f853f1-1666-4a5e-b3f0-f877e09f70b1 tempest-AttachVolumeNegativeTest-727363408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.310s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:32:51 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-79f853f1-1666-4a5e-b3f0-f877e09f70b1 tempest-AttachVolumeNegativeTest-727363408 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:32:51 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-79f853f1-1666-4a5e-b3f0-f877e09f70b1 tempest-AttachVolumeNegativeTest-727363408 None] Deleted volume successfully. Jun 23 16:32:51 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-79f853f1-1666-4a5e-b3f0-f877e09f70b1 tempest-AttachVolumeNegativeTest-727363408 None] Lock "cinder-51dd9291-63e3-4e12-abc0-35adcb4357ab-delete_volume" released by "delete_volume" :: held 4.483s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:32:51 devstack sudo[100680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4f141109-4eee-4811-9011-3ee89d30e83b Jun 23 16:32:51 devstack sudo[100680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:32:52 devstack sudo[100680]: pam_unix(sudo:session): session closed for user root Jun 23 16:32:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a530ddaf-e3ed-4590-b836-fb0ffef995d0 tempest-AttachVolumeNegativeTest-727363408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4f141109-4eee-4811-9011-3ee89d30e83b" returned: 0 in 1.327s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:32:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a530ddaf-e3ed-4590-b836-fb0ffef995d0 tempest-AttachVolumeNegativeTest-727363408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4f141109-4eee-4811-9011-3ee89d30e83b {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:32:52 devstack sudo[100685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4f141109-4eee-4811-9011-3ee89d30e83b Jun 23 16:32:52 devstack sudo[100685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:32:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a530ddaf-e3ed-4590-b836-fb0ffef995d0 tempest-AttachVolumeNegativeTest-727363408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4f141109-4eee-4811-9011-3ee89d30e83b" returned: 0 in 1.088s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:32:54 devstack sudo[100685]: pam_unix(sudo:session): session closed for user root Jun 23 16:32:54 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-a530ddaf-e3ed-4590-b836-fb0ffef995d0 tempest-AttachVolumeNegativeTest-727363408 None] Lock "cinder-quobyte-4f141109-4eee-4811-9011-3ee89d30e83b" released by "delete_volume" :: held 2.494s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:32:54 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-a530ddaf-e3ed-4590-b836-fb0ffef995d0 tempest-AttachVolumeNegativeTest-727363408 None] Created reservations ['34a62068-229c-4f55-86c5-ca7ae8d568bb', '97bebca9-0c9e-47e7-a59e-1a7f6507975b', 'ec95de35-21b1-42ea-b567-ed059bce2481', '1fed9e16-d284-40a9-aa59-f5d2813899a2'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:32:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a530ddaf-e3ed-4590-b836-fb0ffef995d0 tempest-AttachVolumeNegativeTest-727363408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:32:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a530ddaf-e3ed-4590-b836-fb0ffef995d0 tempest-AttachVolumeNegativeTest-727363408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:32:54 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-a530ddaf-e3ed-4590-b836-fb0ffef995d0 tempest-AttachVolumeNegativeTest-727363408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:32:54 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-a530ddaf-e3ed-4590-b836-fb0ffef995d0 tempest-AttachVolumeNegativeTest-727363408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:32:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a530ddaf-e3ed-4590-b836-fb0ffef995d0 tempest-AttachVolumeNegativeTest-727363408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:32:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a530ddaf-e3ed-4590-b836-fb0ffef995d0 tempest-AttachVolumeNegativeTest-727363408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:32:54 devstack sudo[100690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:32:54 devstack sudo[100690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:32:55 devstack sudo[100690]: pam_unix(sudo:session): session closed for user root Jun 23 16:32:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a530ddaf-e3ed-4590-b836-fb0ffef995d0 tempest-AttachVolumeNegativeTest-727363408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.378s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:32:55 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-a530ddaf-e3ed-4590-b836-fb0ffef995d0 tempest-AttachVolumeNegativeTest-727363408 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:32:55 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-a530ddaf-e3ed-4590-b836-fb0ffef995d0 tempest-AttachVolumeNegativeTest-727363408 None] Deleted volume successfully. Jun 23 16:32:55 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-a530ddaf-e3ed-4590-b836-fb0ffef995d0 tempest-AttachVolumeNegativeTest-727363408 None] Lock "cinder-4f141109-4eee-4811-9011-3ee89d30e83b-delete_volume" released by "delete_volume" :: held 4.377s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:33:00 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-772b0421-7f73-4188-ba2a-566b3b818282 tempest-SnapshotMetadataTestJSON-1465009020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:33:00 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-772b0421-7f73-4188-ba2a-566b3b818282 tempest-SnapshotMetadataTestJSON-1465009020 None] Flow 'volume_create_manager' (da21d88e-168d-4504-97da-7a91071cdddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:33:00 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-772b0421-7f73-4188-ba2a-566b3b818282 tempest-SnapshotMetadataTestJSON-1465009020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fa9a125-e8d1-4e44-a957-323b9d2a23b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:33:00 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-772b0421-7f73-4188-ba2a-566b3b818282 tempest-SnapshotMetadataTestJSON-1465009020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fa9a125-e8d1-4e44-a957-323b9d2a23b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:33:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1547686733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2fab983-e584-4501-868e-549915653228,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='686b04f543a54d7396b251c036b90899',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:33:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:33:00Z,use_quota=True,user_id='ee41da83a31148ff9bcc344f7c392e03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:33:00 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-772b0421-7f73-4188-ba2a-566b3b818282 tempest-SnapshotMetadataTestJSON-1465009020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a3093ac-ef33-4a4a-a1f2-4a1e05b314b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:33:00 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-772b0421-7f73-4188-ba2a-566b3b818282 tempest-SnapshotMetadataTestJSON-1465009020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a3093ac-ef33-4a4a-a1f2-4a1e05b314b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:33:00 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-772b0421-7f73-4188-ba2a-566b3b818282 tempest-SnapshotMetadataTestJSON-1465009020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c855c1e3-184d-4f47-b009-acc15f81983a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:33:00 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-772b0421-7f73-4188-ba2a-566b3b818282 tempest-SnapshotMetadataTestJSON-1465009020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c855c1e3-184d-4f47-b009-acc15f81983a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2fab983-e584-4501-868e-549915653228', 'volume_name': 'volume-d2fab983-e584-4501-868e-549915653228', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:33:00 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-772b0421-7f73-4188-ba2a-566b3b818282 tempest-SnapshotMetadataTestJSON-1465009020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e883392-3085-4de5-9383-75a860d5cd74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:33:00 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-772b0421-7f73-4188-ba2a-566b3b818282 tempest-SnapshotMetadataTestJSON-1465009020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e883392-3085-4de5-9383-75a860d5cd74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:33:00 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-772b0421-7f73-4188-ba2a-566b3b818282 tempest-SnapshotMetadataTestJSON-1465009020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deba1cf1-7e03-4d17-9d75-0e546646c32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:33:00 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-772b0421-7f73-4188-ba2a-566b3b818282 tempest-SnapshotMetadataTestJSON-1465009020 None] Volume d2fab983-e584-4501-868e-549915653228: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2fab983-e584-4501-868e-549915653228', 'volume_size': 1} Jun 23 16:33:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-772b0421-7f73-4188-ba2a-566b3b818282 tempest-SnapshotMetadataTestJSON-1465009020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:33:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-772b0421-7f73-4188-ba2a-566b3b818282 tempest-SnapshotMetadataTestJSON-1465009020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:33:00 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-772b0421-7f73-4188-ba2a-566b3b818282 tempest-SnapshotMetadataTestJSON-1465009020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:33:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1547686733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2fab983-e584-4501-868e-549915653228,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='686b04f543a54d7396b251c036b90899',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:33:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:33:00Z,use_quota=True,user_id='ee41da83a31148ff9bcc344f7c392e03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:33:00 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-772b0421-7f73-4188-ba2a-566b3b818282 tempest-SnapshotMetadataTestJSON-1465009020 None] Creating volume d2fab983-e584-4501-868e-549915653228 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:33:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-772b0421-7f73-4188-ba2a-566b3b818282 tempest-SnapshotMetadataTestJSON-1465009020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:33:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-772b0421-7f73-4188-ba2a-566b3b818282 tempest-SnapshotMetadataTestJSON-1465009020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:33:00 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-772b0421-7f73-4188-ba2a-566b3b818282 tempest-SnapshotMetadataTestJSON-1465009020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:33:00 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-772b0421-7f73-4188-ba2a-566b3b818282 tempest-SnapshotMetadataTestJSON-1465009020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:33:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-772b0421-7f73-4188-ba2a-566b3b818282 tempest-SnapshotMetadataTestJSON-1465009020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:33:00 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-772b0421-7f73-4188-ba2a-566b3b818282 tempest-SnapshotMetadataTestJSON-1465009020 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:33:00 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-772b0421-7f73-4188-ba2a-566b3b818282 tempest-SnapshotMetadataTestJSON-1465009020 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:33:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-772b0421-7f73-4188-ba2a-566b3b818282 tempest-SnapshotMetadataTestJSON-1465009020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d2fab983-e584-4501-868e-549915653228 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:00 devstack sudo[100713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d2fab983-e584-4501-868e-549915653228 1073741824 Jun 23 16:33:00 devstack sudo[100713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:01 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:33:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:33:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:33:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:33:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:33:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:33:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:01 devstack sudo[100718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:33:01 devstack sudo[100718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:01 devstack sudo[100713]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-772b0421-7f73-4188-ba2a-566b3b818282 tempest-SnapshotMetadataTestJSON-1465009020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d2fab983-e584-4501-868e-549915653228 1073741824" returned: 0 in 1.430s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-772b0421-7f73-4188-ba2a-566b3b818282 tempest-SnapshotMetadataTestJSON-1465009020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d2fab983-e584-4501-868e-549915653228 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:01 devstack sudo[100730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d2fab983-e584-4501-868e-549915653228 Jun 23 16:33:01 devstack sudo[100730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:02 devstack sudo[100718]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.087s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:02 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:33:02 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager._thread_info {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:33:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread count: 8 {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 16:33:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread info: [<_MainThread(MainThread, started 126303828988032)>, , , , , , , ] {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 16:33:02 devstack sudo[100730]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-772b0421-7f73-4188-ba2a-566b3b818282 tempest-SnapshotMetadataTestJSON-1465009020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d2fab983-e584-4501-868e-549915653228" returned: 0 in 0.974s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:02 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-772b0421-7f73-4188-ba2a-566b3b818282 tempest-SnapshotMetadataTestJSON-1465009020 None] <== create_volume: return (2488ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:33:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-772b0421-7f73-4188-ba2a-566b3b818282 tempest-SnapshotMetadataTestJSON-1465009020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.491s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:33:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-772b0421-7f73-4188-ba2a-566b3b818282 tempest-SnapshotMetadataTestJSON-1465009020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deba1cf1-7e03-4d17-9d75-0e546646c32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2fab983-e584-4501-868e-549915653228', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:33:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-772b0421-7f73-4188-ba2a-566b3b818282 tempest-SnapshotMetadataTestJSON-1465009020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef4aeac1-f977-438b-b56f-41644f9bdbc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:33:02 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-772b0421-7f73-4188-ba2a-566b3b818282 tempest-SnapshotMetadataTestJSON-1465009020 None] Volume volume-d2fab983-e584-4501-868e-549915653228 (d2fab983-e584-4501-868e-549915653228): created successfully Jun 23 16:33:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-772b0421-7f73-4188-ba2a-566b3b818282 tempest-SnapshotMetadataTestJSON-1465009020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef4aeac1-f977-438b-b56f-41644f9bdbc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:33:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-772b0421-7f73-4188-ba2a-566b3b818282 tempest-SnapshotMetadataTestJSON-1465009020 None] Flow 'volume_create_manager' (da21d88e-168d-4504-97da-7a91071cdddd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:33:02 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-772b0421-7f73-4188-ba2a-566b3b818282 tempest-SnapshotMetadataTestJSON-1465009020 None] Created volume successfully. Jun 23 16:33:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-10e6417c-c11e-4231-a01b-b53f047cb3d6 tempest-SnapshotMetadataTestJSON-1465009020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:33:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-10e6417c-c11e-4231-a01b-b53f047cb3d6 tempest-SnapshotMetadataTestJSON-1465009020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:33:03 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-10e6417c-c11e-4231-a01b-b53f047cb3d6 tempest-SnapshotMetadataTestJSON-1465009020 None] Creating offline snapshot 95573080-c183-4d80-9e9a-d18307fa9655 of volume d2fab983-e584-4501-868e-549915653228 {{(pid=93788) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:33:03 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbec9e52-ec51-4151-b702-925df5be1a45]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:33:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-10e6417c-c11e-4231-a01b-b53f047cb3d6 tempest-SnapshotMetadataTestJSON-1465009020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d2fab983-e584-4501-868e-549915653228 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:03 devstack sudo[100770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d2fab983-e584-4501-868e-549915653228 Jun 23 16:33:03 devstack sudo[100770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:05 devstack sudo[100770]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-10e6417c-c11e-4231-a01b-b53f047cb3d6 tempest-SnapshotMetadataTestJSON-1465009020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d2fab983-e584-4501-868e-549915653228" returned: 0 in 1.619s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-10e6417c-c11e-4231-a01b-b53f047cb3d6 tempest-SnapshotMetadataTestJSON-1465009020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d2fab983-e584-4501-868e-549915653228,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d2fab983-e584-4501-868e-549915653228.95573080-c183-4d80-9e9a-d18307fa9655 1G {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:05 devstack sudo[100840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d2fab983-e584-4501-868e-549915653228,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d2fab983-e584-4501-868e-549915653228.95573080-c183-4d80-9e9a-d18307fa9655 1G Jun 23 16:33:05 devstack sudo[100840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:06 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [req-20d09e78-1109-4811-9c76-bf9f147928e0 req-ab75e2ff-bdb4-4c6e-bdf2-1c61055f2945 tempest-VolumesGetTestJSON-302841591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:33:06 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-20d09e78-1109-4811-9c76-bf9f147928e0 req-ab75e2ff-bdb4-4c6e-bdf2-1c61055f2945 tempest-VolumesGetTestJSON-302841591 None] Flow 'volume_create_manager' (c42c2343-19df-403e-b532-97f064ec14c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:33:06 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-20d09e78-1109-4811-9c76-bf9f147928e0 req-ab75e2ff-bdb4-4c6e-bdf2-1c61055f2945 tempest-VolumesGetTestJSON-302841591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f291b536-b011-4569-add2-e06c2bae9c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:33:06 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-20d09e78-1109-4811-9c76-bf9f147928e0 req-ab75e2ff-bdb4-4c6e-bdf2-1c61055f2945 tempest-VolumesGetTestJSON-302841591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f291b536-b011-4569-add2-e06c2bae9c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2077970362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8a11f47-4320-46ae-8dc3-bbb3adcb0a30,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7f28434396c24bf293ec194e2ddc50ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:33:06Z,use_quota=True,user_id='7967e4f201f64fb2834e4387064477de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:33:06 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-20d09e78-1109-4811-9c76-bf9f147928e0 req-ab75e2ff-bdb4-4c6e-bdf2-1c61055f2945 tempest-VolumesGetTestJSON-302841591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24df578f-cbb0-4c6c-9019-af417f2a7b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:33:06 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-20d09e78-1109-4811-9c76-bf9f147928e0 req-ab75e2ff-bdb4-4c6e-bdf2-1c61055f2945 tempest-VolumesGetTestJSON-302841591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24df578f-cbb0-4c6c-9019-af417f2a7b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:33:06 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-20d09e78-1109-4811-9c76-bf9f147928e0 req-ab75e2ff-bdb4-4c6e-bdf2-1c61055f2945 tempest-VolumesGetTestJSON-302841591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52eb7b79-87df-4310-8a12-0da68aef78dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:33:06 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-20d09e78-1109-4811-9c76-bf9f147928e0 req-ab75e2ff-bdb4-4c6e-bdf2-1c61055f2945 tempest-VolumesGetTestJSON-302841591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52eb7b79-87df-4310-8a12-0da68aef78dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8a11f47-4320-46ae-8dc3-bbb3adcb0a30', 'volume_name': 'volume-c8a11f47-4320-46ae-8dc3-bbb3adcb0a30', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:33:06 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-20d09e78-1109-4811-9c76-bf9f147928e0 req-ab75e2ff-bdb4-4c6e-bdf2-1c61055f2945 tempest-VolumesGetTestJSON-302841591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c61a10d0-46bc-427a-85c1-cfe9d034fe70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:33:06 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-20d09e78-1109-4811-9c76-bf9f147928e0 req-ab75e2ff-bdb4-4c6e-bdf2-1c61055f2945 tempest-VolumesGetTestJSON-302841591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c61a10d0-46bc-427a-85c1-cfe9d034fe70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:33:06 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-20d09e78-1109-4811-9c76-bf9f147928e0 req-ab75e2ff-bdb4-4c6e-bdf2-1c61055f2945 tempest-VolumesGetTestJSON-302841591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9cba838-5051-4c74-91d2-11f44397bc40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:33:06 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [req-20d09e78-1109-4811-9c76-bf9f147928e0 req-ab75e2ff-bdb4-4c6e-bdf2-1c61055f2945 tempest-VolumesGetTestJSON-302841591 None] Volume c8a11f47-4320-46ae-8dc3-bbb3adcb0a30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8a11f47-4320-46ae-8dc3-bbb3adcb0a30', 'volume_size': 1} Jun 23 16:33:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-20d09e78-1109-4811-9c76-bf9f147928e0 req-ab75e2ff-bdb4-4c6e-bdf2-1c61055f2945 tempest-VolumesGetTestJSON-302841591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:33:06 devstack sudo[100840]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-10e6417c-c11e-4231-a01b-b53f047cb3d6 tempest-SnapshotMetadataTestJSON-1465009020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d2fab983-e584-4501-868e-549915653228,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d2fab983-e584-4501-868e-549915653228.95573080-c183-4d80-9e9a-d18307fa9655 1G" returned: 0 in 1.154s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-10e6417c-c11e-4231-a01b-b53f047cb3d6 tempest-SnapshotMetadataTestJSON-1465009020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2fab983-e584-4501-868e-549915653228 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d2fab983-e584-4501-868e-549915653228.95573080-c183-4d80-9e9a-d18307fa9655 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:06 devstack sudo[100847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2fab983-e584-4501-868e-549915653228 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d2fab983-e584-4501-868e-549915653228.95573080-c183-4d80-9e9a-d18307fa9655 Jun 23 16:33:06 devstack sudo[100847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:07 devstack sudo[100847]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-10e6417c-c11e-4231-a01b-b53f047cb3d6 tempest-SnapshotMetadataTestJSON-1465009020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2fab983-e584-4501-868e-549915653228 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d2fab983-e584-4501-868e-549915653228.95573080-c183-4d80-9e9a-d18307fa9655" returned: 0 in 0.771s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:07 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-10e6417c-c11e-4231-a01b-b53f047cb3d6 tempest-SnapshotMetadataTestJSON-1465009020 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d2fab983-e584-4501-868e-549915653228.95573080-c183-4d80-9e9a-d18307fa9655 is being set with open permissions: ugo+rw Jun 23 16:33:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-10e6417c-c11e-4231-a01b-b53f047cb3d6 tempest-SnapshotMetadataTestJSON-1465009020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d2fab983-e584-4501-868e-549915653228.95573080-c183-4d80-9e9a-d18307fa9655 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:07 devstack sudo[100853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d2fab983-e584-4501-868e-549915653228.95573080-c183-4d80-9e9a-d18307fa9655 Jun 23 16:33:07 devstack sudo[100853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:08 devstack sudo[100853]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-10e6417c-c11e-4231-a01b-b53f047cb3d6 tempest-SnapshotMetadataTestJSON-1465009020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d2fab983-e584-4501-868e-549915653228.95573080-c183-4d80-9e9a-d18307fa9655" returned: 0 in 0.795s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-10e6417c-c11e-4231-a01b-b53f047cb3d6 tempest-SnapshotMetadataTestJSON-1465009020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d2fab983-e584-4501-868e-549915653228.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:08 devstack sudo[100856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d2fab983-e584-4501-868e-549915653228.info Jun 23 16:33:08 devstack sudo[100856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:08 devstack sudo[100856]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-10e6417c-c11e-4231-a01b-b53f047cb3d6 tempest-SnapshotMetadataTestJSON-1465009020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d2fab983-e584-4501-868e-549915653228.info" returned: 0 in 0.796s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:08 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-10e6417c-c11e-4231-a01b-b53f047cb3d6 tempest-SnapshotMetadataTestJSON-1465009020 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d2fab983-e584-4501-868e-549915653228.info is being set with open permissions: ugo+rw Jun 23 16:33:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-10e6417c-c11e-4231-a01b-b53f047cb3d6 tempest-SnapshotMetadataTestJSON-1465009020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d2fab983-e584-4501-868e-549915653228.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:09 devstack sudo[100860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d2fab983-e584-4501-868e-549915653228.info Jun 23 16:33:09 devstack sudo[100860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:09 devstack sudo[100860]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-10e6417c-c11e-4231-a01b-b53f047cb3d6 tempest-SnapshotMetadataTestJSON-1465009020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d2fab983-e584-4501-868e-549915653228.info" returned: 0 in 0.900s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-10e6417c-c11e-4231-a01b-b53f047cb3d6 tempest-SnapshotMetadataTestJSON-1465009020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.183s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:33:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-20d09e78-1109-4811-9c76-bf9f147928e0 req-ab75e2ff-bdb4-4c6e-bdf2-1c61055f2945 tempest-VolumesGetTestJSON-302841591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.708s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:33:09 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [req-20d09e78-1109-4811-9c76-bf9f147928e0 req-ab75e2ff-bdb4-4c6e-bdf2-1c61055f2945 tempest-VolumesGetTestJSON-302841591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2077970362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8a11f47-4320-46ae-8dc3-bbb3adcb0a30,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7f28434396c24bf293ec194e2ddc50ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:33:06Z,use_quota=True,user_id='7967e4f201f64fb2834e4387064477de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:33:09 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [req-20d09e78-1109-4811-9c76-bf9f147928e0 req-ab75e2ff-bdb4-4c6e-bdf2-1c61055f2945 tempest-VolumesGetTestJSON-302841591 None] Creating volume c8a11f47-4320-46ae-8dc3-bbb3adcb0a30 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:33:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-20d09e78-1109-4811-9c76-bf9f147928e0 req-ab75e2ff-bdb4-4c6e-bdf2-1c61055f2945 tempest-VolumesGetTestJSON-302841591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:33:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-20d09e78-1109-4811-9c76-bf9f147928e0 req-ab75e2ff-bdb4-4c6e-bdf2-1c61055f2945 tempest-VolumesGetTestJSON-302841591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:33:09 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [req-20d09e78-1109-4811-9c76-bf9f147928e0 req-ab75e2ff-bdb4-4c6e-bdf2-1c61055f2945 tempest-VolumesGetTestJSON-302841591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:33:09 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [req-20d09e78-1109-4811-9c76-bf9f147928e0 req-ab75e2ff-bdb4-4c6e-bdf2-1c61055f2945 tempest-VolumesGetTestJSON-302841591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:33:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-20d09e78-1109-4811-9c76-bf9f147928e0 req-ab75e2ff-bdb4-4c6e-bdf2-1c61055f2945 tempest-VolumesGetTestJSON-302841591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:33:09 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [req-20d09e78-1109-4811-9c76-bf9f147928e0 req-ab75e2ff-bdb4-4c6e-bdf2-1c61055f2945 tempest-VolumesGetTestJSON-302841591 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:33:09 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [req-20d09e78-1109-4811-9c76-bf9f147928e0 req-ab75e2ff-bdb4-4c6e-bdf2-1c61055f2945 tempest-VolumesGetTestJSON-302841591 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:33:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-20d09e78-1109-4811-9c76-bf9f147928e0 req-ab75e2ff-bdb4-4c6e-bdf2-1c61055f2945 tempest-VolumesGetTestJSON-302841591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c8a11f47-4320-46ae-8dc3-bbb3adcb0a30 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:09 devstack sudo[100865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c8a11f47-4320-46ae-8dc3-bbb3adcb0a30 1073741824 Jun 23 16:33:09 devstack sudo[100865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:09 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-10e6417c-c11e-4231-a01b-b53f047cb3d6 tempest-SnapshotMetadataTestJSON-1465009020 None] Create snapshot completed successfully Jun 23 16:33:11 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-a4bcd0c0-0a79-48a4-90e9-12983030b0c0 tempest-SnapshotMetadataTestJSON-1465009020 None] Acquiring lock "cinder-95573080-c183-4d80-9e9a-d18307fa9655-delete_snapshot" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:33:11 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-a4bcd0c0-0a79-48a4-90e9-12983030b0c0 tempest-SnapshotMetadataTestJSON-1465009020 None] Lock "cinder-95573080-c183-4d80-9e9a-d18307fa9655-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:33:11 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-a4bcd0c0-0a79-48a4-90e9-12983030b0c0 tempest-SnapshotMetadataTestJSON-1465009020 None] Acquiring lock "cinder-quobyte-d2fab983-e584-4501-868e-549915653228" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:33:11 devstack sudo[100865]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:11 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-a4bcd0c0-0a79-48a4-90e9-12983030b0c0 tempest-SnapshotMetadataTestJSON-1465009020 None] Lock "cinder-quobyte-d2fab983-e584-4501-868e-549915653228" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:33:11 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-a4bcd0c0-0a79-48a4-90e9-12983030b0c0 tempest-SnapshotMetadataTestJSON-1465009020 None] Acquiring lock "cinder-quobyte-95573080-c183-4d80-9e9a-d18307fa9655" by "_delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:33:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-20d09e78-1109-4811-9c76-bf9f147928e0 req-ab75e2ff-bdb4-4c6e-bdf2-1c61055f2945 tempest-VolumesGetTestJSON-302841591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c8a11f47-4320-46ae-8dc3-bbb3adcb0a30 1073741824" returned: 0 in 1.324s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:11 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-a4bcd0c0-0a79-48a4-90e9-12983030b0c0 tempest-SnapshotMetadataTestJSON-1465009020 None] Lock "cinder-quobyte-95573080-c183-4d80-9e9a-d18307fa9655" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:33:11 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-a4bcd0c0-0a79-48a4-90e9-12983030b0c0 tempest-SnapshotMetadataTestJSON-1465009020 None] Deleting offline snapshot 95573080-c183-4d80-9e9a-d18307fa9655 of volume d2fab983-e584-4501-868e-549915653228 {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:33:11 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-a4bcd0c0-0a79-48a4-90e9-12983030b0c0 tempest-SnapshotMetadataTestJSON-1465009020 None] snapshot_file for this snap is: volume-d2fab983-e584-4501-868e-549915653228.95573080-c183-4d80-9e9a-d18307fa9655 {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:33:11 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfef6ddc-ed2c-42b4-ba9c-6b92490a6063]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:33:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a4bcd0c0-0a79-48a4-90e9-12983030b0c0 tempest-SnapshotMetadataTestJSON-1465009020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d2fab983-e584-4501-868e-549915653228.95573080-c183-4d80-9e9a-d18307fa9655 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-20d09e78-1109-4811-9c76-bf9f147928e0 req-ab75e2ff-bdb4-4c6e-bdf2-1c61055f2945 tempest-VolumesGetTestJSON-302841591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c8a11f47-4320-46ae-8dc3-bbb3adcb0a30 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:11 devstack sudo[100872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c8a11f47-4320-46ae-8dc3-bbb3adcb0a30 Jun 23 16:33:11 devstack sudo[100872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:11 devstack sudo[100871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d2fab983-e584-4501-868e-549915653228.95573080-c183-4d80-9e9a-d18307fa9655 Jun 23 16:33:11 devstack sudo[100871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:12 devstack sudo[100872]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-20d09e78-1109-4811-9c76-bf9f147928e0 req-ab75e2ff-bdb4-4c6e-bdf2-1c61055f2945 tempest-VolumesGetTestJSON-302841591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c8a11f47-4320-46ae-8dc3-bbb3adcb0a30" returned: 0 in 0.717s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:12 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [req-20d09e78-1109-4811-9c76-bf9f147928e0 req-ab75e2ff-bdb4-4c6e-bdf2-1c61055f2945 tempest-VolumesGetTestJSON-302841591 None] <== create_volume: return (2121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:33:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-20d09e78-1109-4811-9c76-bf9f147928e0 req-ab75e2ff-bdb4-4c6e-bdf2-1c61055f2945 tempest-VolumesGetTestJSON-302841591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.126s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:33:12 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-20d09e78-1109-4811-9c76-bf9f147928e0 req-ab75e2ff-bdb4-4c6e-bdf2-1c61055f2945 tempest-VolumesGetTestJSON-302841591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9cba838-5051-4c74-91d2-11f44397bc40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8a11f47-4320-46ae-8dc3-bbb3adcb0a30', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:33:12 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-20d09e78-1109-4811-9c76-bf9f147928e0 req-ab75e2ff-bdb4-4c6e-bdf2-1c61055f2945 tempest-VolumesGetTestJSON-302841591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1e3d56c-8cf6-4dc6-97a3-dff82ec0ecae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:33:12 devstack sudo[100871]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a4bcd0c0-0a79-48a4-90e9-12983030b0c0 tempest-SnapshotMetadataTestJSON-1465009020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d2fab983-e584-4501-868e-549915653228.95573080-c183-4d80-9e9a-d18307fa9655" returned: 0 in 0.815s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:12 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-a4bcd0c0-0a79-48a4-90e9-12983030b0c0 tempest-SnapshotMetadataTestJSON-1465009020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2fab983-e584-4501-868e-549915653228(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:33:12 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [req-20d09e78-1109-4811-9c76-bf9f147928e0 req-ab75e2ff-bdb4-4c6e-bdf2-1c61055f2945 tempest-VolumesGetTestJSON-302841591 None] Volume volume-c8a11f47-4320-46ae-8dc3-bbb3adcb0a30 (c8a11f47-4320-46ae-8dc3-bbb3adcb0a30): created successfully Jun 23 16:33:12 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-20d09e78-1109-4811-9c76-bf9f147928e0 req-ab75e2ff-bdb4-4c6e-bdf2-1c61055f2945 tempest-VolumesGetTestJSON-302841591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1e3d56c-8cf6-4dc6-97a3-dff82ec0ecae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:33:12 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-20d09e78-1109-4811-9c76-bf9f147928e0 req-ab75e2ff-bdb4-4c6e-bdf2-1c61055f2945 tempest-VolumesGetTestJSON-302841591 None] Flow 'volume_create_manager' (c42c2343-19df-403e-b532-97f064ec14c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:33:12 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[28bf2dfe-66cf-47ab-a8be-b70960c4c6da]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:33:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a4bcd0c0-0a79-48a4-90e9-12983030b0c0 tempest-SnapshotMetadataTestJSON-1465009020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d2fab983-e584-4501-868e-549915653228 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:12 devstack cinder-volume[93788]: INFO cinder.volume.manager [req-20d09e78-1109-4811-9c76-bf9f147928e0 req-ab75e2ff-bdb4-4c6e-bdf2-1c61055f2945 tempest-VolumesGetTestJSON-302841591 None] Created volume successfully. Jun 23 16:33:12 devstack sudo[100880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d2fab983-e584-4501-868e-549915653228 Jun 23 16:33:12 devstack sudo[100880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:12 devstack cinder-volume[93788]: DEBUG cinder.coordination [req-c085f4b8-b6ab-4a07-8187-bf2aec365d0c req-361f03b0-4b08-46e3-84d9-bcbba119b574 tempest-VolumesGetTestJSON-302841591 None] Acquiring lock "cinder-c8a11f47-4320-46ae-8dc3-bbb3adcb0a30-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:33:12 devstack cinder-volume[93788]: DEBUG cinder.coordination [req-c085f4b8-b6ab-4a07-8187-bf2aec365d0c req-361f03b0-4b08-46e3-84d9-bcbba119b574 tempest-VolumesGetTestJSON-302841591 None] Lock "cinder-c8a11f47-4320-46ae-8dc3-bbb3adcb0a30-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:33:12 devstack sudo[100880]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a4bcd0c0-0a79-48a4-90e9-12983030b0c0 tempest-SnapshotMetadataTestJSON-1465009020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d2fab983-e584-4501-868e-549915653228" returned: 0 in 0.855s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a4bcd0c0-0a79-48a4-90e9-12983030b0c0 tempest-SnapshotMetadataTestJSON-1465009020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d2fab983-e584-4501-868e-549915653228.95573080-c183-4d80-9e9a-d18307fa9655 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:13 devstack sudo[100885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d2fab983-e584-4501-868e-549915653228.95573080-c183-4d80-9e9a-d18307fa9655 Jun 23 16:33:13 devstack sudo[100885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:13 devstack cinder-volume[93788]: DEBUG cinder.coordination [req-c085f4b8-b6ab-4a07-8187-bf2aec365d0c req-361f03b0-4b08-46e3-84d9-bcbba119b574 tempest-VolumesGetTestJSON-302841591 None] Acquiring lock "cinder-quobyte-c8a11f47-4320-46ae-8dc3-bbb3adcb0a30" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:33:13 devstack cinder-volume[93788]: DEBUG cinder.coordination [req-c085f4b8-b6ab-4a07-8187-bf2aec365d0c req-361f03b0-4b08-46e3-84d9-bcbba119b574 tempest-VolumesGetTestJSON-302841591 None] Lock "cinder-quobyte-c8a11f47-4320-46ae-8dc3-bbb3adcb0a30" acquired by "delete_volume" :: waited 0.023s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:33:13 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[59297494-a3d6-4b32-853d-14f887bd3675]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:33:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-c085f4b8-b6ab-4a07-8187-bf2aec365d0c req-361f03b0-4b08-46e3-84d9-bcbba119b574 tempest-VolumesGetTestJSON-302841591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c8a11f47-4320-46ae-8dc3-bbb3adcb0a30 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:13 devstack sudo[100887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c8a11f47-4320-46ae-8dc3-bbb3adcb0a30 Jun 23 16:33:13 devstack sudo[100887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:13 devstack sudo[100885]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a4bcd0c0-0a79-48a4-90e9-12983030b0c0 tempest-SnapshotMetadataTestJSON-1465009020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d2fab983-e584-4501-868e-549915653228.95573080-c183-4d80-9e9a-d18307fa9655" returned: 0 in 0.866s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a4bcd0c0-0a79-48a4-90e9-12983030b0c0 tempest-SnapshotMetadataTestJSON-1465009020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d2fab983-e584-4501-868e-549915653228.95573080-c183-4d80-9e9a-d18307fa9655 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:13 devstack sudo[100897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d2fab983-e584-4501-868e-549915653228.95573080-c183-4d80-9e9a-d18307fa9655 Jun 23 16:33:13 devstack sudo[100897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:13 devstack sudo[100887]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-c085f4b8-b6ab-4a07-8187-bf2aec365d0c req-361f03b0-4b08-46e3-84d9-bcbba119b574 tempest-VolumesGetTestJSON-302841591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c8a11f47-4320-46ae-8dc3-bbb3adcb0a30" returned: 0 in 0.836s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-c085f4b8-b6ab-4a07-8187-bf2aec365d0c req-361f03b0-4b08-46e3-84d9-bcbba119b574 tempest-VolumesGetTestJSON-302841591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c8a11f47-4320-46ae-8dc3-bbb3adcb0a30 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:13 devstack sudo[100899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c8a11f47-4320-46ae-8dc3-bbb3adcb0a30 Jun 23 16:33:13 devstack sudo[100899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:14 devstack sudo[100897]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a4bcd0c0-0a79-48a4-90e9-12983030b0c0 tempest-SnapshotMetadataTestJSON-1465009020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d2fab983-e584-4501-868e-549915653228.95573080-c183-4d80-9e9a-d18307fa9655" returned: 0 in 0.757s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:14 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-a4bcd0c0-0a79-48a4-90e9-12983030b0c0 tempest-SnapshotMetadataTestJSON-1465009020 None] Lock "cinder-quobyte-95573080-c183-4d80-9e9a-d18307fa9655" released by "_delete_snapshot" :: held 3.424s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:33:14 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-a4bcd0c0-0a79-48a4-90e9-12983030b0c0 tempest-SnapshotMetadataTestJSON-1465009020 None] Lock "cinder-quobyte-d2fab983-e584-4501-868e-549915653228" released by "delete_snapshot" :: held 3.452s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:33:14 devstack cinder-volume[93788]: WARNING cinder.quota [None req-a4bcd0c0-0a79-48a4-90e9-12983030b0c0 tempest-SnapshotMetadataTestJSON-1465009020 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:33:14 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-a4bcd0c0-0a79-48a4-90e9-12983030b0c0 tempest-SnapshotMetadataTestJSON-1465009020 None] Created reservations ['1fef0c29-8c4b-4d68-8e64-68e84ac6d2f5', 'fa4b9d06-a0fb-4ef6-968e-4344b570fb63', '6b46e1c9-727e-4fb5-91b0-9aee1a31b52e', '2c730c78-da2e-48ca-a3de-790dd6209d33'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:33:14 devstack sudo[100899]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-c085f4b8-b6ab-4a07-8187-bf2aec365d0c req-361f03b0-4b08-46e3-84d9-bcbba119b574 tempest-VolumesGetTestJSON-302841591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c8a11f47-4320-46ae-8dc3-bbb3adcb0a30" returned: 0 in 0.835s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:14 devstack cinder-volume[93788]: DEBUG cinder.coordination [req-c085f4b8-b6ab-4a07-8187-bf2aec365d0c req-361f03b0-4b08-46e3-84d9-bcbba119b574 tempest-VolumesGetTestJSON-302841591 None] Lock "cinder-quobyte-c8a11f47-4320-46ae-8dc3-bbb3adcb0a30" released by "delete_volume" :: held 1.721s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:33:14 devstack cinder-volume[93788]: DEBUG cinder.quota [req-c085f4b8-b6ab-4a07-8187-bf2aec365d0c req-361f03b0-4b08-46e3-84d9-bcbba119b574 tempest-VolumesGetTestJSON-302841591 None] Created reservations ['00870273-705b-48df-8327-562d5a5c9930', '02b28f5e-92e5-4b26-9194-7da04756808c', '1265c837-400c-4baa-a967-440946b94a26', 'aeefc1ac-25b8-48cc-b53c-5476cd969e21'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:33:15 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-a4bcd0c0-0a79-48a4-90e9-12983030b0c0 tempest-SnapshotMetadataTestJSON-1465009020 None] Delete snapshot completed successfully. Jun 23 16:33:15 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-a4bcd0c0-0a79-48a4-90e9-12983030b0c0 tempest-SnapshotMetadataTestJSON-1465009020 None] Lock "cinder-95573080-c183-4d80-9e9a-d18307fa9655-delete_snapshot" released by "delete_snapshot" :: held 3.908s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:33:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-c085f4b8-b6ab-4a07-8187-bf2aec365d0c req-361f03b0-4b08-46e3-84d9-bcbba119b574 tempest-VolumesGetTestJSON-302841591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:33:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-c085f4b8-b6ab-4a07-8187-bf2aec365d0c req-361f03b0-4b08-46e3-84d9-bcbba119b574 tempest-VolumesGetTestJSON-302841591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:33:15 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [req-c085f4b8-b6ab-4a07-8187-bf2aec365d0c req-361f03b0-4b08-46e3-84d9-bcbba119b574 tempest-VolumesGetTestJSON-302841591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:33:15 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [req-c085f4b8-b6ab-4a07-8187-bf2aec365d0c req-361f03b0-4b08-46e3-84d9-bcbba119b574 tempest-VolumesGetTestJSON-302841591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:33:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-c085f4b8-b6ab-4a07-8187-bf2aec365d0c req-361f03b0-4b08-46e3-84d9-bcbba119b574 tempest-VolumesGetTestJSON-302841591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:33:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-c085f4b8-b6ab-4a07-8187-bf2aec365d0c req-361f03b0-4b08-46e3-84d9-bcbba119b574 tempest-VolumesGetTestJSON-302841591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:15 devstack sudo[100909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:33:15 devstack sudo[100909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:15 devstack sudo[100909]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-c085f4b8-b6ab-4a07-8187-bf2aec365d0c req-361f03b0-4b08-46e3-84d9-bcbba119b574 tempest-VolumesGetTestJSON-302841591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.686s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:15 devstack cinder-volume[93788]: DEBUG cinder.manager [req-c085f4b8-b6ab-4a07-8187-bf2aec365d0c req-361f03b0-4b08-46e3-84d9-bcbba119b574 tempest-VolumesGetTestJSON-302841591 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:33:15 devstack cinder-volume[93788]: INFO cinder.volume.manager [req-c085f4b8-b6ab-4a07-8187-bf2aec365d0c req-361f03b0-4b08-46e3-84d9-bcbba119b574 tempest-VolumesGetTestJSON-302841591 None] Deleted volume successfully. Jun 23 16:33:16 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b083b72f-1a57-4654-8423-45a8a5576e86 tempest-SnapshotMetadataTestJSON-1465009020 None] Acquiring lock "cinder-d2fab983-e584-4501-868e-549915653228-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:33:16 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b083b72f-1a57-4654-8423-45a8a5576e86 tempest-SnapshotMetadataTestJSON-1465009020 None] Lock "cinder-d2fab983-e584-4501-868e-549915653228-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:33:16 devstack cinder-volume[93788]: DEBUG cinder.coordination [req-c085f4b8-b6ab-4a07-8187-bf2aec365d0c req-361f03b0-4b08-46e3-84d9-bcbba119b574 tempest-VolumesGetTestJSON-302841591 None] Lock "cinder-c8a11f47-4320-46ae-8dc3-bbb3adcb0a30-delete_volume" released by "delete_volume" :: held 3.084s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:33:16 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b083b72f-1a57-4654-8423-45a8a5576e86 tempest-SnapshotMetadataTestJSON-1465009020 None] Acquiring lock "cinder-quobyte-d2fab983-e584-4501-868e-549915653228" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:33:16 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b083b72f-1a57-4654-8423-45a8a5576e86 tempest-SnapshotMetadataTestJSON-1465009020 None] Lock "cinder-quobyte-d2fab983-e584-4501-868e-549915653228" acquired by "delete_volume" :: waited 0.022s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:33:16 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d2c3b7-b2f1-4ecd-8e57-d494d6c05232]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:33:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b083b72f-1a57-4654-8423-45a8a5576e86 tempest-SnapshotMetadataTestJSON-1465009020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d2fab983-e584-4501-868e-549915653228 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:16 devstack sudo[100912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d2fab983-e584-4501-868e-549915653228 Jun 23 16:33:16 devstack sudo[100912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:17 devstack sudo[100912]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b083b72f-1a57-4654-8423-45a8a5576e86 tempest-SnapshotMetadataTestJSON-1465009020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d2fab983-e584-4501-868e-549915653228" returned: 0 in 0.911s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b083b72f-1a57-4654-8423-45a8a5576e86 tempest-SnapshotMetadataTestJSON-1465009020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d2fab983-e584-4501-868e-549915653228 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:17 devstack sudo[100918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d2fab983-e584-4501-868e-549915653228 Jun 23 16:33:17 devstack sudo[100918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:17 devstack sudo[100918]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b083b72f-1a57-4654-8423-45a8a5576e86 tempest-SnapshotMetadataTestJSON-1465009020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d2fab983-e584-4501-868e-549915653228" returned: 0 in 0.748s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:18 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b083b72f-1a57-4654-8423-45a8a5576e86 tempest-SnapshotMetadataTestJSON-1465009020 None] Lock "cinder-quobyte-d2fab983-e584-4501-868e-549915653228" released by "delete_volume" :: held 1.735s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:33:19 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-b083b72f-1a57-4654-8423-45a8a5576e86 tempest-SnapshotMetadataTestJSON-1465009020 None] Created reservations ['fd8f1da2-bc21-4aca-9482-6e1ae2a425b4', 'b687abc1-fa49-4828-aa25-389af4eca2a6', '51bbd271-62be-4746-b0e1-08d970807779', '1bc5de6c-ea04-489a-ab5e-f892b5cc3d49'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:33:20 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b083b72f-1a57-4654-8423-45a8a5576e86 tempest-SnapshotMetadataTestJSON-1465009020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:33:20 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b083b72f-1a57-4654-8423-45a8a5576e86 tempest-SnapshotMetadataTestJSON-1465009020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:33:20 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b083b72f-1a57-4654-8423-45a8a5576e86 tempest-SnapshotMetadataTestJSON-1465009020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:33:20 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b083b72f-1a57-4654-8423-45a8a5576e86 tempest-SnapshotMetadataTestJSON-1465009020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:33:20 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b083b72f-1a57-4654-8423-45a8a5576e86 tempest-SnapshotMetadataTestJSON-1465009020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:33:20 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b083b72f-1a57-4654-8423-45a8a5576e86 tempest-SnapshotMetadataTestJSON-1465009020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:20 devstack sudo[100956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:33:20 devstack sudo[100956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:21 devstack sudo[100956]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b083b72f-1a57-4654-8423-45a8a5576e86 tempest-SnapshotMetadataTestJSON-1465009020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.869s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:21 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-b083b72f-1a57-4654-8423-45a8a5576e86 tempest-SnapshotMetadataTestJSON-1465009020 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:33:21 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-b083b72f-1a57-4654-8423-45a8a5576e86 tempest-SnapshotMetadataTestJSON-1465009020 None] Deleted volume successfully. Jun 23 16:33:21 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b083b72f-1a57-4654-8423-45a8a5576e86 tempest-SnapshotMetadataTestJSON-1465009020 None] Lock "cinder-d2fab983-e584-4501-868e-549915653228-delete_volume" released by "delete_volume" :: held 5.279s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:33:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-e62a4f0b-613e-4a54-aa9d-edaa10980d2d req-dce10321-6b15-4a0e-abff-69cd1ab6b009 tempest-ServerActionsTestOtherA-1626454459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:33:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-e62a4f0b-613e-4a54-aa9d-edaa10980d2d req-dce10321-6b15-4a0e-abff-69cd1ab6b009 tempest-ServerActionsTestOtherA-1626454459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:33:21 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d4d791-25ed-47f0-9073-0a66048f1e40]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:33:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-e62a4f0b-613e-4a54-aa9d-edaa10980d2d req-dce10321-6b15-4a0e-abff-69cd1ab6b009 tempest-ServerActionsTestOtherA-1626454459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-80319ecc-7a03-42da-8ae8-4d7d493a5066 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:21 devstack sudo[100981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-80319ecc-7a03-42da-8ae8-4d7d493a5066 Jun 23 16:33:21 devstack sudo[100981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:22 devstack sudo[100981]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-e62a4f0b-613e-4a54-aa9d-edaa10980d2d req-dce10321-6b15-4a0e-abff-69cd1ab6b009 tempest-ServerActionsTestOtherA-1626454459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-80319ecc-7a03-42da-8ae8-4d7d493a5066" returned: 0 in 0.961s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-e62a4f0b-613e-4a54-aa9d-edaa10980d2d req-dce10321-6b15-4a0e-abff-69cd1ab6b009 tempest-ServerActionsTestOtherA-1626454459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.986s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:33:22 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-e62a4f0b-613e-4a54-aa9d-edaa10980d2d req-dce10321-6b15-4a0e-abff-69cd1ab6b009 tempest-ServerActionsTestOtherA-1626454459 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e', 'name': 'volume-80319ecc-7a03-42da-8ae8-4d7d493a5066', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'db80acf9-a0c2-4d9f-96a6-315563fc878c', 'enforce_multipath': True} {{(pid=93788) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 16:33:22 devstack cinder-volume[93788]: INFO cinder.volume.manager [req-e62a4f0b-613e-4a54-aa9d-edaa10980d2d req-dce10321-6b15-4a0e-abff-69cd1ab6b009 tempest-ServerActionsTestOtherA-1626454459 None] attachment_update completed successfully. Jun 23 16:33:24 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cfadfa5-bac6-4189-88c6-6ce3546dfc03 tempest-VolumesTestJSON-591326206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:33:24 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2cfadfa5-bac6-4189-88c6-6ce3546dfc03 tempest-VolumesTestJSON-591326206 None] Flow 'volume_create_manager' (981a7fff-02c7-4053-a121-79e62608ead4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:33:24 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2cfadfa5-bac6-4189-88c6-6ce3546dfc03 tempest-VolumesTestJSON-591326206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43209246-b824-46ff-83e3-5269447dc988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:33:24 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2cfadfa5-bac6-4189-88c6-6ce3546dfc03 tempest-VolumesTestJSON-591326206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43209246-b824-46ff-83e3-5269447dc988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:33:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-221405542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ae5b83f-4ffc-4d19-b8d1-867dc81ef163,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0a14b90386444232ba029fc93b56f5bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:33:24Z,use_quota=True,user_id='46036bda7c8d456694bb69519a548d57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:33:24 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2cfadfa5-bac6-4189-88c6-6ce3546dfc03 tempest-VolumesTestJSON-591326206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09197ce8-4036-477c-8fd8-d2bd2529134d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:33:24 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2cfadfa5-bac6-4189-88c6-6ce3546dfc03 tempest-VolumesTestJSON-591326206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09197ce8-4036-477c-8fd8-d2bd2529134d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:33:24 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2cfadfa5-bac6-4189-88c6-6ce3546dfc03 tempest-VolumesTestJSON-591326206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (039102c6-6efa-433a-9eb7-558ea7ceeb12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:33:24 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2cfadfa5-bac6-4189-88c6-6ce3546dfc03 tempest-VolumesTestJSON-591326206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (039102c6-6efa-433a-9eb7-558ea7ceeb12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ae5b83f-4ffc-4d19-b8d1-867dc81ef163', 'volume_name': 'volume-0ae5b83f-4ffc-4d19-b8d1-867dc81ef163', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:33:24 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2cfadfa5-bac6-4189-88c6-6ce3546dfc03 tempest-VolumesTestJSON-591326206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (015d9583-499c-47d6-9142-69d987f8f791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:33:24 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2cfadfa5-bac6-4189-88c6-6ce3546dfc03 tempest-VolumesTestJSON-591326206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (015d9583-499c-47d6-9142-69d987f8f791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:33:24 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2cfadfa5-bac6-4189-88c6-6ce3546dfc03 tempest-VolumesTestJSON-591326206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (387dfe21-bdf3-41de-9473-f3cfe590245f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:33:24 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-2cfadfa5-bac6-4189-88c6-6ce3546dfc03 tempest-VolumesTestJSON-591326206 None] Volume 0ae5b83f-4ffc-4d19-b8d1-867dc81ef163: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ae5b83f-4ffc-4d19-b8d1-867dc81ef163', 'volume_size': 1} Jun 23 16:33:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-2cfadfa5-bac6-4189-88c6-6ce3546dfc03 tempest-VolumesTestJSON-591326206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:33:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-2cfadfa5-bac6-4189-88c6-6ce3546dfc03 tempest-VolumesTestJSON-591326206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:33:24 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-2cfadfa5-bac6-4189-88c6-6ce3546dfc03 tempest-VolumesTestJSON-591326206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:33:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-221405542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ae5b83f-4ffc-4d19-b8d1-867dc81ef163,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0a14b90386444232ba029fc93b56f5bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:33:24Z,use_quota=True,user_id='46036bda7c8d456694bb69519a548d57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:33:24 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-2cfadfa5-bac6-4189-88c6-6ce3546dfc03 tempest-VolumesTestJSON-591326206 None] Creating volume 0ae5b83f-4ffc-4d19-b8d1-867dc81ef163 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:33:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-2cfadfa5-bac6-4189-88c6-6ce3546dfc03 tempest-VolumesTestJSON-591326206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:33:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-2cfadfa5-bac6-4189-88c6-6ce3546dfc03 tempest-VolumesTestJSON-591326206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:33:24 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-2cfadfa5-bac6-4189-88c6-6ce3546dfc03 tempest-VolumesTestJSON-591326206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:33:24 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-2cfadfa5-bac6-4189-88c6-6ce3546dfc03 tempest-VolumesTestJSON-591326206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:33:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-2cfadfa5-bac6-4189-88c6-6ce3546dfc03 tempest-VolumesTestJSON-591326206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:33:24 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-2cfadfa5-bac6-4189-88c6-6ce3546dfc03 tempest-VolumesTestJSON-591326206 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:33:24 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-2cfadfa5-bac6-4189-88c6-6ce3546dfc03 tempest-VolumesTestJSON-591326206 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:33:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2cfadfa5-bac6-4189-88c6-6ce3546dfc03 tempest-VolumesTestJSON-591326206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ae5b83f-4ffc-4d19-b8d1-867dc81ef163 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:24 devstack sudo[101372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ae5b83f-4ffc-4d19-b8d1-867dc81ef163 1073741824 Jun 23 16:33:24 devstack sudo[101372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:25 devstack sudo[101372]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2cfadfa5-bac6-4189-88c6-6ce3546dfc03 tempest-VolumesTestJSON-591326206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ae5b83f-4ffc-4d19-b8d1-867dc81ef163 1073741824" returned: 0 in 0.967s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2cfadfa5-bac6-4189-88c6-6ce3546dfc03 tempest-VolumesTestJSON-591326206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ae5b83f-4ffc-4d19-b8d1-867dc81ef163 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:25 devstack sudo[101379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ae5b83f-4ffc-4d19-b8d1-867dc81ef163 Jun 23 16:33:25 devstack sudo[101379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:25 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc1f78f0-a8af-457c-ac89-9952e4dd6ae4 tempest-AbsoluteLimitsTests-1986032319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:33:25 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-fc1f78f0-a8af-457c-ac89-9952e4dd6ae4 tempest-AbsoluteLimitsTests-1986032319 None] Flow 'volume_create_manager' (4270781a-3968-423e-844c-2606733c40b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:33:25 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-fc1f78f0-a8af-457c-ac89-9952e4dd6ae4 tempest-AbsoluteLimitsTests-1986032319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c808402f-df21-4076-91b3-59fd102157a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:33:25 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-fc1f78f0-a8af-457c-ac89-9952e4dd6ae4 tempest-AbsoluteLimitsTests-1986032319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c808402f-df21-4076-91b3-59fd102157a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1471161779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1085e2f-13fb-4f88-9aca-20cb098a3a8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daaa7b9643304fecad7d334e9f625003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:33:26Z,use_quota=True,user_id='246a2f9148d246dc8231dadf60936b58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:33:25 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-fc1f78f0-a8af-457c-ac89-9952e4dd6ae4 tempest-AbsoluteLimitsTests-1986032319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (818b7a96-c993-46a5-9cf3-07a47163b613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:33:25 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-fc1f78f0-a8af-457c-ac89-9952e4dd6ae4 tempest-AbsoluteLimitsTests-1986032319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (818b7a96-c993-46a5-9cf3-07a47163b613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:33:25 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-fc1f78f0-a8af-457c-ac89-9952e4dd6ae4 tempest-AbsoluteLimitsTests-1986032319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d92d67d-77c1-4fb7-aa20-ddbd5eef908c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:33:25 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-fc1f78f0-a8af-457c-ac89-9952e4dd6ae4 tempest-AbsoluteLimitsTests-1986032319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d92d67d-77c1-4fb7-aa20-ddbd5eef908c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1085e2f-13fb-4f88-9aca-20cb098a3a8e', 'volume_name': 'volume-f1085e2f-13fb-4f88-9aca-20cb098a3a8e', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:33:25 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-fc1f78f0-a8af-457c-ac89-9952e4dd6ae4 tempest-AbsoluteLimitsTests-1986032319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b31a1dd1-2c20-4faa-af5b-d548dfc8b5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:33:25 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-fc1f78f0-a8af-457c-ac89-9952e4dd6ae4 tempest-AbsoluteLimitsTests-1986032319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b31a1dd1-2c20-4faa-af5b-d548dfc8b5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:33:25 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-fc1f78f0-a8af-457c-ac89-9952e4dd6ae4 tempest-AbsoluteLimitsTests-1986032319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (984e3794-9aa5-4560-8a44-1c66e5c4987f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:33:25 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-fc1f78f0-a8af-457c-ac89-9952e4dd6ae4 tempest-AbsoluteLimitsTests-1986032319 None] Volume f1085e2f-13fb-4f88-9aca-20cb098a3a8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1085e2f-13fb-4f88-9aca-20cb098a3a8e', 'volume_size': 1} Jun 23 16:33:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-fc1f78f0-a8af-457c-ac89-9952e4dd6ae4 tempest-AbsoluteLimitsTests-1986032319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:33:25 devstack sudo[101379]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2cfadfa5-bac6-4189-88c6-6ce3546dfc03 tempest-VolumesTestJSON-591326206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ae5b83f-4ffc-4d19-b8d1-867dc81ef163" returned: 0 in 0.698s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:25 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-2cfadfa5-bac6-4189-88c6-6ce3546dfc03 tempest-VolumesTestJSON-591326206 None] <== create_volume: return (1734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:33:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-2cfadfa5-bac6-4189-88c6-6ce3546dfc03 tempest-VolumesTestJSON-591326206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.737s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:33:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-fc1f78f0-a8af-457c-ac89-9952e4dd6ae4 tempest-AbsoluteLimitsTests-1986032319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.313s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:33:25 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-fc1f78f0-a8af-457c-ac89-9952e4dd6ae4 tempest-AbsoluteLimitsTests-1986032319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1471161779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1085e2f-13fb-4f88-9aca-20cb098a3a8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daaa7b9643304fecad7d334e9f625003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:33:26Z,use_quota=True,user_id='246a2f9148d246dc8231dadf60936b58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:33:25 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-fc1f78f0-a8af-457c-ac89-9952e4dd6ae4 tempest-AbsoluteLimitsTests-1986032319 None] Creating volume f1085e2f-13fb-4f88-9aca-20cb098a3a8e {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:33:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-fc1f78f0-a8af-457c-ac89-9952e4dd6ae4 tempest-AbsoluteLimitsTests-1986032319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:33:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-fc1f78f0-a8af-457c-ac89-9952e4dd6ae4 tempest-AbsoluteLimitsTests-1986032319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:33:25 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-fc1f78f0-a8af-457c-ac89-9952e4dd6ae4 tempest-AbsoluteLimitsTests-1986032319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:33:25 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-fc1f78f0-a8af-457c-ac89-9952e4dd6ae4 tempest-AbsoluteLimitsTests-1986032319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:33:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-fc1f78f0-a8af-457c-ac89-9952e4dd6ae4 tempest-AbsoluteLimitsTests-1986032319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:33:26 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-fc1f78f0-a8af-457c-ac89-9952e4dd6ae4 tempest-AbsoluteLimitsTests-1986032319 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:33:26 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-fc1f78f0-a8af-457c-ac89-9952e4dd6ae4 tempest-AbsoluteLimitsTests-1986032319 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:33:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-fc1f78f0-a8af-457c-ac89-9952e4dd6ae4 tempest-AbsoluteLimitsTests-1986032319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f1085e2f-13fb-4f88-9aca-20cb098a3a8e 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:26 devstack sudo[101397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f1085e2f-13fb-4f88-9aca-20cb098a3a8e 1073741824 Jun 23 16:33:26 devstack sudo[101397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2cfadfa5-bac6-4189-88c6-6ce3546dfc03 tempest-VolumesTestJSON-591326206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (387dfe21-bdf3-41de-9473-f3cfe590245f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ae5b83f-4ffc-4d19-b8d1-867dc81ef163', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:33:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2cfadfa5-bac6-4189-88c6-6ce3546dfc03 tempest-VolumesTestJSON-591326206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2116c849-96d9-4d08-b2cb-ebe8962ad87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:33:26 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-2cfadfa5-bac6-4189-88c6-6ce3546dfc03 tempest-VolumesTestJSON-591326206 None] Volume volume-0ae5b83f-4ffc-4d19-b8d1-867dc81ef163 (0ae5b83f-4ffc-4d19-b8d1-867dc81ef163): created successfully Jun 23 16:33:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2cfadfa5-bac6-4189-88c6-6ce3546dfc03 tempest-VolumesTestJSON-591326206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2116c849-96d9-4d08-b2cb-ebe8962ad87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:33:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2cfadfa5-bac6-4189-88c6-6ce3546dfc03 tempest-VolumesTestJSON-591326206 None] Flow 'volume_create_manager' (981a7fff-02c7-4053-a121-79e62608ead4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:33:26 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-2cfadfa5-bac6-4189-88c6-6ce3546dfc03 tempest-VolumesTestJSON-591326206 None] Created volume successfully. Jun 23 16:33:26 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-04e68a4f-01d9-4059-8cc6-585955b0418c tempest-VolumesTestJSON-591326206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:33:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-04e68a4f-01d9-4059-8cc6-585955b0418c tempest-VolumesTestJSON-591326206 None] Flow 'volume_create_manager' (86f80687-ab4b-4eb8-9180-65971333352c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:33:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-04e68a4f-01d9-4059-8cc6-585955b0418c tempest-VolumesTestJSON-591326206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (016e6dff-0b16-40aa-950c-ed86c1351936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:33:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-04e68a4f-01d9-4059-8cc6-585955b0418c tempest-VolumesTestJSON-591326206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (016e6dff-0b16-40aa-950c-ed86c1351936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-614105226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0321657-8b73-4997-aa26-fe24e14fd976,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0a14b90386444232ba029fc93b56f5bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:33:27Z,use_quota=True,user_id='46036bda7c8d456694bb69519a548d57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:33:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-04e68a4f-01d9-4059-8cc6-585955b0418c tempest-VolumesTestJSON-591326206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7c7a7a6-79cc-4011-bc08-263712374a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:33:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-04e68a4f-01d9-4059-8cc6-585955b0418c tempest-VolumesTestJSON-591326206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7c7a7a6-79cc-4011-bc08-263712374a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:33:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-04e68a4f-01d9-4059-8cc6-585955b0418c tempest-VolumesTestJSON-591326206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a534c123-4c8d-4310-ac5e-a7f7abe0c0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:33:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-04e68a4f-01d9-4059-8cc6-585955b0418c tempest-VolumesTestJSON-591326206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a534c123-4c8d-4310-ac5e-a7f7abe0c0e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0321657-8b73-4997-aa26-fe24e14fd976', 'volume_name': 'volume-a0321657-8b73-4997-aa26-fe24e14fd976', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:33:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-04e68a4f-01d9-4059-8cc6-585955b0418c tempest-VolumesTestJSON-591326206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1249a8b2-77ce-4049-a75b-d618a56d3598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:33:26 devstack sudo[101397]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-04e68a4f-01d9-4059-8cc6-585955b0418c tempest-VolumesTestJSON-591326206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1249a8b2-77ce-4049-a75b-d618a56d3598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:33:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-04e68a4f-01d9-4059-8cc6-585955b0418c tempest-VolumesTestJSON-591326206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (384edbcf-363c-4890-bfda-92cf9216b6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:33:26 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-04e68a4f-01d9-4059-8cc6-585955b0418c tempest-VolumesTestJSON-591326206 None] Volume a0321657-8b73-4997-aa26-fe24e14fd976: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0321657-8b73-4997-aa26-fe24e14fd976', 'volume_size': 1} Jun 23 16:33:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-04e68a4f-01d9-4059-8cc6-585955b0418c tempest-VolumesTestJSON-591326206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:33:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-fc1f78f0-a8af-457c-ac89-9952e4dd6ae4 tempest-AbsoluteLimitsTests-1986032319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f1085e2f-13fb-4f88-9aca-20cb098a3a8e 1073741824" returned: 0 in 0.916s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-fc1f78f0-a8af-457c-ac89-9952e4dd6ae4 tempest-AbsoluteLimitsTests-1986032319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f1085e2f-13fb-4f88-9aca-20cb098a3a8e {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:26 devstack sudo[101405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f1085e2f-13fb-4f88-9aca-20cb098a3a8e Jun 23 16:33:26 devstack sudo[101405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:27 devstack sudo[101405]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-fc1f78f0-a8af-457c-ac89-9952e4dd6ae4 tempest-AbsoluteLimitsTests-1986032319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f1085e2f-13fb-4f88-9aca-20cb098a3a8e" returned: 0 in 0.805s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:27 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-fc1f78f0-a8af-457c-ac89-9952e4dd6ae4 tempest-AbsoluteLimitsTests-1986032319 None] <== create_volume: return (1766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:33:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-fc1f78f0-a8af-457c-ac89-9952e4dd6ae4 tempest-AbsoluteLimitsTests-1986032319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.769s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:33:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-04e68a4f-01d9-4059-8cc6-585955b0418c tempest-VolumesTestJSON-591326206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.850s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:33:27 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-04e68a4f-01d9-4059-8cc6-585955b0418c tempest-VolumesTestJSON-591326206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-614105226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0321657-8b73-4997-aa26-fe24e14fd976,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0a14b90386444232ba029fc93b56f5bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:33:27Z,use_quota=True,user_id='46036bda7c8d456694bb69519a548d57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:33:27 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-04e68a4f-01d9-4059-8cc6-585955b0418c tempest-VolumesTestJSON-591326206 None] Creating volume a0321657-8b73-4997-aa26-fe24e14fd976 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:33:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-04e68a4f-01d9-4059-8cc6-585955b0418c tempest-VolumesTestJSON-591326206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:33:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-04e68a4f-01d9-4059-8cc6-585955b0418c tempest-VolumesTestJSON-591326206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:33:27 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-04e68a4f-01d9-4059-8cc6-585955b0418c tempest-VolumesTestJSON-591326206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:33:27 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-04e68a4f-01d9-4059-8cc6-585955b0418c tempest-VolumesTestJSON-591326206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:33:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-04e68a4f-01d9-4059-8cc6-585955b0418c tempest-VolumesTestJSON-591326206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:33:27 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-04e68a4f-01d9-4059-8cc6-585955b0418c tempest-VolumesTestJSON-591326206 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:33:27 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-04e68a4f-01d9-4059-8cc6-585955b0418c tempest-VolumesTestJSON-591326206 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:33:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-04e68a4f-01d9-4059-8cc6-585955b0418c tempest-VolumesTestJSON-591326206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-a0321657-8b73-4997-aa26-fe24e14fd976 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:27 devstack sudo[101408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-a0321657-8b73-4997-aa26-fe24e14fd976 1073741824 Jun 23 16:33:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-fc1f78f0-a8af-457c-ac89-9952e4dd6ae4 tempest-AbsoluteLimitsTests-1986032319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (984e3794-9aa5-4560-8a44-1c66e5c4987f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1085e2f-13fb-4f88-9aca-20cb098a3a8e', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:33:27 devstack sudo[101408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-fc1f78f0-a8af-457c-ac89-9952e4dd6ae4 tempest-AbsoluteLimitsTests-1986032319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aad5f68-d3bf-4401-a406-5330f5694efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:33:27 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-fc1f78f0-a8af-457c-ac89-9952e4dd6ae4 tempest-AbsoluteLimitsTests-1986032319 None] Volume volume-f1085e2f-13fb-4f88-9aca-20cb098a3a8e (f1085e2f-13fb-4f88-9aca-20cb098a3a8e): created successfully Jun 23 16:33:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-fc1f78f0-a8af-457c-ac89-9952e4dd6ae4 tempest-AbsoluteLimitsTests-1986032319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aad5f68-d3bf-4401-a406-5330f5694efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:33:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-fc1f78f0-a8af-457c-ac89-9952e4dd6ae4 tempest-AbsoluteLimitsTests-1986032319 None] Flow 'volume_create_manager' (4270781a-3968-423e-844c-2606733c40b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:33:27 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-fc1f78f0-a8af-457c-ac89-9952e4dd6ae4 tempest-AbsoluteLimitsTests-1986032319 None] Created volume successfully. Jun 23 16:33:28 devstack sudo[101408]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-04e68a4f-01d9-4059-8cc6-585955b0418c tempest-VolumesTestJSON-591326206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-a0321657-8b73-4997-aa26-fe24e14fd976 1073741824" returned: 0 in 1.128s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-04e68a4f-01d9-4059-8cc6-585955b0418c tempest-VolumesTestJSON-591326206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-a0321657-8b73-4997-aa26-fe24e14fd976 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:29 devstack sudo[101431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-a0321657-8b73-4997-aa26-fe24e14fd976 Jun 23 16:33:29 devstack sudo[101431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:29 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-13379988-da52-45aa-9bba-0181f91875cd tempest-AbsoluteLimitsTests-1986032319 None] Acquiring lock "cinder-f1085e2f-13fb-4f88-9aca-20cb098a3a8e-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:33:29 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-13379988-da52-45aa-9bba-0181f91875cd tempest-AbsoluteLimitsTests-1986032319 None] Lock "cinder-f1085e2f-13fb-4f88-9aca-20cb098a3a8e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:33:29 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-13379988-da52-45aa-9bba-0181f91875cd tempest-AbsoluteLimitsTests-1986032319 None] Acquiring lock "cinder-quobyte-f1085e2f-13fb-4f88-9aca-20cb098a3a8e" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:33:29 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-13379988-da52-45aa-9bba-0181f91875cd tempest-AbsoluteLimitsTests-1986032319 None] Lock "cinder-quobyte-f1085e2f-13fb-4f88-9aca-20cb098a3a8e" acquired by "delete_volume" :: waited 0.032s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:33:29 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[970119be-3b03-4573-b70c-35117e7f7f2c]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:33:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-13379988-da52-45aa-9bba-0181f91875cd tempest-AbsoluteLimitsTests-1986032319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f1085e2f-13fb-4f88-9aca-20cb098a3a8e {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:29 devstack sudo[101455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f1085e2f-13fb-4f88-9aca-20cb098a3a8e Jun 23 16:33:29 devstack sudo[101455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:30 devstack sudo[101431]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-04e68a4f-01d9-4059-8cc6-585955b0418c tempest-VolumesTestJSON-591326206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-a0321657-8b73-4997-aa26-fe24e14fd976" returned: 0 in 1.056s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:30 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-04e68a4f-01d9-4059-8cc6-585955b0418c tempest-VolumesTestJSON-591326206 None] <== create_volume: return (2259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:33:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-04e68a4f-01d9-4059-8cc6-585955b0418c tempest-VolumesTestJSON-591326206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.263s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:33:30 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-04e68a4f-01d9-4059-8cc6-585955b0418c tempest-VolumesTestJSON-591326206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (384edbcf-363c-4890-bfda-92cf9216b6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0321657-8b73-4997-aa26-fe24e14fd976', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:33:30 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-04e68a4f-01d9-4059-8cc6-585955b0418c tempest-VolumesTestJSON-591326206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a1d5880-9db8-4c70-9020-67ddb6b9b579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:33:30 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-04e68a4f-01d9-4059-8cc6-585955b0418c tempest-VolumesTestJSON-591326206 None] Volume volume-a0321657-8b73-4997-aa26-fe24e14fd976 (a0321657-8b73-4997-aa26-fe24e14fd976): created successfully Jun 23 16:33:30 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-04e68a4f-01d9-4059-8cc6-585955b0418c tempest-VolumesTestJSON-591326206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a1d5880-9db8-4c70-9020-67ddb6b9b579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:33:30 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-04e68a4f-01d9-4059-8cc6-585955b0418c tempest-VolumesTestJSON-591326206 None] Flow 'volume_create_manager' (86f80687-ab4b-4eb8-9180-65971333352c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:33:30 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-04e68a4f-01d9-4059-8cc6-585955b0418c tempest-VolumesTestJSON-591326206 None] Created volume successfully. Jun 23 16:33:30 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-df8d80b2-f02e-47d9-a83b-db62ceddf053 tempest-AttachVolumeTestJSON-1111501152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:33:30 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df8d80b2-f02e-47d9-a83b-db62ceddf053 tempest-AttachVolumeTestJSON-1111501152 None] Flow 'volume_create_manager' (ae24ae76-42fd-45ad-8a85-5929ef9b66c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:33:30 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df8d80b2-f02e-47d9-a83b-db62ceddf053 tempest-AttachVolumeTestJSON-1111501152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a1797ec-8131-4c97-84e0-5887f27c777e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:33:30 devstack sudo[101455]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-13379988-da52-45aa-9bba-0181f91875cd tempest-AbsoluteLimitsTests-1986032319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f1085e2f-13fb-4f88-9aca-20cb098a3a8e" returned: 0 in 1.206s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-13379988-da52-45aa-9bba-0181f91875cd tempest-AbsoluteLimitsTests-1986032319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f1085e2f-13fb-4f88-9aca-20cb098a3a8e {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:30 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df8d80b2-f02e-47d9-a83b-db62ceddf053 tempest-AttachVolumeTestJSON-1111501152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a1797ec-8131-4c97-84e0-5887f27c777e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-518720044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15b3b4e5-2b5e-4084-b713-0851e5ed4541,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e57d651cfd04e00826ec703018aca5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:33:30Z,use_quota=True,user_id='f831cea18f3c4738b5b0b0388ed86b3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:33:30 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df8d80b2-f02e-47d9-a83b-db62ceddf053 tempest-AttachVolumeTestJSON-1111501152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1221604f-2b9d-444f-8d1c-c40845d5b41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:33:30 devstack sudo[101467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f1085e2f-13fb-4f88-9aca-20cb098a3a8e Jun 23 16:33:30 devstack sudo[101467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:30 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df8d80b2-f02e-47d9-a83b-db62ceddf053 tempest-AttachVolumeTestJSON-1111501152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1221604f-2b9d-444f-8d1c-c40845d5b41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:33:30 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df8d80b2-f02e-47d9-a83b-db62ceddf053 tempest-AttachVolumeTestJSON-1111501152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35034f25-1c1b-47d2-bd9b-53e4bd31662b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:33:30 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df8d80b2-f02e-47d9-a83b-db62ceddf053 tempest-AttachVolumeTestJSON-1111501152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35034f25-1c1b-47d2-bd9b-53e4bd31662b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15b3b4e5-2b5e-4084-b713-0851e5ed4541', 'volume_name': 'volume-15b3b4e5-2b5e-4084-b713-0851e5ed4541', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:33:30 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df8d80b2-f02e-47d9-a83b-db62ceddf053 tempest-AttachVolumeTestJSON-1111501152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cce8f9b-4731-4159-bea9-76b42c45145b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:33:30 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df8d80b2-f02e-47d9-a83b-db62ceddf053 tempest-AttachVolumeTestJSON-1111501152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cce8f9b-4731-4159-bea9-76b42c45145b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:33:30 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df8d80b2-f02e-47d9-a83b-db62ceddf053 tempest-AttachVolumeTestJSON-1111501152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be2c7e78-5d76-47ac-b501-64c140a7532d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:33:30 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-df8d80b2-f02e-47d9-a83b-db62ceddf053 tempest-AttachVolumeTestJSON-1111501152 None] Volume 15b3b4e5-2b5e-4084-b713-0851e5ed4541: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15b3b4e5-2b5e-4084-b713-0851e5ed4541', 'volume_size': 1} Jun 23 16:33:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df8d80b2-f02e-47d9-a83b-db62ceddf053 tempest-AttachVolumeTestJSON-1111501152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:33:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df8d80b2-f02e-47d9-a83b-db62ceddf053 tempest-AttachVolumeTestJSON-1111501152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:33:30 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df8d80b2-f02e-47d9-a83b-db62ceddf053 tempest-AttachVolumeTestJSON-1111501152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-518720044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15b3b4e5-2b5e-4084-b713-0851e5ed4541,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e57d651cfd04e00826ec703018aca5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:33:30Z,use_quota=True,user_id='f831cea18f3c4738b5b0b0388ed86b3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:33:30 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-df8d80b2-f02e-47d9-a83b-db62ceddf053 tempest-AttachVolumeTestJSON-1111501152 None] Creating volume 15b3b4e5-2b5e-4084-b713-0851e5ed4541 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:33:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df8d80b2-f02e-47d9-a83b-db62ceddf053 tempest-AttachVolumeTestJSON-1111501152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:33:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df8d80b2-f02e-47d9-a83b-db62ceddf053 tempest-AttachVolumeTestJSON-1111501152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:33:30 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df8d80b2-f02e-47d9-a83b-db62ceddf053 tempest-AttachVolumeTestJSON-1111501152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:33:30 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df8d80b2-f02e-47d9-a83b-db62ceddf053 tempest-AttachVolumeTestJSON-1111501152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:33:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df8d80b2-f02e-47d9-a83b-db62ceddf053 tempest-AttachVolumeTestJSON-1111501152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:33:30 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df8d80b2-f02e-47d9-a83b-db62ceddf053 tempest-AttachVolumeTestJSON-1111501152 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:33:30 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-df8d80b2-f02e-47d9-a83b-db62ceddf053 tempest-AttachVolumeTestJSON-1111501152 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:33:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df8d80b2-f02e-47d9-a83b-db62ceddf053 tempest-AttachVolumeTestJSON-1111501152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-15b3b4e5-2b5e-4084-b713-0851e5ed4541 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:30 devstack sudo[101469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-15b3b4e5-2b5e-4084-b713-0851e5ed4541 1073741824 Jun 23 16:33:30 devstack sudo[101469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:31 devstack sudo[101467]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:31 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-13379988-da52-45aa-9bba-0181f91875cd tempest-AbsoluteLimitsTests-1986032319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f1085e2f-13fb-4f88-9aca-20cb098a3a8e" returned: 0 in 1.104s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:31 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-13379988-da52-45aa-9bba-0181f91875cd tempest-AbsoluteLimitsTests-1986032319 None] Lock "cinder-quobyte-f1085e2f-13fb-4f88-9aca-20cb098a3a8e" released by "delete_volume" :: held 2.380s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:33:31 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-13379988-da52-45aa-9bba-0181f91875cd tempest-AbsoluteLimitsTests-1986032319 None] Created reservations ['07b16950-829a-4ad5-ac3a-5f39bea0395e', '3a87c735-6848-43bb-a8b0-1285ee40304f', 'd097d9e6-099b-4767-b15f-72f21806b955', 'c1c9dc6d-cc2e-42ef-8859-37b00d2e322d'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:33:31 devstack sudo[101469]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:31 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df8d80b2-f02e-47d9-a83b-db62ceddf053 tempest-AttachVolumeTestJSON-1111501152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-15b3b4e5-2b5e-4084-b713-0851e5ed4541 1073741824" returned: 0 in 1.233s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:31 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-13379988-da52-45aa-9bba-0181f91875cd tempest-AbsoluteLimitsTests-1986032319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:33:31 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-13379988-da52-45aa-9bba-0181f91875cd tempest-AbsoluteLimitsTests-1986032319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:33:31 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-13379988-da52-45aa-9bba-0181f91875cd tempest-AbsoluteLimitsTests-1986032319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:33:31 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-13379988-da52-45aa-9bba-0181f91875cd tempest-AbsoluteLimitsTests-1986032319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:33:31 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-13379988-da52-45aa-9bba-0181f91875cd tempest-AbsoluteLimitsTests-1986032319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:33:31 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-13379988-da52-45aa-9bba-0181f91875cd tempest-AbsoluteLimitsTests-1986032319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:31 devstack sudo[101518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:33:31 devstack sudo[101518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:31 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df8d80b2-f02e-47d9-a83b-db62ceddf053 tempest-AttachVolumeTestJSON-1111501152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-15b3b4e5-2b5e-4084-b713-0851e5ed4541 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:31 devstack sudo[101544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-15b3b4e5-2b5e-4084-b713-0851e5ed4541 Jun 23 16:33:31 devstack sudo[101544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:31 devstack cinder-volume[93788]: INFO cinder.volume.manager [req-453dec3c-99dc-4a17-b633-f955d9623053 req-3c1f0b58-4174-461c-bb62-6485f5b3051f tempest-ServerActionsTestOtherA-1626454459 None] Terminate volume connection completed successfully. Jun 23 16:33:31 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-453dec3c-99dc-4a17-b633-f955d9623053 req-3c1f0b58-4174-461c-bb62-6485f5b3051f tempest-ServerActionsTestOtherA-1626454459 None] Deleting attachment db80acf9-a0c2-4d9f-96a6-315563fc878c. {{(pid=93788) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 16:33:32 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-b15590f1-224d-4e2a-9f0d-833834e074f8 tempest-VolumesTestJSON-591326206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:33:32 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b15590f1-224d-4e2a-9f0d-833834e074f8 tempest-VolumesTestJSON-591326206 None] Flow 'volume_create_manager' (23573e11-57b6-463e-980f-41893eb5d7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:33:32 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b15590f1-224d-4e2a-9f0d-833834e074f8 tempest-VolumesTestJSON-591326206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8332a58f-9788-435b-99a0-ff05af44b371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:33:32 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b15590f1-224d-4e2a-9f0d-833834e074f8 tempest-VolumesTestJSON-591326206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8332a58f-9788-435b-99a0-ff05af44b371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:33:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1737663673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=681e0a4d-9b04-42e5-a48d-182c09358511,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0a14b90386444232ba029fc93b56f5bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:33:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:33:32Z,use_quota=True,user_id='46036bda7c8d456694bb69519a548d57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:33:32 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b15590f1-224d-4e2a-9f0d-833834e074f8 tempest-VolumesTestJSON-591326206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e408617b-a488-42d4-99d9-d5314109e333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:33:32 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b15590f1-224d-4e2a-9f0d-833834e074f8 tempest-VolumesTestJSON-591326206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e408617b-a488-42d4-99d9-d5314109e333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:33:32 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b15590f1-224d-4e2a-9f0d-833834e074f8 tempest-VolumesTestJSON-591326206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32c084dc-0528-4131-a53c-af08db0906ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:33:32 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b15590f1-224d-4e2a-9f0d-833834e074f8 tempest-VolumesTestJSON-591326206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32c084dc-0528-4131-a53c-af08db0906ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '681e0a4d-9b04-42e5-a48d-182c09358511', 'volume_name': 'volume-681e0a4d-9b04-42e5-a48d-182c09358511', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:33:32 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b15590f1-224d-4e2a-9f0d-833834e074f8 tempest-VolumesTestJSON-591326206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff29d0b8-ff27-4a50-bcf4-b044b02a3fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:33:32 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b15590f1-224d-4e2a-9f0d-833834e074f8 tempest-VolumesTestJSON-591326206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff29d0b8-ff27-4a50-bcf4-b044b02a3fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:33:32 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b15590f1-224d-4e2a-9f0d-833834e074f8 tempest-VolumesTestJSON-591326206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83f543f6-d418-4403-bc6c-1e8955fcfc6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:33:32 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-b15590f1-224d-4e2a-9f0d-833834e074f8 tempest-VolumesTestJSON-591326206 None] Volume 681e0a4d-9b04-42e5-a48d-182c09358511: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-681e0a4d-9b04-42e5-a48d-182c09358511', 'volume_size': 1} Jun 23 16:33:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b15590f1-224d-4e2a-9f0d-833834e074f8 tempest-VolumesTestJSON-591326206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:33:32 devstack sudo[101518]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-13379988-da52-45aa-9bba-0181f91875cd tempest-AbsoluteLimitsTests-1986032319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.746s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:32 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-13379988-da52-45aa-9bba-0181f91875cd tempest-AbsoluteLimitsTests-1986032319 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:33:32 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-13379988-da52-45aa-9bba-0181f91875cd tempest-AbsoluteLimitsTests-1986032319 None] Deleted volume successfully. Jun 23 16:33:32 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-13379988-da52-45aa-9bba-0181f91875cd tempest-AbsoluteLimitsTests-1986032319 None] Lock "cinder-f1085e2f-13fb-4f88-9aca-20cb098a3a8e-delete_volume" released by "delete_volume" :: held 3.511s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:33:32 devstack sudo[101544]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df8d80b2-f02e-47d9-a83b-db62ceddf053 tempest-AttachVolumeTestJSON-1111501152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-15b3b4e5-2b5e-4084-b713-0851e5ed4541" returned: 0 in 0.786s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:32 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df8d80b2-f02e-47d9-a83b-db62ceddf053 tempest-AttachVolumeTestJSON-1111501152 None] <== create_volume: return (2148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:33:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df8d80b2-f02e-47d9-a83b-db62ceddf053 tempest-AttachVolumeTestJSON-1111501152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.151s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:33:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b15590f1-224d-4e2a-9f0d-833834e074f8 tempest-VolumesTestJSON-591326206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.508s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:33:32 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b15590f1-224d-4e2a-9f0d-833834e074f8 tempest-VolumesTestJSON-591326206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:33:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1737663673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=681e0a4d-9b04-42e5-a48d-182c09358511,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0a14b90386444232ba029fc93b56f5bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:33:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:33:32Z,use_quota=True,user_id='46036bda7c8d456694bb69519a548d57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:33:32 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-b15590f1-224d-4e2a-9f0d-833834e074f8 tempest-VolumesTestJSON-591326206 None] Creating volume 681e0a4d-9b04-42e5-a48d-182c09358511 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:33:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b15590f1-224d-4e2a-9f0d-833834e074f8 tempest-VolumesTestJSON-591326206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:33:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b15590f1-224d-4e2a-9f0d-833834e074f8 tempest-VolumesTestJSON-591326206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:33:32 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b15590f1-224d-4e2a-9f0d-833834e074f8 tempest-VolumesTestJSON-591326206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:33:32 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b15590f1-224d-4e2a-9f0d-833834e074f8 tempest-VolumesTestJSON-591326206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:33:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b15590f1-224d-4e2a-9f0d-833834e074f8 tempest-VolumesTestJSON-591326206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:33:32 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b15590f1-224d-4e2a-9f0d-833834e074f8 tempest-VolumesTestJSON-591326206 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:33:32 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-b15590f1-224d-4e2a-9f0d-833834e074f8 tempest-VolumesTestJSON-591326206 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:33:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b15590f1-224d-4e2a-9f0d-833834e074f8 tempest-VolumesTestJSON-591326206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-681e0a4d-9b04-42e5-a48d-182c09358511 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:32 devstack sudo[101548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-681e0a4d-9b04-42e5-a48d-182c09358511 1073741824 Jun 23 16:33:32 devstack sudo[101548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:32 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df8d80b2-f02e-47d9-a83b-db62ceddf053 tempest-AttachVolumeTestJSON-1111501152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be2c7e78-5d76-47ac-b501-64c140a7532d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15b3b4e5-2b5e-4084-b713-0851e5ed4541', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:33:32 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df8d80b2-f02e-47d9-a83b-db62ceddf053 tempest-AttachVolumeTestJSON-1111501152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (961cc7c5-215c-44c7-adc2-56a95d1ab3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:33:32 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-df8d80b2-f02e-47d9-a83b-db62ceddf053 tempest-AttachVolumeTestJSON-1111501152 None] Volume volume-15b3b4e5-2b5e-4084-b713-0851e5ed4541 (15b3b4e5-2b5e-4084-b713-0851e5ed4541): created successfully Jun 23 16:33:32 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df8d80b2-f02e-47d9-a83b-db62ceddf053 tempest-AttachVolumeTestJSON-1111501152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (961cc7c5-215c-44c7-adc2-56a95d1ab3a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:33:32 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df8d80b2-f02e-47d9-a83b-db62ceddf053 tempest-AttachVolumeTestJSON-1111501152 None] Flow 'volume_create_manager' (ae24ae76-42fd-45ad-8a85-5929ef9b66c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:33:32 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-df8d80b2-f02e-47d9-a83b-db62ceddf053 tempest-AttachVolumeTestJSON-1111501152 None] Created volume successfully. Jun 23 16:33:33 devstack sudo[101548]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:33 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b15590f1-224d-4e2a-9f0d-833834e074f8 tempest-VolumesTestJSON-591326206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-681e0a4d-9b04-42e5-a48d-182c09358511 1073741824" returned: 0 in 0.941s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:33 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b15590f1-224d-4e2a-9f0d-833834e074f8 tempest-VolumesTestJSON-591326206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-681e0a4d-9b04-42e5-a48d-182c09358511 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:33 devstack sudo[101559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-681e0a4d-9b04-42e5-a48d-182c09358511 Jun 23 16:33:33 devstack sudo[101559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:34 devstack sudo[101559]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b15590f1-224d-4e2a-9f0d-833834e074f8 tempest-VolumesTestJSON-591326206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-681e0a4d-9b04-42e5-a48d-182c09358511" returned: 0 in 0.784s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:34 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b15590f1-224d-4e2a-9f0d-833834e074f8 tempest-VolumesTestJSON-591326206 None] <== create_volume: return (1776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:33:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b15590f1-224d-4e2a-9f0d-833834e074f8 tempest-VolumesTestJSON-591326206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.778s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:33:34 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b15590f1-224d-4e2a-9f0d-833834e074f8 tempest-VolumesTestJSON-591326206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83f543f6-d418-4403-bc6c-1e8955fcfc6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-681e0a4d-9b04-42e5-a48d-182c09358511', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:33:34 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b15590f1-224d-4e2a-9f0d-833834e074f8 tempest-VolumesTestJSON-591326206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (467cae94-2110-4a1c-8ae5-4e9aaac08afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:33:34 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-b15590f1-224d-4e2a-9f0d-833834e074f8 tempest-VolumesTestJSON-591326206 None] Volume volume-681e0a4d-9b04-42e5-a48d-182c09358511 (681e0a4d-9b04-42e5-a48d-182c09358511): created successfully Jun 23 16:33:34 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b15590f1-224d-4e2a-9f0d-833834e074f8 tempest-VolumesTestJSON-591326206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (467cae94-2110-4a1c-8ae5-4e9aaac08afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:33:34 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b15590f1-224d-4e2a-9f0d-833834e074f8 tempest-VolumesTestJSON-591326206 None] Flow 'volume_create_manager' (23573e11-57b6-463e-980f-41893eb5d7ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:33:34 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-b15590f1-224d-4e2a-9f0d-833834e074f8 tempest-VolumesTestJSON-591326206 None] Created volume successfully. Jun 23 16:33:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-453dec3c-99dc-4a17-b633-f955d9623053 req-075d70f4-7b1a-4fc8-b3be-5f8ff3e12898 tempest-ServerActionsTestOtherA-1626454459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:33:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-453dec3c-99dc-4a17-b633-f955d9623053 req-075d70f4-7b1a-4fc8-b3be-5f8ff3e12898 tempest-ServerActionsTestOtherA-1626454459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:33:34 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5144fb1f-5ba8-4a15-a67c-4d9833d3f23c]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:33:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-453dec3c-99dc-4a17-b633-f955d9623053 req-075d70f4-7b1a-4fc8-b3be-5f8ff3e12898 tempest-ServerActionsTestOtherA-1626454459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-80319ecc-7a03-42da-8ae8-4d7d493a5066 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:34 devstack sudo[101570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-80319ecc-7a03-42da-8ae8-4d7d493a5066 Jun 23 16:33:34 devstack sudo[101570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:35 devstack sudo[101570]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-453dec3c-99dc-4a17-b633-f955d9623053 req-075d70f4-7b1a-4fc8-b3be-5f8ff3e12898 tempest-ServerActionsTestOtherA-1626454459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-80319ecc-7a03-42da-8ae8-4d7d493a5066" returned: 0 in 0.907s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-453dec3c-99dc-4a17-b633-f955d9623053 req-075d70f4-7b1a-4fc8-b3be-5f8ff3e12898 tempest-ServerActionsTestOtherA-1626454459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.925s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:33:35 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-453dec3c-99dc-4a17-b633-f955d9623053 req-075d70f4-7b1a-4fc8-b3be-5f8ff3e12898 tempest-ServerActionsTestOtherA-1626454459 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e', 'name': 'volume-80319ecc-7a03-42da-8ae8-4d7d493a5066', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cd4d9cd9-8ca1-409c-89d2-e238b748e71a', 'enforce_multipath': True} {{(pid=93788) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 16:33:35 devstack cinder-volume[93788]: INFO cinder.volume.manager [req-453dec3c-99dc-4a17-b633-f955d9623053 req-075d70f4-7b1a-4fc8-b3be-5f8ff3e12898 tempest-ServerActionsTestOtherA-1626454459 None] attachment_update completed successfully. Jun 23 16:33:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-31340610-2150-4128-962d-7bd074f4a411 req-5a79ec68-b051-4557-8079-4a97ff8450cb tempest-AttachVolumeTestJSON-1111501152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:33:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-31340610-2150-4128-962d-7bd074f4a411 req-5a79ec68-b051-4557-8079-4a97ff8450cb tempest-AttachVolumeTestJSON-1111501152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:33:36 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b23be24-abe4-4202-9c98-8435134988c4]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:33:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-31340610-2150-4128-962d-7bd074f4a411 req-5a79ec68-b051-4557-8079-4a97ff8450cb tempest-AttachVolumeTestJSON-1111501152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-15b3b4e5-2b5e-4084-b713-0851e5ed4541 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:36 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-2206d3bd-fb3e-49bc-92cb-eac0fb9158ed tempest-VolumesTestJSON-591326206 None] Acquiring lock "cinder-681e0a4d-9b04-42e5-a48d-182c09358511-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:33:36 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-2206d3bd-fb3e-49bc-92cb-eac0fb9158ed tempest-VolumesTestJSON-591326206 None] Lock "cinder-681e0a4d-9b04-42e5-a48d-182c09358511-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:33:36 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-2206d3bd-fb3e-49bc-92cb-eac0fb9158ed tempest-VolumesTestJSON-591326206 None] Acquiring lock "cinder-quobyte-681e0a4d-9b04-42e5-a48d-182c09358511" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:33:36 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-2206d3bd-fb3e-49bc-92cb-eac0fb9158ed tempest-VolumesTestJSON-591326206 None] Lock "cinder-quobyte-681e0a4d-9b04-42e5-a48d-182c09358511" acquired by "delete_volume" :: waited 0.024s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:33:36 devstack sudo[101584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-15b3b4e5-2b5e-4084-b713-0851e5ed4541 Jun 23 16:33:36 devstack sudo[101584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:36 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[026dfe84-433d-4548-933a-33e8d811098f]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:33:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2206d3bd-fb3e-49bc-92cb-eac0fb9158ed tempest-VolumesTestJSON-591326206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-681e0a4d-9b04-42e5-a48d-182c09358511 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:37 devstack sudo[101586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-681e0a4d-9b04-42e5-a48d-182c09358511 Jun 23 16:33:37 devstack sudo[101586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:37 devstack sudo[101584]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:37 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e1063c1-a9fb-43c0-a4ed-218e6384dc0a tempest-VolumesDeleteCascade-1735160611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:33:37 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2e1063c1-a9fb-43c0-a4ed-218e6384dc0a tempest-VolumesDeleteCascade-1735160611 None] Flow 'volume_create_manager' (70eac58c-a4c6-4b9e-90de-0ea6d026976b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:33:37 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2e1063c1-a9fb-43c0-a4ed-218e6384dc0a tempest-VolumesDeleteCascade-1735160611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44fa5cb6-9254-41ad-b86f-ad304ff121d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:33:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-31340610-2150-4128-962d-7bd074f4a411 req-5a79ec68-b051-4557-8079-4a97ff8450cb tempest-AttachVolumeTestJSON-1111501152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-15b3b4e5-2b5e-4084-b713-0851e5ed4541" returned: 0 in 1.031s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-31340610-2150-4128-962d-7bd074f4a411 req-5a79ec68-b051-4557-8079-4a97ff8450cb tempest-AttachVolumeTestJSON-1111501152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.061s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:33:37 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2e1063c1-a9fb-43c0-a4ed-218e6384dc0a tempest-VolumesDeleteCascade-1735160611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44fa5cb6-9254-41ad-b86f-ad304ff121d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1538620995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f256f6f0-1442-4563-8ba4-98bd744d2ca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c289ab92c01848c7814fa32075db1285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:33:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:33:38Z,use_quota=True,user_id='30f2b7f272064a5d952fc413547f80e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:33:37 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2e1063c1-a9fb-43c0-a4ed-218e6384dc0a tempest-VolumesDeleteCascade-1735160611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc7cd818-8a00-42fd-ab24-bdf59b8a0cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:33:37 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2e1063c1-a9fb-43c0-a4ed-218e6384dc0a tempest-VolumesDeleteCascade-1735160611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc7cd818-8a00-42fd-ab24-bdf59b8a0cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:33:37 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2e1063c1-a9fb-43c0-a4ed-218e6384dc0a tempest-VolumesDeleteCascade-1735160611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c7cbcee-dae1-4550-bc6e-94738915a703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:33:37 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2e1063c1-a9fb-43c0-a4ed-218e6384dc0a tempest-VolumesDeleteCascade-1735160611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c7cbcee-dae1-4550-bc6e-94738915a703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f256f6f0-1442-4563-8ba4-98bd744d2ca3', 'volume_name': 'volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:33:37 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2e1063c1-a9fb-43c0-a4ed-218e6384dc0a tempest-VolumesDeleteCascade-1735160611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (882812fa-dd8a-4730-aa3a-841378537343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:33:37 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2e1063c1-a9fb-43c0-a4ed-218e6384dc0a tempest-VolumesDeleteCascade-1735160611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (882812fa-dd8a-4730-aa3a-841378537343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:33:37 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2e1063c1-a9fb-43c0-a4ed-218e6384dc0a tempest-VolumesDeleteCascade-1735160611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (731852fa-8ae4-48f7-bc5d-9e226bdfcc46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:33:37 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-2e1063c1-a9fb-43c0-a4ed-218e6384dc0a tempest-VolumesDeleteCascade-1735160611 None] Volume f256f6f0-1442-4563-8ba4-98bd744d2ca3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3', 'volume_size': 1} Jun 23 16:33:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-2e1063c1-a9fb-43c0-a4ed-218e6384dc0a tempest-VolumesDeleteCascade-1735160611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:33:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-2e1063c1-a9fb-43c0-a4ed-218e6384dc0a tempest-VolumesDeleteCascade-1735160611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:33:37 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-2e1063c1-a9fb-43c0-a4ed-218e6384dc0a tempest-VolumesDeleteCascade-1735160611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1538620995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f256f6f0-1442-4563-8ba4-98bd744d2ca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c289ab92c01848c7814fa32075db1285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:33:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:33:38Z,use_quota=True,user_id='30f2b7f272064a5d952fc413547f80e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:33:37 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-2e1063c1-a9fb-43c0-a4ed-218e6384dc0a tempest-VolumesDeleteCascade-1735160611 None] Creating volume f256f6f0-1442-4563-8ba4-98bd744d2ca3 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:33:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-2e1063c1-a9fb-43c0-a4ed-218e6384dc0a tempest-VolumesDeleteCascade-1735160611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:33:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-2e1063c1-a9fb-43c0-a4ed-218e6384dc0a tempest-VolumesDeleteCascade-1735160611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:33:37 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-2e1063c1-a9fb-43c0-a4ed-218e6384dc0a tempest-VolumesDeleteCascade-1735160611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:33:37 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-2e1063c1-a9fb-43c0-a4ed-218e6384dc0a tempest-VolumesDeleteCascade-1735160611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:33:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-2e1063c1-a9fb-43c0-a4ed-218e6384dc0a tempest-VolumesDeleteCascade-1735160611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:33:37 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-2e1063c1-a9fb-43c0-a4ed-218e6384dc0a tempest-VolumesDeleteCascade-1735160611 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:33:37 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-2e1063c1-a9fb-43c0-a4ed-218e6384dc0a tempest-VolumesDeleteCascade-1735160611 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:33:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2e1063c1-a9fb-43c0-a4ed-218e6384dc0a tempest-VolumesDeleteCascade-1735160611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:37 devstack sudo[101596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3 1073741824 Jun 23 16:33:37 devstack sudo[101596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:37 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-31340610-2150-4128-962d-7bd074f4a411 req-5a79ec68-b051-4557-8079-4a97ff8450cb tempest-AttachVolumeTestJSON-1111501152 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e', 'name': 'volume-15b3b4e5-2b5e-4084-b713-0851e5ed4541', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6e768e1f-1137-4fd7-9d58-822d12c3b12f', 'enforce_multipath': True} {{(pid=93788) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 16:33:37 devstack sudo[101586]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2206d3bd-fb3e-49bc-92cb-eac0fb9158ed tempest-VolumesTestJSON-591326206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-681e0a4d-9b04-42e5-a48d-182c09358511" returned: 0 in 1.055s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2206d3bd-fb3e-49bc-92cb-eac0fb9158ed tempest-VolumesTestJSON-591326206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-681e0a4d-9b04-42e5-a48d-182c09358511 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:37 devstack sudo[101601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-681e0a4d-9b04-42e5-a48d-182c09358511 Jun 23 16:33:37 devstack sudo[101601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:38 devstack cinder-volume[93788]: INFO cinder.volume.manager [req-31340610-2150-4128-962d-7bd074f4a411 req-5a79ec68-b051-4557-8079-4a97ff8450cb tempest-AttachVolumeTestJSON-1111501152 None] attachment_update completed successfully. Jun 23 16:33:38 devstack sudo[101601]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2206d3bd-fb3e-49bc-92cb-eac0fb9158ed tempest-VolumesTestJSON-591326206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-681e0a4d-9b04-42e5-a48d-182c09358511" returned: 0 in 0.808s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:38 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-2206d3bd-fb3e-49bc-92cb-eac0fb9158ed tempest-VolumesTestJSON-591326206 None] Lock "cinder-quobyte-681e0a4d-9b04-42e5-a48d-182c09358511" released by "delete_volume" :: held 1.917s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:33:38 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-2206d3bd-fb3e-49bc-92cb-eac0fb9158ed tempest-VolumesTestJSON-591326206 None] Created reservations ['4f1bf3ed-a926-4c55-92d6-e52821ac99fc', '49ef05a5-be46-432b-a9ed-789100683db3', 'c42100f4-5c5f-4c19-ad78-61d7c5422332', '2857fac5-e2d1-48ae-917f-21a3564c1040'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:33:38 devstack sudo[101596]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2e1063c1-a9fb-43c0-a4ed-218e6384dc0a tempest-VolumesDeleteCascade-1735160611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3 1073741824" returned: 0 in 1.069s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-2206d3bd-fb3e-49bc-92cb-eac0fb9158ed tempest-VolumesTestJSON-591326206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:33:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-2206d3bd-fb3e-49bc-92cb-eac0fb9158ed tempest-VolumesTestJSON-591326206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:33:38 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-2206d3bd-fb3e-49bc-92cb-eac0fb9158ed tempest-VolumesTestJSON-591326206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:33:38 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-2206d3bd-fb3e-49bc-92cb-eac0fb9158ed tempest-VolumesTestJSON-591326206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:33:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-2206d3bd-fb3e-49bc-92cb-eac0fb9158ed tempest-VolumesTestJSON-591326206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:33:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2206d3bd-fb3e-49bc-92cb-eac0fb9158ed tempest-VolumesTestJSON-591326206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:38 devstack sudo[101687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:33:38 devstack sudo[101687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2e1063c1-a9fb-43c0-a4ed-218e6384dc0a tempest-VolumesDeleteCascade-1735160611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:38 devstack sudo[101689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3 Jun 23 16:33:38 devstack sudo[101689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:39 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-0c4782d1-6c0f-46ed-ab91-5cac2fa561f0 tempest-VolumesTestJSON-591326206 None] Acquiring lock "cinder-a0321657-8b73-4997-aa26-fe24e14fd976-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:33:39 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-0c4782d1-6c0f-46ed-ab91-5cac2fa561f0 tempest-VolumesTestJSON-591326206 None] Lock "cinder-a0321657-8b73-4997-aa26-fe24e14fd976-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:33:39 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-0c4782d1-6c0f-46ed-ab91-5cac2fa561f0 tempest-VolumesTestJSON-591326206 None] Acquiring lock "cinder-quobyte-a0321657-8b73-4997-aa26-fe24e14fd976" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:33:39 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-0c4782d1-6c0f-46ed-ab91-5cac2fa561f0 tempest-VolumesTestJSON-591326206 None] Lock "cinder-quobyte-a0321657-8b73-4997-aa26-fe24e14fd976" acquired by "delete_volume" :: waited 0.019s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:33:39 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19f44fa-aae2-4324-af11-061a484d2719]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:33:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0c4782d1-6c0f-46ed-ab91-5cac2fa561f0 tempest-VolumesTestJSON-591326206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-a0321657-8b73-4997-aa26-fe24e14fd976 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:39 devstack sudo[102008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-a0321657-8b73-4997-aa26-fe24e14fd976 Jun 23 16:33:39 devstack sudo[102008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:39 devstack sudo[101687]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2206d3bd-fb3e-49bc-92cb-eac0fb9158ed tempest-VolumesTestJSON-591326206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.819s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:39 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-2206d3bd-fb3e-49bc-92cb-eac0fb9158ed tempest-VolumesTestJSON-591326206 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:33:39 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-2206d3bd-fb3e-49bc-92cb-eac0fb9158ed tempest-VolumesTestJSON-591326206 None] Deleted volume successfully. Jun 23 16:33:39 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-2206d3bd-fb3e-49bc-92cb-eac0fb9158ed tempest-VolumesTestJSON-591326206 None] Lock "cinder-681e0a4d-9b04-42e5-a48d-182c09358511-delete_volume" released by "delete_volume" :: held 3.006s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:33:39 devstack sudo[101689]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2e1063c1-a9fb-43c0-a4ed-218e6384dc0a tempest-VolumesDeleteCascade-1735160611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3" returned: 0 in 0.924s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:39 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-2e1063c1-a9fb-43c0-a4ed-218e6384dc0a tempest-VolumesDeleteCascade-1735160611 None] <== create_volume: return (2062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:33:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-2e1063c1-a9fb-43c0-a4ed-218e6384dc0a tempest-VolumesDeleteCascade-1735160611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.065s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:33:39 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2e1063c1-a9fb-43c0-a4ed-218e6384dc0a tempest-VolumesDeleteCascade-1735160611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (731852fa-8ae4-48f7-bc5d-9e226bdfcc46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:33:39 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2e1063c1-a9fb-43c0-a4ed-218e6384dc0a tempest-VolumesDeleteCascade-1735160611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60de1a85-8722-473b-86ed-ec72ecd1c746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:33:39 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-2e1063c1-a9fb-43c0-a4ed-218e6384dc0a tempest-VolumesDeleteCascade-1735160611 None] Volume volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3 (f256f6f0-1442-4563-8ba4-98bd744d2ca3): created successfully Jun 23 16:33:39 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2e1063c1-a9fb-43c0-a4ed-218e6384dc0a tempest-VolumesDeleteCascade-1735160611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60de1a85-8722-473b-86ed-ec72ecd1c746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:33:39 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2e1063c1-a9fb-43c0-a4ed-218e6384dc0a tempest-VolumesDeleteCascade-1735160611 None] Flow 'volume_create_manager' (70eac58c-a4c6-4b9e-90de-0ea6d026976b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:33:39 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-2e1063c1-a9fb-43c0-a4ed-218e6384dc0a tempest-VolumesDeleteCascade-1735160611 None] Created volume successfully. Jun 23 16:33:40 devstack sudo[102008]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0c4782d1-6c0f-46ed-ab91-5cac2fa561f0 tempest-VolumesTestJSON-591326206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-a0321657-8b73-4997-aa26-fe24e14fd976" returned: 0 in 0.953s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0c4782d1-6c0f-46ed-ab91-5cac2fa561f0 tempest-VolumesTestJSON-591326206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-a0321657-8b73-4997-aa26-fe24e14fd976 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:40 devstack sudo[102020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-a0321657-8b73-4997-aa26-fe24e14fd976 Jun 23 16:33:40 devstack sudo[102020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:40 devstack sudo[102020]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0c4782d1-6c0f-46ed-ab91-5cac2fa561f0 tempest-VolumesTestJSON-591326206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-a0321657-8b73-4997-aa26-fe24e14fd976" returned: 0 in 0.664s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:40 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-0c4782d1-6c0f-46ed-ab91-5cac2fa561f0 tempest-VolumesTestJSON-591326206 None] Lock "cinder-quobyte-a0321657-8b73-4997-aa26-fe24e14fd976" released by "delete_volume" :: held 1.667s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:33:40 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:SELECT=83,cinder:INSERT=21,cinder:UPDATE=95,cinder:DELETE=10 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:33:40 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:UPDATE=89,cinder:SELECT=76,cinder:INSERT=20,cinder:DELETE=6 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:33:40 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-0c4782d1-6c0f-46ed-ab91-5cac2fa561f0 tempest-VolumesTestJSON-591326206 None] Created reservations ['d7f731e6-7df5-45df-a753-d4a10c436d35', 'bf2f4b5b-8723-40ad-9ae3-5006bd586571', '889128b6-d1ec-4891-abb2-165ee6909ac3', '54a69d73-2e8e-412d-90a6-3f16707206f3'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:33:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-0c4782d1-6c0f-46ed-ab91-5cac2fa561f0 tempest-VolumesTestJSON-591326206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:33:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-0c4782d1-6c0f-46ed-ab91-5cac2fa561f0 tempest-VolumesTestJSON-591326206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:33:40 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-0c4782d1-6c0f-46ed-ab91-5cac2fa561f0 tempest-VolumesTestJSON-591326206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:33:41 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-0c4782d1-6c0f-46ed-ab91-5cac2fa561f0 tempest-VolumesTestJSON-591326206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:33:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-0c4782d1-6c0f-46ed-ab91-5cac2fa561f0 tempest-VolumesTestJSON-591326206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:33:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0c4782d1-6c0f-46ed-ab91-5cac2fa561f0 tempest-VolumesTestJSON-591326206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:41 devstack sudo[102023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:33:41 devstack sudo[102023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d30cf1ce-079f-4eb4-aa2e-ea0fcba162c8 tempest-VolumesDeleteCascade-1735160611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:33:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d30cf1ce-079f-4eb4-aa2e-ea0fcba162c8 tempest-VolumesDeleteCascade-1735160611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:33:41 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-d30cf1ce-079f-4eb4-aa2e-ea0fcba162c8 tempest-VolumesDeleteCascade-1735160611 None] Creating offline snapshot ef685aab-01b6-4ec9-83e5-c74fb5988130 of volume f256f6f0-1442-4563-8ba4-98bd744d2ca3 {{(pid=93788) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:33:41 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82408e9-94ca-4467-a703-b133baddd8d4]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:33:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d30cf1ce-079f-4eb4-aa2e-ea0fcba162c8 tempest-VolumesDeleteCascade-1735160611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:41 devstack sudo[102025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3 Jun 23 16:33:41 devstack sudo[102025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:41 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-cd83eb88-afff-4226-be1e-5b78832c1fd8 tempest-VolumesTestJSON-591326206 None] Acquiring lock "cinder-0ae5b83f-4ffc-4d19-b8d1-867dc81ef163-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:33:41 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-cd83eb88-afff-4226-be1e-5b78832c1fd8 tempest-VolumesTestJSON-591326206 None] Lock "cinder-0ae5b83f-4ffc-4d19-b8d1-867dc81ef163-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:33:41 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-cd83eb88-afff-4226-be1e-5b78832c1fd8 tempest-VolumesTestJSON-591326206 None] Acquiring lock "cinder-quobyte-0ae5b83f-4ffc-4d19-b8d1-867dc81ef163" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:33:41 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-cd83eb88-afff-4226-be1e-5b78832c1fd8 tempest-VolumesTestJSON-591326206 None] Lock "cinder-quobyte-0ae5b83f-4ffc-4d19-b8d1-867dc81ef163" acquired by "delete_volume" :: waited 0.024s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:33:41 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed73d7e-dec8-4d20-becf-064cdefb37c0]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:33:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-cd83eb88-afff-4226-be1e-5b78832c1fd8 tempest-VolumesTestJSON-591326206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ae5b83f-4ffc-4d19-b8d1-867dc81ef163 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:41 devstack sudo[102033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ae5b83f-4ffc-4d19-b8d1-867dc81ef163 Jun 23 16:33:41 devstack sudo[102033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:41 devstack sudo[102023]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0c4782d1-6c0f-46ed-ab91-5cac2fa561f0 tempest-VolumesTestJSON-591326206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.851s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:41 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-0c4782d1-6c0f-46ed-ab91-5cac2fa561f0 tempest-VolumesTestJSON-591326206 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:33:41 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-0c4782d1-6c0f-46ed-ab91-5cac2fa561f0 tempest-VolumesTestJSON-591326206 None] Deleted volume successfully. Jun 23 16:33:41 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-0c4782d1-6c0f-46ed-ab91-5cac2fa561f0 tempest-VolumesTestJSON-591326206 None] Lock "cinder-a0321657-8b73-4997-aa26-fe24e14fd976-delete_volume" released by "delete_volume" :: held 2.801s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:33:42 devstack sudo[102025]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:42 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d30cf1ce-079f-4eb4-aa2e-ea0fcba162c8 tempest-VolumesDeleteCascade-1735160611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3" returned: 0 in 0.877s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:42 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d30cf1ce-079f-4eb4-aa2e-ea0fcba162c8 tempest-VolumesDeleteCascade-1735160611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.ef685aab-01b6-4ec9-83e5-c74fb5988130 1G {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:42 devstack sudo[102050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.ef685aab-01b6-4ec9-83e5-c74fb5988130 1G Jun 23 16:33:42 devstack sudo[102050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:42 devstack sudo[102033]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:42 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-cd83eb88-afff-4226-be1e-5b78832c1fd8 tempest-VolumesTestJSON-591326206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ae5b83f-4ffc-4d19-b8d1-867dc81ef163" returned: 0 in 1.211s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:42 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-cd83eb88-afff-4226-be1e-5b78832c1fd8 tempest-VolumesTestJSON-591326206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ae5b83f-4ffc-4d19-b8d1-867dc81ef163 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:42 devstack sudo[102088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ae5b83f-4ffc-4d19-b8d1-867dc81ef163 Jun 23 16:33:42 devstack sudo[102088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:43 devstack sudo[102050]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d30cf1ce-079f-4eb4-aa2e-ea0fcba162c8 tempest-VolumesDeleteCascade-1735160611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.ef685aab-01b6-4ec9-83e5-c74fb5988130 1G" returned: 0 in 1.423s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d30cf1ce-079f-4eb4-aa2e-ea0fcba162c8 tempest-VolumesDeleteCascade-1735160611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.ef685aab-01b6-4ec9-83e5-c74fb5988130 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:43 devstack sudo[102101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.ef685aab-01b6-4ec9-83e5-c74fb5988130 Jun 23 16:33:43 devstack sudo[102101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:43 devstack sudo[102088]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-cd83eb88-afff-4226-be1e-5b78832c1fd8 tempest-VolumesTestJSON-591326206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ae5b83f-4ffc-4d19-b8d1-867dc81ef163" returned: 0 in 0.957s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:43 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-cd83eb88-afff-4226-be1e-5b78832c1fd8 tempest-VolumesTestJSON-591326206 None] Lock "cinder-quobyte-0ae5b83f-4ffc-4d19-b8d1-867dc81ef163" released by "delete_volume" :: held 2.236s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:33:43 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-cd83eb88-afff-4226-be1e-5b78832c1fd8 tempest-VolumesTestJSON-591326206 None] Created reservations ['4677f8ee-e4d9-4da1-ab82-ed986bea9b87', '0560a7cf-7c9a-4691-aa8f-381a3c950bd2', '84854c05-18ee-4ab8-8d46-64f15c18a9c6', '9df01d63-fbe7-467f-bc93-4d01a01e1a70'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:33:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-cd83eb88-afff-4226-be1e-5b78832c1fd8 tempest-VolumesTestJSON-591326206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:33:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-cd83eb88-afff-4226-be1e-5b78832c1fd8 tempest-VolumesTestJSON-591326206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:33:43 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-cd83eb88-afff-4226-be1e-5b78832c1fd8 tempest-VolumesTestJSON-591326206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:33:43 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-cd83eb88-afff-4226-be1e-5b78832c1fd8 tempest-VolumesTestJSON-591326206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:33:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-cd83eb88-afff-4226-be1e-5b78832c1fd8 tempest-VolumesTestJSON-591326206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:33:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-cd83eb88-afff-4226-be1e-5b78832c1fd8 tempest-VolumesTestJSON-591326206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:44 devstack sudo[102105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:33:44 devstack sudo[102105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:44 devstack sudo[102101]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d30cf1ce-079f-4eb4-aa2e-ea0fcba162c8 tempest-VolumesDeleteCascade-1735160611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.ef685aab-01b6-4ec9-83e5-c74fb5988130" returned: 0 in 0.939s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:44 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-d30cf1ce-079f-4eb4-aa2e-ea0fcba162c8 tempest-VolumesDeleteCascade-1735160611 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.ef685aab-01b6-4ec9-83e5-c74fb5988130 is being set with open permissions: ugo+rw Jun 23 16:33:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d30cf1ce-079f-4eb4-aa2e-ea0fcba162c8 tempest-VolumesDeleteCascade-1735160611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.ef685aab-01b6-4ec9-83e5-c74fb5988130 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:44 devstack sudo[102111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.ef685aab-01b6-4ec9-83e5-c74fb5988130 Jun 23 16:33:44 devstack sudo[102111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:44 devstack sudo[102105]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-cd83eb88-afff-4226-be1e-5b78832c1fd8 tempest-VolumesTestJSON-591326206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.793s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:44 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-cd83eb88-afff-4226-be1e-5b78832c1fd8 tempest-VolumesTestJSON-591326206 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:33:44 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-cd83eb88-afff-4226-be1e-5b78832c1fd8 tempest-VolumesTestJSON-591326206 None] Deleted volume successfully. Jun 23 16:33:44 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-cd83eb88-afff-4226-be1e-5b78832c1fd8 tempest-VolumesTestJSON-591326206 None] Lock "cinder-0ae5b83f-4ffc-4d19-b8d1-867dc81ef163-delete_volume" released by "delete_volume" :: held 3.341s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:33:45 devstack sudo[102111]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d30cf1ce-079f-4eb4-aa2e-ea0fcba162c8 tempest-VolumesDeleteCascade-1735160611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.ef685aab-01b6-4ec9-83e5-c74fb5988130" returned: 0 in 1.523s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d30cf1ce-079f-4eb4-aa2e-ea0fcba162c8 tempest-VolumesDeleteCascade-1735160611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:46 devstack sudo[102161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.info Jun 23 16:33:46 devstack sudo[102161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:47 devstack sudo[102161]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d30cf1ce-079f-4eb4-aa2e-ea0fcba162c8 tempest-VolumesDeleteCascade-1735160611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.info" returned: 0 in 1.313s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:47 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-d30cf1ce-079f-4eb4-aa2e-ea0fcba162c8 tempest-VolumesDeleteCascade-1735160611 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.info is being set with open permissions: ugo+rw Jun 23 16:33:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d30cf1ce-079f-4eb4-aa2e-ea0fcba162c8 tempest-VolumesDeleteCascade-1735160611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:47 devstack sudo[102167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.info Jun 23 16:33:47 devstack sudo[102167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:48 devstack sudo[102167]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d30cf1ce-079f-4eb4-aa2e-ea0fcba162c8 tempest-VolumesDeleteCascade-1735160611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.info" returned: 0 in 0.764s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d30cf1ce-079f-4eb4-aa2e-ea0fcba162c8 tempest-VolumesDeleteCascade-1735160611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.973s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:33:48 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-d30cf1ce-079f-4eb4-aa2e-ea0fcba162c8 tempest-VolumesDeleteCascade-1735160611 None] Create snapshot completed successfully Jun 23 16:33:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-c13b5ae4-7955-4bbe-b5cc-a4bcc9b9d66b tempest-VolumesDeleteCascade-1735160611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:33:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-c13b5ae4-7955-4bbe-b5cc-a4bcc9b9d66b tempest-VolumesDeleteCascade-1735160611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:33:49 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-c13b5ae4-7955-4bbe-b5cc-a4bcc9b9d66b tempest-VolumesDeleteCascade-1735160611 None] Creating offline snapshot 3a6f9804-a0bc-4b56-b534-642f10a7467b of volume f256f6f0-1442-4563-8ba4-98bd744d2ca3 {{(pid=93788) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:33:49 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b49ca7b-299c-46ba-b138-35a9c4305560]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:33:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c13b5ae4-7955-4bbe-b5cc-a4bcc9b9d66b tempest-VolumesDeleteCascade-1735160611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.ef685aab-01b6-4ec9-83e5-c74fb5988130 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:49 devstack sudo[102172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.ef685aab-01b6-4ec9-83e5-c74fb5988130 Jun 23 16:33:49 devstack sudo[102172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:50 devstack sudo[102172]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c13b5ae4-7955-4bbe-b5cc-a4bcc9b9d66b tempest-VolumesDeleteCascade-1735160611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.ef685aab-01b6-4ec9-83e5-c74fb5988130" returned: 0 in 1.047s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:50 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-c13b5ae4-7955-4bbe-b5cc-a4bcc9b9d66b tempest-VolumesDeleteCascade-1735160611 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:33:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c13b5ae4-7955-4bbe-b5cc-a4bcc9b9d66b tempest-VolumesDeleteCascade-1735160611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.ef685aab-01b6-4ec9-83e5-c74fb5988130,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.3a6f9804-a0bc-4b56-b534-642f10a7467b 1G {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:50 devstack sudo[102178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.ef685aab-01b6-4ec9-83e5-c74fb5988130,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.3a6f9804-a0bc-4b56-b534-642f10a7467b 1G Jun 23 16:33:50 devstack sudo[102178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:51 devstack sudo[102178]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c13b5ae4-7955-4bbe-b5cc-a4bcc9b9d66b tempest-VolumesDeleteCascade-1735160611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.ef685aab-01b6-4ec9-83e5-c74fb5988130,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.3a6f9804-a0bc-4b56-b534-642f10a7467b 1G" returned: 0 in 1.495s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c13b5ae4-7955-4bbe-b5cc-a4bcc9b9d66b tempest-VolumesDeleteCascade-1735160611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.ef685aab-01b6-4ec9-83e5-c74fb5988130 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.3a6f9804-a0bc-4b56-b534-642f10a7467b {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:51 devstack sudo[102184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.ef685aab-01b6-4ec9-83e5-c74fb5988130 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.3a6f9804-a0bc-4b56-b534-642f10a7467b Jun 23 16:33:51 devstack sudo[102184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:52 devstack sudo[102184]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c13b5ae4-7955-4bbe-b5cc-a4bcc9b9d66b tempest-VolumesDeleteCascade-1735160611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.ef685aab-01b6-4ec9-83e5-c74fb5988130 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.3a6f9804-a0bc-4b56-b534-642f10a7467b" returned: 0 in 1.100s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:52 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-c13b5ae4-7955-4bbe-b5cc-a4bcc9b9d66b tempest-VolumesDeleteCascade-1735160611 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.3a6f9804-a0bc-4b56-b534-642f10a7467b is being set with open permissions: ugo+rw Jun 23 16:33:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c13b5ae4-7955-4bbe-b5cc-a4bcc9b9d66b tempest-VolumesDeleteCascade-1735160611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.3a6f9804-a0bc-4b56-b534-642f10a7467b {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:52 devstack sudo[102190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.3a6f9804-a0bc-4b56-b534-642f10a7467b Jun 23 16:33:52 devstack sudo[102190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:53 devstack sudo[102190]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:53 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c13b5ae4-7955-4bbe-b5cc-a4bcc9b9d66b tempest-VolumesDeleteCascade-1735160611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.3a6f9804-a0bc-4b56-b534-642f10a7467b" returned: 0 in 0.794s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:53 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-c13b5ae4-7955-4bbe-b5cc-a4bcc9b9d66b tempest-VolumesDeleteCascade-1735160611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.603s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:33:53 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-c13b5ae4-7955-4bbe-b5cc-a4bcc9b9d66b tempest-VolumesDeleteCascade-1735160611 None] Create snapshot completed successfully Jun 23 16:33:54 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Acquiring lock "cinder-f256f6f0-1442-4563-8ba4-98bd744d2ca3-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:33:54 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Lock "cinder-f256f6f0-1442-4563-8ba4-98bd744d2ca3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:33:54 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Performing cascade delete. {{(pid=93788) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 23 16:33:54 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Acquiring lock "cinder-3a6f9804-a0bc-4b56-b534-642f10a7467b-delete_snapshot" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:33:54 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Lock "cinder-3a6f9804-a0bc-4b56-b534-642f10a7467b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:33:54 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Acquiring lock "cinder-quobyte-f256f6f0-1442-4563-8ba4-98bd744d2ca3" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:33:54 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Lock "cinder-quobyte-f256f6f0-1442-4563-8ba4-98bd744d2ca3" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:33:54 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Acquiring lock "cinder-quobyte-3a6f9804-a0bc-4b56-b534-642f10a7467b" by "_delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:33:54 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Lock "cinder-quobyte-3a6f9804-a0bc-4b56-b534-642f10a7467b" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:33:54 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Deleting offline snapshot 3a6f9804-a0bc-4b56-b534-642f10a7467b of volume f256f6f0-1442-4563-8ba4-98bd744d2ca3 {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:33:54 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] snapshot_file for this snap is: volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.3a6f9804-a0bc-4b56-b534-642f10a7467b {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:33:54 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[57cc421e-66ff-4181-a05f-31170b0f2059]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:33:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.3a6f9804-a0bc-4b56-b534-642f10a7467b {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:55 devstack sudo[102195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.3a6f9804-a0bc-4b56-b534-642f10a7467b Jun 23 16:33:55 devstack sudo[102195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:55 devstack sudo[102195]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.3a6f9804-a0bc-4b56-b534-642f10a7467b" returned: 0 in 1.055s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:55 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:33:55 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[294e629b-af2d-4731-a47a-db9d0bd344d0]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:33:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.ef685aab-01b6-4ec9-83e5-c74fb5988130 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:56 devstack sudo[102200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.ef685aab-01b6-4ec9-83e5-c74fb5988130 Jun 23 16:33:56 devstack sudo[102200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:57 devstack sudo[102200]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.ef685aab-01b6-4ec9-83e5-c74fb5988130" returned: 0 in 1.147s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:57 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:33:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.3a6f9804-a0bc-4b56-b534-642f10a7467b {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:57 devstack sudo[102239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.3a6f9804-a0bc-4b56-b534-642f10a7467b Jun 23 16:33:57 devstack sudo[102239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:58 devstack sudo[102239]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.3a6f9804-a0bc-4b56-b534-642f10a7467b" returned: 0 in 1.017s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.3a6f9804-a0bc-4b56-b534-642f10a7467b {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:58 devstack sudo[102250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.3a6f9804-a0bc-4b56-b534-642f10a7467b Jun 23 16:33:58 devstack sudo[102250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:58 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-8235cf41-219b-4359-a8a4-3417a24637f7 tempest-SnapshotsActionsTest-171329803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:33:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8235cf41-219b-4359-a8a4-3417a24637f7 tempest-SnapshotsActionsTest-171329803 None] Flow 'volume_create_manager' (39b68f91-f579-47fa-bfc7-a2381d96872f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:33:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8235cf41-219b-4359-a8a4-3417a24637f7 tempest-SnapshotsActionsTest-171329803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29a27e17-5b71-45a3-84bd-dd0e3f5f2a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:33:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8235cf41-219b-4359-a8a4-3417a24637f7 tempest-SnapshotsActionsTest-171329803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29a27e17-5b71-45a3-84bd-dd0e3f5f2a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:33:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-317078251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3efa3889-11f1-4263-8bb3-178ada5775d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b7cecfad2934df498ec92c1753b1dba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:33:59Z,use_quota=True,user_id='6ceafe9a753a4a9bbdba356b7a5ffe72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:33:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8235cf41-219b-4359-a8a4-3417a24637f7 tempest-SnapshotsActionsTest-171329803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56b21251-4fc4-4449-a3d9-b1d04ea93137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:33:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8235cf41-219b-4359-a8a4-3417a24637f7 tempest-SnapshotsActionsTest-171329803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56b21251-4fc4-4449-a3d9-b1d04ea93137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:33:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8235cf41-219b-4359-a8a4-3417a24637f7 tempest-SnapshotsActionsTest-171329803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcc47904-8646-49a6-9e9d-e40fbd27f634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:33:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8235cf41-219b-4359-a8a4-3417a24637f7 tempest-SnapshotsActionsTest-171329803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcc47904-8646-49a6-9e9d-e40fbd27f634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3efa3889-11f1-4263-8bb3-178ada5775d2', 'volume_name': 'volume-3efa3889-11f1-4263-8bb3-178ada5775d2', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:33:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8235cf41-219b-4359-a8a4-3417a24637f7 tempest-SnapshotsActionsTest-171329803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1bb3c61-93d6-4fc4-9508-d54a61d13bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:33:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8235cf41-219b-4359-a8a4-3417a24637f7 tempest-SnapshotsActionsTest-171329803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1bb3c61-93d6-4fc4-9508-d54a61d13bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:33:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8235cf41-219b-4359-a8a4-3417a24637f7 tempest-SnapshotsActionsTest-171329803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0231524-35f4-490c-a29c-11ee95a80a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:33:58 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-8235cf41-219b-4359-a8a4-3417a24637f7 tempest-SnapshotsActionsTest-171329803 None] Volume 3efa3889-11f1-4263-8bb3-178ada5775d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3efa3889-11f1-4263-8bb3-178ada5775d2', 'volume_size': 1} Jun 23 16:33:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8235cf41-219b-4359-a8a4-3417a24637f7 tempest-SnapshotsActionsTest-171329803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:33:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8235cf41-219b-4359-a8a4-3417a24637f7 tempest-SnapshotsActionsTest-171329803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:33:58 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-8235cf41-219b-4359-a8a4-3417a24637f7 tempest-SnapshotsActionsTest-171329803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:33:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-317078251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3efa3889-11f1-4263-8bb3-178ada5775d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b7cecfad2934df498ec92c1753b1dba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:33:59Z,use_quota=True,user_id='6ceafe9a753a4a9bbdba356b7a5ffe72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:33:58 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-8235cf41-219b-4359-a8a4-3417a24637f7 tempest-SnapshotsActionsTest-171329803 None] Creating volume 3efa3889-11f1-4263-8bb3-178ada5775d2 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:33:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8235cf41-219b-4359-a8a4-3417a24637f7 tempest-SnapshotsActionsTest-171329803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:33:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8235cf41-219b-4359-a8a4-3417a24637f7 tempest-SnapshotsActionsTest-171329803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:33:58 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-8235cf41-219b-4359-a8a4-3417a24637f7 tempest-SnapshotsActionsTest-171329803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:33:58 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-8235cf41-219b-4359-a8a4-3417a24637f7 tempest-SnapshotsActionsTest-171329803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:33:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8235cf41-219b-4359-a8a4-3417a24637f7 tempest-SnapshotsActionsTest-171329803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:33:58 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-8235cf41-219b-4359-a8a4-3417a24637f7 tempest-SnapshotsActionsTest-171329803 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:33:58 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-8235cf41-219b-4359-a8a4-3417a24637f7 tempest-SnapshotsActionsTest-171329803 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:33:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8235cf41-219b-4359-a8a4-3417a24637f7 tempest-SnapshotsActionsTest-171329803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:58 devstack sudo[102291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2 1073741824 Jun 23 16:33:58 devstack sudo[102291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:33:58 devstack sudo[102250]: pam_unix(sudo:session): session closed for user root Jun 23 16:33:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.3a6f9804-a0bc-4b56-b534-642f10a7467b" returned: 0 in 0.750s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:33:58 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Lock "cinder-quobyte-3a6f9804-a0bc-4b56-b534-642f10a7467b" released by "_delete_snapshot" :: held 4.121s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:33:58 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Lock "cinder-quobyte-f256f6f0-1442-4563-8ba4-98bd744d2ca3" released by "delete_snapshot" :: held 4.164s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:33:58 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Created reservations ['98e4a649-677a-4807-94cf-01766f519fe7', 'd54e53e4-358a-42b3-9ffb-f8f6de3fb1e8', 'e2bcba77-db27-482a-bbef-96e882283e0e', 'cb7620de-6b34-4fcb-9cb6-f591fa4051d3'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:33:59 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Delete snapshot completed successfully. Jun 23 16:33:59 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Lock "cinder-3a6f9804-a0bc-4b56-b534-642f10a7467b-delete_snapshot" released by "delete_snapshot" :: held 4.381s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:33:59 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Acquiring lock "cinder-ef685aab-01b6-4ec9-83e5-c74fb5988130-delete_snapshot" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:33:59 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Lock "cinder-ef685aab-01b6-4ec9-83e5-c74fb5988130-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:33:59 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Acquiring lock "cinder-quobyte-f256f6f0-1442-4563-8ba4-98bd744d2ca3" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:33:59 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Lock "cinder-quobyte-f256f6f0-1442-4563-8ba4-98bd744d2ca3" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:33:59 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Acquiring lock "cinder-quobyte-ef685aab-01b6-4ec9-83e5-c74fb5988130" by "_delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:33:59 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Lock "cinder-quobyte-ef685aab-01b6-4ec9-83e5-c74fb5988130" acquired by "_delete_snapshot" :: waited 0.053s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:33:59 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Deleting offline snapshot ef685aab-01b6-4ec9-83e5-c74fb5988130 of volume f256f6f0-1442-4563-8ba4-98bd744d2ca3 {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:33:59 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] snapshot_file for this snap is: volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.ef685aab-01b6-4ec9-83e5-c74fb5988130 {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:33:59 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e69cd1-26e7-49e6-b1a8-20e2dacb6bab]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:33:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.ef685aab-01b6-4ec9-83e5-c74fb5988130 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:33:59 devstack sudo[102320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.ef685aab-01b6-4ec9-83e5-c74fb5988130 Jun 23 16:33:59 devstack sudo[102320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:00 devstack sudo[102291]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8235cf41-219b-4359-a8a4-3417a24637f7 tempest-SnapshotsActionsTest-171329803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2 1073741824" returned: 0 in 1.579s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8235cf41-219b-4359-a8a4-3417a24637f7 tempest-SnapshotsActionsTest-171329803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:00 devstack sudo[102370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2 Jun 23 16:34:00 devstack sudo[102370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:00 devstack sudo[102320]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.ef685aab-01b6-4ec9-83e5-c74fb5988130" returned: 0 in 1.355s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:00 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:34:00 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[376ee192-4880-4e53-a1ac-9f1bea2b7d23]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:34:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:00 devstack sudo[102375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3 Jun 23 16:34:00 devstack sudo[102375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:01 devstack sudo[102370]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8235cf41-219b-4359-a8a4-3417a24637f7 tempest-SnapshotsActionsTest-171329803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2" returned: 0 in 0.778s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-8235cf41-219b-4359-a8a4-3417a24637f7 tempest-SnapshotsActionsTest-171329803 None] <== create_volume: return (2448ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:34:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8235cf41-219b-4359-a8a4-3417a24637f7 tempest-SnapshotsActionsTest-171329803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.451s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:34:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8235cf41-219b-4359-a8a4-3417a24637f7 tempest-SnapshotsActionsTest-171329803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0231524-35f4-490c-a29c-11ee95a80a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3efa3889-11f1-4263-8bb3-178ada5775d2', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:34:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8235cf41-219b-4359-a8a4-3417a24637f7 tempest-SnapshotsActionsTest-171329803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20823443-5012-4382-8b21-14a693ee3fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:34:01 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-8235cf41-219b-4359-a8a4-3417a24637f7 tempest-SnapshotsActionsTest-171329803 None] Volume volume-3efa3889-11f1-4263-8bb3-178ada5775d2 (3efa3889-11f1-4263-8bb3-178ada5775d2): created successfully Jun 23 16:34:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8235cf41-219b-4359-a8a4-3417a24637f7 tempest-SnapshotsActionsTest-171329803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20823443-5012-4382-8b21-14a693ee3fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:34:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8235cf41-219b-4359-a8a4-3417a24637f7 tempest-SnapshotsActionsTest-171329803 None] Flow 'volume_create_manager' (39b68f91-f579-47fa-bfc7-a2381d96872f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:34:01 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-8235cf41-219b-4359-a8a4-3417a24637f7 tempest-SnapshotsActionsTest-171329803 None] Created volume successfully. Jun 23 16:34:01 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:34:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:34:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:34:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:34:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:34:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:34:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:01 devstack sudo[102380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:34:01 devstack sudo[102380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:01 devstack sudo[102375]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3" returned: 0 in 0.915s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.ef685aab-01b6-4ec9-83e5-c74fb5988130 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:01 devstack sudo[102386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.ef685aab-01b6-4ec9-83e5-c74fb5988130 Jun 23 16:34:01 devstack sudo[102386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:02 devstack sudo[102380]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.839s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:02 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:34:02 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager._thread_info {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:34:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread count: 8 {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 16:34:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread info: [<_MainThread(MainThread, started 126303828988032)>, , , , , , , ] {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 16:34:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d8f72dd7-6c9d-4753-bde1-b2dc8c05afd9 tempest-SnapshotsActionsTest-171329803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:34:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d8f72dd7-6c9d-4753-bde1-b2dc8c05afd9 tempest-SnapshotsActionsTest-171329803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:34:02 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-d8f72dd7-6c9d-4753-bde1-b2dc8c05afd9 tempest-SnapshotsActionsTest-171329803 None] Creating offline snapshot 300f904b-6ed6-4aae-a8bf-52765365fdc0 of volume 3efa3889-11f1-4263-8bb3-178ada5775d2 {{(pid=93788) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:34:02 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f05d8a0-e081-4ea3-8fce-f96951f13abc]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:34:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d8f72dd7-6c9d-4753-bde1-b2dc8c05afd9 tempest-SnapshotsActionsTest-171329803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:02 devstack sudo[102389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2 Jun 23 16:34:02 devstack sudo[102389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:02 devstack sudo[102386]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.ef685aab-01b6-4ec9-83e5-c74fb5988130" returned: 0 in 1.183s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.ef685aab-01b6-4ec9-83e5-c74fb5988130 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:02 devstack sudo[102394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.ef685aab-01b6-4ec9-83e5-c74fb5988130 Jun 23 16:34:02 devstack sudo[102394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:03 devstack sudo[102389]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d8f72dd7-6c9d-4753-bde1-b2dc8c05afd9 tempest-SnapshotsActionsTest-171329803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2" returned: 0 in 1.038s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d8f72dd7-6c9d-4753-bde1-b2dc8c05afd9 tempest-SnapshotsActionsTest-171329803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0 1G {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:03 devstack sudo[102400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0 1G Jun 23 16:34:03 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:03 devstack sudo[102394]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3.ef685aab-01b6-4ec9-83e5-c74fb5988130" returned: 0 in 0.726s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:03 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Lock "cinder-quobyte-ef685aab-01b6-4ec9-83e5-c74fb5988130" released by "_delete_snapshot" :: held 4.312s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:34:03 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Lock "cinder-quobyte-f256f6f0-1442-4563-8ba4-98bd744d2ca3" released by "delete_snapshot" :: held 4.376s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:34:03 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Created reservations ['ddb427ab-7dd3-4909-a765-30ff1fc093ba', '0961b58d-393a-4a18-bbf5-6657a572b38c', 'f2080e50-ff13-4525-91f1-491177cc9293', 'd170857c-cea5-447a-a0fc-081c00aed433'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:34:03 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Delete snapshot completed successfully. Jun 23 16:34:03 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Lock "cinder-ef685aab-01b6-4ec9-83e5-c74fb5988130-delete_snapshot" released by "delete_snapshot" :: held 4.569s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:34:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Snapshots deleted, issuing volume delete {{(pid=93788) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 23 16:34:03 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Acquiring lock "cinder-quobyte-f256f6f0-1442-4563-8ba4-98bd744d2ca3" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:34:03 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Lock "cinder-quobyte-f256f6f0-1442-4563-8ba4-98bd744d2ca3" acquired by "delete_volume" :: waited 0.020s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:34:03 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d569d470-eddc-4dc7-9af5-712748e2a6bb]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:34:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:03 devstack sudo[102402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3 Jun 23 16:34:03 devstack sudo[102402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d8f72dd7-6c9d-4753-bde1-b2dc8c05afd9 tempest-SnapshotsActionsTest-171329803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0 1G" returned: 0 in 1.007s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:04 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d8f72dd7-6c9d-4753-bde1-b2dc8c05afd9 tempest-SnapshotsActionsTest-171329803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3efa3889-11f1-4263-8bb3-178ada5775d2 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:04 devstack sudo[102407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3efa3889-11f1-4263-8bb3-178ada5775d2 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0 Jun 23 16:34:04 devstack sudo[102407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:04 devstack sudo[102402]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3" returned: 0 in 0.982s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:04 devstack sudo[102413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3 Jun 23 16:34:04 devstack sudo[102413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:05 devstack sudo[102407]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d8f72dd7-6c9d-4753-bde1-b2dc8c05afd9 tempest-SnapshotsActionsTest-171329803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3efa3889-11f1-4263-8bb3-178ada5775d2 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0" returned: 0 in 0.872s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:05 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-d8f72dd7-6c9d-4753-bde1-b2dc8c05afd9 tempest-SnapshotsActionsTest-171329803 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0 is being set with open permissions: ugo+rw Jun 23 16:34:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d8f72dd7-6c9d-4753-bde1-b2dc8c05afd9 tempest-SnapshotsActionsTest-171329803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:05 devstack sudo[102418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0 Jun 23 16:34:05 devstack sudo[102418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:05 devstack sudo[102413]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f256f6f0-1442-4563-8ba4-98bd744d2ca3" returned: 0 in 0.844s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:05 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Lock "cinder-quobyte-f256f6f0-1442-4563-8ba4-98bd744d2ca3" released by "delete_volume" :: held 1.920s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:34:05 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Created reservations ['caf7a8d2-c550-4b12-b399-887f0188c96d', '6f37e4f1-788e-4f6d-b343-1f24958e20ee', 'd12de545-3bab-4dee-825f-23e188fdc319', 'f9cf3d7a-cea1-443b-bb7a-40f58179ed19'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:34:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:34:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:34:05 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:34:05 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:34:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:34:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:05 devstack sudo[102421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:34:05 devstack sudo[102421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:06 devstack sudo[102418]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d8f72dd7-6c9d-4753-bde1-b2dc8c05afd9 tempest-SnapshotsActionsTest-171329803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0" returned: 0 in 0.835s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d8f72dd7-6c9d-4753-bde1-b2dc8c05afd9 tempest-SnapshotsActionsTest-171329803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:06 devstack sudo[102426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.info Jun 23 16:34:06 devstack sudo[102426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:06 devstack sudo[102421]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.854s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:06 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:34:06 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Deleted volume successfully. Jun 23 16:34:06 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5c506332-e7d9-4cd0-975d-f78d2639e11a tempest-VolumesDeleteCascade-1735160611 None] Lock "cinder-f256f6f0-1442-4563-8ba4-98bd744d2ca3-delete_volume" released by "delete_volume" :: held 12.161s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:34:07 devstack sudo[102426]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d8f72dd7-6c9d-4753-bde1-b2dc8c05afd9 tempest-SnapshotsActionsTest-171329803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.info" returned: 0 in 1.076s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:07 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-d8f72dd7-6c9d-4753-bde1-b2dc8c05afd9 tempest-SnapshotsActionsTest-171329803 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.info is being set with open permissions: ugo+rw Jun 23 16:34:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d8f72dd7-6c9d-4753-bde1-b2dc8c05afd9 tempest-SnapshotsActionsTest-171329803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:07 devstack sudo[102430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.info Jun 23 16:34:07 devstack sudo[102430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:07 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-195c6cf3-7d22-433d-8ec1-bf878dfc7591 tempest-VolumesDeleteCascade-1735160611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:34:07 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-195c6cf3-7d22-433d-8ec1-bf878dfc7591 tempest-VolumesDeleteCascade-1735160611 None] Flow 'volume_create_manager' (da829c2a-4c2a-4fba-bc76-01ef8a0770ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:34:07 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-195c6cf3-7d22-433d-8ec1-bf878dfc7591 tempest-VolumesDeleteCascade-1735160611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fbfc1d5-0ef7-4169-a4d4-341433393787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:34:07 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-195c6cf3-7d22-433d-8ec1-bf878dfc7591 tempest-VolumesDeleteCascade-1735160611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fbfc1d5-0ef7-4169-a4d4-341433393787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1516037239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90c8de0f-e3ca-4eaa-ab70-ba49bc584200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c289ab92c01848c7814fa32075db1285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:34:08Z,use_quota=True,user_id='30f2b7f272064a5d952fc413547f80e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:34:07 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-195c6cf3-7d22-433d-8ec1-bf878dfc7591 tempest-VolumesDeleteCascade-1735160611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e9d9d9-d14f-4f91-a39f-d473734568a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:34:07 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-195c6cf3-7d22-433d-8ec1-bf878dfc7591 tempest-VolumesDeleteCascade-1735160611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e9d9d9-d14f-4f91-a39f-d473734568a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:34:07 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-195c6cf3-7d22-433d-8ec1-bf878dfc7591 tempest-VolumesDeleteCascade-1735160611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (375ec1b4-3bae-4042-9b1f-08dda4f716a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:34:07 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-195c6cf3-7d22-433d-8ec1-bf878dfc7591 tempest-VolumesDeleteCascade-1735160611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (375ec1b4-3bae-4042-9b1f-08dda4f716a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90c8de0f-e3ca-4eaa-ab70-ba49bc584200', 'volume_name': 'volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:34:07 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-195c6cf3-7d22-433d-8ec1-bf878dfc7591 tempest-VolumesDeleteCascade-1735160611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9558e6f2-633d-4a84-8e75-0ff9606dd8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:34:07 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-195c6cf3-7d22-433d-8ec1-bf878dfc7591 tempest-VolumesDeleteCascade-1735160611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9558e6f2-633d-4a84-8e75-0ff9606dd8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:34:07 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-195c6cf3-7d22-433d-8ec1-bf878dfc7591 tempest-VolumesDeleteCascade-1735160611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2f57e0f-818f-4b5e-baed-0f8214ebc33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:34:07 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-195c6cf3-7d22-433d-8ec1-bf878dfc7591 tempest-VolumesDeleteCascade-1735160611 None] Volume 90c8de0f-e3ca-4eaa-ab70-ba49bc584200: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200', 'volume_size': 1} Jun 23 16:34:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-195c6cf3-7d22-433d-8ec1-bf878dfc7591 tempest-VolumesDeleteCascade-1735160611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:34:08 devstack sudo[102430]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d8f72dd7-6c9d-4753-bde1-b2dc8c05afd9 tempest-SnapshotsActionsTest-171329803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.info" returned: 0 in 0.915s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d8f72dd7-6c9d-4753-bde1-b2dc8c05afd9 tempest-SnapshotsActionsTest-171329803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.897s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:34:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-195c6cf3-7d22-433d-8ec1-bf878dfc7591 tempest-VolumesDeleteCascade-1735160611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.323s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:34:08 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-195c6cf3-7d22-433d-8ec1-bf878dfc7591 tempest-VolumesDeleteCascade-1735160611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1516037239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90c8de0f-e3ca-4eaa-ab70-ba49bc584200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c289ab92c01848c7814fa32075db1285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:34:08Z,use_quota=True,user_id='30f2b7f272064a5d952fc413547f80e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:34:08 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-195c6cf3-7d22-433d-8ec1-bf878dfc7591 tempest-VolumesDeleteCascade-1735160611 None] Creating volume 90c8de0f-e3ca-4eaa-ab70-ba49bc584200 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:34:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-195c6cf3-7d22-433d-8ec1-bf878dfc7591 tempest-VolumesDeleteCascade-1735160611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:34:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-195c6cf3-7d22-433d-8ec1-bf878dfc7591 tempest-VolumesDeleteCascade-1735160611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:34:08 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-195c6cf3-7d22-433d-8ec1-bf878dfc7591 tempest-VolumesDeleteCascade-1735160611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:34:08 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-195c6cf3-7d22-433d-8ec1-bf878dfc7591 tempest-VolumesDeleteCascade-1735160611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:34:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-195c6cf3-7d22-433d-8ec1-bf878dfc7591 tempest-VolumesDeleteCascade-1735160611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:34:08 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-195c6cf3-7d22-433d-8ec1-bf878dfc7591 tempest-VolumesDeleteCascade-1735160611 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:34:08 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-195c6cf3-7d22-433d-8ec1-bf878dfc7591 tempest-VolumesDeleteCascade-1735160611 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:34:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-195c6cf3-7d22-433d-8ec1-bf878dfc7591 tempest-VolumesDeleteCascade-1735160611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:08 devstack sudo[102434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200 1073741824 Jun 23 16:34:08 devstack sudo[102434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:08 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-d8f72dd7-6c9d-4753-bde1-b2dc8c05afd9 tempest-SnapshotsActionsTest-171329803 None] Create snapshot completed successfully Jun 23 16:34:09 devstack cinder-volume[93788]: INFO cinder.volume.manager [req-012f242c-6cd1-4e02-86d0-d94f665d498e req-d2f2a27c-92ac-4971-aeb2-14744c731a3e tempest-ServerActionsTestOtherA-1626454459 None] Terminate volume connection completed successfully. Jun 23 16:34:09 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-012f242c-6cd1-4e02-86d0-d94f665d498e req-d2f2a27c-92ac-4971-aeb2-14744c731a3e tempest-ServerActionsTestOtherA-1626454459 None] Deleting attachment cd4d9cd9-8ca1-409c-89d2-e238b748e71a. {{(pid=93788) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 16:34:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-06aa7d64-9081-415e-b70b-eae13cab3a16 tempest-SnapshotsActionsTest-171329803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:34:09 devstack sudo[102434]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-195c6cf3-7d22-433d-8ec1-bf878dfc7591 tempest-VolumesDeleteCascade-1735160611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200 1073741824" returned: 0 in 1.245s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-195c6cf3-7d22-433d-8ec1-bf878dfc7591 tempest-VolumesDeleteCascade-1735160611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:09 devstack sudo[102447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200 Jun 23 16:34:09 devstack sudo[102447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:10 devstack sudo[102447]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-195c6cf3-7d22-433d-8ec1-bf878dfc7591 tempest-VolumesDeleteCascade-1735160611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200" returned: 0 in 0.723s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:10 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-195c6cf3-7d22-433d-8ec1-bf878dfc7591 tempest-VolumesDeleteCascade-1735160611 None] <== create_volume: return (2010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:34:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-195c6cf3-7d22-433d-8ec1-bf878dfc7591 tempest-VolumesDeleteCascade-1735160611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.014s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:34:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-06aa7d64-9081-415e-b70b-eae13cab3a16 tempest-SnapshotsActionsTest-171329803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.884s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:34:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-195c6cf3-7d22-433d-8ec1-bf878dfc7591 tempest-VolumesDeleteCascade-1735160611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2f57e0f-818f-4b5e-baed-0f8214ebc33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:34:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-195c6cf3-7d22-433d-8ec1-bf878dfc7591 tempest-VolumesDeleteCascade-1735160611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8144a6c-c2c4-446e-8412-81737ee06952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:34:10 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-06aa7d64-9081-415e-b70b-eae13cab3a16 tempest-SnapshotsActionsTest-171329803 None] Creating offline snapshot a21edffa-a8ec-41a3-b883-b9e5534b54d2 of volume 3efa3889-11f1-4263-8bb3-178ada5775d2 {{(pid=93788) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:34:10 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-195c6cf3-7d22-433d-8ec1-bf878dfc7591 tempest-VolumesDeleteCascade-1735160611 None] Volume volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200 (90c8de0f-e3ca-4eaa-ab70-ba49bc584200): created successfully Jun 23 16:34:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-195c6cf3-7d22-433d-8ec1-bf878dfc7591 tempest-VolumesDeleteCascade-1735160611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8144a6c-c2c4-446e-8412-81737ee06952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:34:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-195c6cf3-7d22-433d-8ec1-bf878dfc7591 tempest-VolumesDeleteCascade-1735160611 None] Flow 'volume_create_manager' (da829c2a-4c2a-4fba-bc76-01ef8a0770ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:34:10 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[388cf9a3-b045-4837-979d-f966a2aae3ba]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:34:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-06aa7d64-9081-415e-b70b-eae13cab3a16 tempest-SnapshotsActionsTest-171329803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:10 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-195c6cf3-7d22-433d-8ec1-bf878dfc7591 tempest-VolumesDeleteCascade-1735160611 None] Created volume successfully. Jun 23 16:34:10 devstack sudo[102450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0 Jun 23 16:34:10 devstack sudo[102450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:11 devstack sudo[102450]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-06aa7d64-9081-415e-b70b-eae13cab3a16 tempest-SnapshotsActionsTest-171329803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0" returned: 0 in 0.847s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:11 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-06aa7d64-9081-415e-b70b-eae13cab3a16 tempest-SnapshotsActionsTest-171329803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3efa3889-11f1-4263-8bb3-178ada5775d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:34:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-06aa7d64-9081-415e-b70b-eae13cab3a16 tempest-SnapshotsActionsTest-171329803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.a21edffa-a8ec-41a3-b883-b9e5534b54d2 1G {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:11 devstack sudo[102456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.a21edffa-a8ec-41a3-b883-b9e5534b54d2 1G Jun 23 16:34:11 devstack sudo[102456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-64764dba-e00f-49c5-a760-16b198545053 tempest-VolumesDeleteCascade-1735160611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:34:12 devstack sudo[102456]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-06aa7d64-9081-415e-b70b-eae13cab3a16 tempest-SnapshotsActionsTest-171329803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.a21edffa-a8ec-41a3-b883-b9e5534b54d2 1G" returned: 0 in 0.925s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-06aa7d64-9081-415e-b70b-eae13cab3a16 tempest-SnapshotsActionsTest-171329803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.a21edffa-a8ec-41a3-b883-b9e5534b54d2 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:12 devstack sudo[102462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.a21edffa-a8ec-41a3-b883-b9e5534b54d2 Jun 23 16:34:12 devstack sudo[102462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:13 devstack sudo[102462]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-06aa7d64-9081-415e-b70b-eae13cab3a16 tempest-SnapshotsActionsTest-171329803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.a21edffa-a8ec-41a3-b883-b9e5534b54d2" returned: 0 in 1.316s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:13 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-06aa7d64-9081-415e-b70b-eae13cab3a16 tempest-SnapshotsActionsTest-171329803 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.a21edffa-a8ec-41a3-b883-b9e5534b54d2 is being set with open permissions: ugo+rw Jun 23 16:34:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-06aa7d64-9081-415e-b70b-eae13cab3a16 tempest-SnapshotsActionsTest-171329803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.a21edffa-a8ec-41a3-b883-b9e5534b54d2 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:13 devstack sudo[102511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.a21edffa-a8ec-41a3-b883-b9e5534b54d2 Jun 23 16:34:13 devstack sudo[102511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:14 devstack sudo[102511]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-06aa7d64-9081-415e-b70b-eae13cab3a16 tempest-SnapshotsActionsTest-171329803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.a21edffa-a8ec-41a3-b883-b9e5534b54d2" returned: 0 in 0.758s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-06aa7d64-9081-415e-b70b-eae13cab3a16 tempest-SnapshotsActionsTest-171329803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.018s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:34:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-64764dba-e00f-49c5-a760-16b198545053 tempest-VolumesDeleteCascade-1735160611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.944s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:34:14 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-64764dba-e00f-49c5-a760-16b198545053 tempest-VolumesDeleteCascade-1735160611 None] Creating offline snapshot e3e52eec-bc40-42ee-a8b9-9e3f14333817 of volume 90c8de0f-e3ca-4eaa-ab70-ba49bc584200 {{(pid=93788) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:34:14 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-06aa7d64-9081-415e-b70b-eae13cab3a16 tempest-SnapshotsActionsTest-171329803 None] Create snapshot completed successfully Jun 23 16:34:14 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[01554168-be31-48ac-9d79-135c1e21f8f5]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:34:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-64764dba-e00f-49c5-a760-16b198545053 tempest-VolumesDeleteCascade-1735160611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:14 devstack sudo[102523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200 Jun 23 16:34:14 devstack sudo[102523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:14 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d3721a3d-716c-494a-922e-da76eae16f06 tempest-SnapshotsActionsTest-798685141 None] Acquiring lock "cinder-a21edffa-a8ec-41a3-b883-b9e5534b54d2-delete_snapshot" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:34:14 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d3721a3d-716c-494a-922e-da76eae16f06 tempest-SnapshotsActionsTest-798685141 None] Lock "cinder-a21edffa-a8ec-41a3-b883-b9e5534b54d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:34:14 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d3721a3d-716c-494a-922e-da76eae16f06 tempest-SnapshotsActionsTest-798685141 None] Acquiring lock "cinder-quobyte-3efa3889-11f1-4263-8bb3-178ada5775d2" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:34:14 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d3721a3d-716c-494a-922e-da76eae16f06 tempest-SnapshotsActionsTest-798685141 None] Lock "cinder-quobyte-3efa3889-11f1-4263-8bb3-178ada5775d2" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:34:14 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d3721a3d-716c-494a-922e-da76eae16f06 tempest-SnapshotsActionsTest-798685141 None] Acquiring lock "cinder-quobyte-a21edffa-a8ec-41a3-b883-b9e5534b54d2" by "_delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:34:14 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d3721a3d-716c-494a-922e-da76eae16f06 tempest-SnapshotsActionsTest-798685141 None] Lock "cinder-quobyte-a21edffa-a8ec-41a3-b883-b9e5534b54d2" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:34:14 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-d3721a3d-716c-494a-922e-da76eae16f06 tempest-SnapshotsActionsTest-798685141 None] Deleting offline snapshot a21edffa-a8ec-41a3-b883-b9e5534b54d2 of volume 3efa3889-11f1-4263-8bb3-178ada5775d2 {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:34:14 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-d3721a3d-716c-494a-922e-da76eae16f06 tempest-SnapshotsActionsTest-798685141 None] snapshot_file for this snap is: volume-3efa3889-11f1-4263-8bb3-178ada5775d2.a21edffa-a8ec-41a3-b883-b9e5534b54d2 {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:34:14 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddb3c09-1471-469c-a95d-f46bfa95e2e0]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:34:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d3721a3d-716c-494a-922e-da76eae16f06 tempest-SnapshotsActionsTest-798685141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.a21edffa-a8ec-41a3-b883-b9e5534b54d2 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:15 devstack sudo[102526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.a21edffa-a8ec-41a3-b883-b9e5534b54d2 Jun 23 16:34:15 devstack sudo[102526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:15 devstack sudo[102523]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-64764dba-e00f-49c5-a760-16b198545053 tempest-VolumesDeleteCascade-1735160611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200" returned: 0 in 1.024s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-64764dba-e00f-49c5-a760-16b198545053 tempest-VolumesDeleteCascade-1735160611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200.e3e52eec-bc40-42ee-a8b9-9e3f14333817 1G {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:15 devstack sudo[102532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200.e3e52eec-bc40-42ee-a8b9-9e3f14333817 1G Jun 23 16:34:15 devstack sudo[102532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:15 devstack sudo[102526]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d3721a3d-716c-494a-922e-da76eae16f06 tempest-SnapshotsActionsTest-798685141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.a21edffa-a8ec-41a3-b883-b9e5534b54d2" returned: 0 in 0.846s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:15 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-d3721a3d-716c-494a-922e-da76eae16f06 tempest-SnapshotsActionsTest-798685141 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3efa3889-11f1-4263-8bb3-178ada5775d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:34:15 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3511daa8-4160-4e47-8e2d-0597d9f8134e]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:34:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d3721a3d-716c-494a-922e-da76eae16f06 tempest-SnapshotsActionsTest-798685141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:15 devstack sudo[102537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0 Jun 23 16:34:15 devstack sudo[102537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:16 devstack sudo[102532]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-64764dba-e00f-49c5-a760-16b198545053 tempest-VolumesDeleteCascade-1735160611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200.e3e52eec-bc40-42ee-a8b9-9e3f14333817 1G" returned: 0 in 0.887s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-64764dba-e00f-49c5-a760-16b198545053 tempest-VolumesDeleteCascade-1735160611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200.e3e52eec-bc40-42ee-a8b9-9e3f14333817 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:16 devstack sudo[102543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200.e3e52eec-bc40-42ee-a8b9-9e3f14333817 Jun 23 16:34:16 devstack sudo[102543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:16 devstack sudo[102537]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d3721a3d-716c-494a-922e-da76eae16f06 tempest-SnapshotsActionsTest-798685141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0" returned: 0 in 0.923s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:16 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-d3721a3d-716c-494a-922e-da76eae16f06 tempest-SnapshotsActionsTest-798685141 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3efa3889-11f1-4263-8bb3-178ada5775d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:34:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d3721a3d-716c-494a-922e-da76eae16f06 tempest-SnapshotsActionsTest-798685141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.a21edffa-a8ec-41a3-b883-b9e5534b54d2 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:16 devstack sudo[102550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.a21edffa-a8ec-41a3-b883-b9e5534b54d2 Jun 23 16:34:16 devstack sudo[102550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:17 devstack sudo[102543]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-64764dba-e00f-49c5-a760-16b198545053 tempest-VolumesDeleteCascade-1735160611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200.e3e52eec-bc40-42ee-a8b9-9e3f14333817" returned: 0 in 0.847s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:17 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-64764dba-e00f-49c5-a760-16b198545053 tempest-VolumesDeleteCascade-1735160611 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200.e3e52eec-bc40-42ee-a8b9-9e3f14333817 is being set with open permissions: ugo+rw Jun 23 16:34:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-64764dba-e00f-49c5-a760-16b198545053 tempest-VolumesDeleteCascade-1735160611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200.e3e52eec-bc40-42ee-a8b9-9e3f14333817 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:17 devstack sudo[102555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200.e3e52eec-bc40-42ee-a8b9-9e3f14333817 Jun 23 16:34:17 devstack sudo[102555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:17 devstack sudo[102550]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d3721a3d-716c-494a-922e-da76eae16f06 tempest-SnapshotsActionsTest-798685141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.a21edffa-a8ec-41a3-b883-b9e5534b54d2" returned: 0 in 0.841s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d3721a3d-716c-494a-922e-da76eae16f06 tempest-SnapshotsActionsTest-798685141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.a21edffa-a8ec-41a3-b883-b9e5534b54d2 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:17 devstack sudo[102561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.a21edffa-a8ec-41a3-b883-b9e5534b54d2 Jun 23 16:34:17 devstack sudo[102561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:17 devstack sudo[102555]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-64764dba-e00f-49c5-a760-16b198545053 tempest-VolumesDeleteCascade-1735160611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200.e3e52eec-bc40-42ee-a8b9-9e3f14333817" returned: 0 in 0.778s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-64764dba-e00f-49c5-a760-16b198545053 tempest-VolumesDeleteCascade-1735160611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:17 devstack sudo[102564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200.info Jun 23 16:34:17 devstack sudo[102564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:18 devstack sudo[102561]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:18 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d3721a3d-716c-494a-922e-da76eae16f06 tempest-SnapshotsActionsTest-798685141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.a21edffa-a8ec-41a3-b883-b9e5534b54d2" returned: 0 in 0.759s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:18 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d3721a3d-716c-494a-922e-da76eae16f06 tempest-SnapshotsActionsTest-798685141 None] Lock "cinder-quobyte-a21edffa-a8ec-41a3-b883-b9e5534b54d2" released by "_delete_snapshot" :: held 3.544s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:34:18 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d3721a3d-716c-494a-922e-da76eae16f06 tempest-SnapshotsActionsTest-798685141 None] Lock "cinder-quobyte-3efa3889-11f1-4263-8bb3-178ada5775d2" released by "delete_snapshot" :: held 3.577s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:34:18 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-d3721a3d-716c-494a-922e-da76eae16f06 tempest-SnapshotsActionsTest-798685141 None] Created reservations ['c8256652-20c5-4207-9ad7-450e7b46347e', 'd1a78e94-aeae-46cf-be93-8618ec2473df', 'afeef1f6-c26e-4493-8cce-c8944a6cdd95', '18e48a17-221b-456a-b740-bb8adb59346f'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:34:18 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-d3721a3d-716c-494a-922e-da76eae16f06 tempest-SnapshotsActionsTest-798685141 None] Delete snapshot completed successfully. Jun 23 16:34:18 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d3721a3d-716c-494a-922e-da76eae16f06 tempest-SnapshotsActionsTest-798685141 None] Lock "cinder-a21edffa-a8ec-41a3-b883-b9e5534b54d2-delete_snapshot" released by "delete_snapshot" :: held 3.773s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:34:18 devstack sudo[102564]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:18 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-64764dba-e00f-49c5-a760-16b198545053 tempest-VolumesDeleteCascade-1735160611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200.info" returned: 0 in 0.736s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:18 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-64764dba-e00f-49c5-a760-16b198545053 tempest-VolumesDeleteCascade-1735160611 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200.info is being set with open permissions: ugo+rw Jun 23 16:34:18 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-64764dba-e00f-49c5-a760-16b198545053 tempest-VolumesDeleteCascade-1735160611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:18 devstack sudo[102569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200.info Jun 23 16:34:18 devstack sudo[102569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:19 devstack sudo[102569]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:19 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-64764dba-e00f-49c5-a760-16b198545053 tempest-VolumesDeleteCascade-1735160611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200.info" returned: 0 in 0.708s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:19 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-64764dba-e00f-49c5-a760-16b198545053 tempest-VolumesDeleteCascade-1735160611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.121s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:34:19 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-64764dba-e00f-49c5-a760-16b198545053 tempest-VolumesDeleteCascade-1735160611 None] Create snapshot completed successfully Jun 23 16:34:19 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5c6b7223-f8df-4c61-bd27-66ff12a23fd1 tempest-SnapshotsActionsTest-171329803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:34:19 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5c6b7223-f8df-4c61-bd27-66ff12a23fd1 tempest-SnapshotsActionsTest-171329803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:34:19 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-5c6b7223-f8df-4c61-bd27-66ff12a23fd1 tempest-SnapshotsActionsTest-171329803 None] Creating offline snapshot 83342a68-9975-41b3-8787-70d4e5de1d52 of volume 3efa3889-11f1-4263-8bb3-178ada5775d2 {{(pid=93788) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:34:19 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b574a8-fa2a-4c97-9d49-6ab891749110]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:34:19 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5c6b7223-f8df-4c61-bd27-66ff12a23fd1 tempest-SnapshotsActionsTest-171329803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:19 devstack sudo[102572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0 Jun 23 16:34:19 devstack sudo[102572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:20 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-2f374049-ce6b-4443-9447-0578c6f79c35 tempest-ServerActionsTestOtherA-1626454459 None] Acquiring lock "cinder-80319ecc-7a03-42da-8ae8-4d7d493a5066-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:34:20 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-2f374049-ce6b-4443-9447-0578c6f79c35 tempest-ServerActionsTestOtherA-1626454459 None] Lock "cinder-80319ecc-7a03-42da-8ae8-4d7d493a5066-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:34:20 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:34:20 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-2f374049-ce6b-4443-9447-0578c6f79c35 tempest-ServerActionsTestOtherA-1626454459 None] Acquiring lock "cinder-quobyte-80319ecc-7a03-42da-8ae8-4d7d493a5066" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:34:20 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] Flow 'volume_create_manager' (d0aa13c2-c44c-4666-bbaf-e145981eac17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:34:20 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a3ba206-a5bd-4691-891a-87437037f2f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:34:20 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-2f374049-ce6b-4443-9447-0578c6f79c35 tempest-ServerActionsTestOtherA-1626454459 None] Lock "cinder-quobyte-80319ecc-7a03-42da-8ae8-4d7d493a5066" acquired by "delete_volume" :: waited 0.045s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:34:20 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a3ba206-a5bd-4691-891a-87437037f2f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:34:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1095016927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db378a89-f545-4cd0-a571-b46921bdf184,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c289ab92c01848c7814fa32075db1285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e3e52eec-bc40-42ee-a8b9-9e3f14333817,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:34:20Z,use_quota=True,user_id='30f2b7f272064a5d952fc413547f80e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:34:20 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d549041d-a8ea-4de2-9eb0-91d090ad8d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:34:20 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d549041d-a8ea-4de2-9eb0-91d090ad8d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:34:20 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b970757-3bea-481a-834a-81cd7e3bb8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:34:20 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b970757-3bea-481a-834a-81cd7e3bb8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'db378a89-f545-4cd0-a571-b46921bdf184', 'volume_name': 'volume-db378a89-f545-4cd0-a571-b46921bdf184', 'volume_size': 1, 'snapshot_id': 'e3e52eec-bc40-42ee-a8b9-9e3f14333817'}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:34:20 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5425ca5-98f7-4b20-85ea-539676c300a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:34:20 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5425ca5-98f7-4b20-85ea-539676c300a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:34:20 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b95f22b-705e-4a52-9498-f9c85419cfc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:34:20 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] Volume db378a89-f545-4cd0-a571-b46921bdf184: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-db378a89-f545-4cd0-a571-b46921bdf184', 'volume_size': 1, 'snapshot_id': 'e3e52eec-bc40-42ee-a8b9-9e3f14333817'} Jun 23 16:34:20 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9077db-fbf0-442a-9f7f-bc9361d8d72d]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:34:20 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2f374049-ce6b-4443-9447-0578c6f79c35 tempest-ServerActionsTestOtherA-1626454459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-80319ecc-7a03-42da-8ae8-4d7d493a5066 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:20 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:34:20 devstack sudo[102572]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:20 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5c6b7223-f8df-4c61-bd27-66ff12a23fd1 tempest-SnapshotsActionsTest-171329803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0" returned: 0 in 1.005s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:20 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-5c6b7223-f8df-4c61-bd27-66ff12a23fd1 tempest-SnapshotsActionsTest-171329803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3efa3889-11f1-4263-8bb3-178ada5775d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:34:20 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5c6b7223-f8df-4c61-bd27-66ff12a23fd1 tempest-SnapshotsActionsTest-171329803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.83342a68-9975-41b3-8787-70d4e5de1d52 1G {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:20 devstack sudo[102578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.83342a68-9975-41b3-8787-70d4e5de1d52 1G Jun 23 16:34:20 devstack sudo[102578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:20 devstack sudo[102577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-80319ecc-7a03-42da-8ae8-4d7d493a5066 Jun 23 16:34:20 devstack sudo[102577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:21 devstack sudo[102577]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2f374049-ce6b-4443-9447-0578c6f79c35 tempest-ServerActionsTestOtherA-1626454459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-80319ecc-7a03-42da-8ae8-4d7d493a5066" returned: 0 in 0.928s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2f374049-ce6b-4443-9447-0578c6f79c35 tempest-ServerActionsTestOtherA-1626454459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-80319ecc-7a03-42da-8ae8-4d7d493a5066 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:21 devstack sudo[102588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-80319ecc-7a03-42da-8ae8-4d7d493a5066 Jun 23 16:34:21 devstack sudo[102588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:21 devstack sudo[102578]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5c6b7223-f8df-4c61-bd27-66ff12a23fd1 tempest-SnapshotsActionsTest-171329803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.83342a68-9975-41b3-8787-70d4e5de1d52 1G" returned: 0 in 0.989s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5c6b7223-f8df-4c61-bd27-66ff12a23fd1 tempest-SnapshotsActionsTest-171329803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.83342a68-9975-41b3-8787-70d4e5de1d52 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:21 devstack sudo[102590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.83342a68-9975-41b3-8787-70d4e5de1d52 Jun 23 16:34:21 devstack sudo[102590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:22 devstack sudo[102588]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2f374049-ce6b-4443-9447-0578c6f79c35 tempest-ServerActionsTestOtherA-1626454459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-80319ecc-7a03-42da-8ae8-4d7d493a5066" returned: 0 in 0.746s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:22 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-2f374049-ce6b-4443-9447-0578c6f79c35 tempest-ServerActionsTestOtherA-1626454459 None] Lock "cinder-quobyte-80319ecc-7a03-42da-8ae8-4d7d493a5066" released by "delete_volume" :: held 1.785s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:34:22 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-2f374049-ce6b-4443-9447-0578c6f79c35 tempest-ServerActionsTestOtherA-1626454459 None] Created reservations ['40d2c06a-3e3f-414a-8926-9249a56d609c', '3ad49483-b782-4caa-b267-1156de16f649', '228f3152-9ec2-4b01-b099-e81f89c38958', '280db096-1c10-453d-bdb6-a397ac6c5c92'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:34:22 devstack sudo[102590]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5c6b7223-f8df-4c61-bd27-66ff12a23fd1 tempest-SnapshotsActionsTest-171329803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.83342a68-9975-41b3-8787-70d4e5de1d52" returned: 0 in 0.690s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:22 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-5c6b7223-f8df-4c61-bd27-66ff12a23fd1 tempest-SnapshotsActionsTest-171329803 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.83342a68-9975-41b3-8787-70d4e5de1d52 is being set with open permissions: ugo+rw Jun 23 16:34:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5c6b7223-f8df-4c61-bd27-66ff12a23fd1 tempest-SnapshotsActionsTest-171329803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.83342a68-9975-41b3-8787-70d4e5de1d52 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:22 devstack sudo[102596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.83342a68-9975-41b3-8787-70d4e5de1d52 Jun 23 16:34:22 devstack sudo[102596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-2f374049-ce6b-4443-9447-0578c6f79c35 tempest-ServerActionsTestOtherA-1626454459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:34:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-2f374049-ce6b-4443-9447-0578c6f79c35 tempest-ServerActionsTestOtherA-1626454459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:34:22 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-2f374049-ce6b-4443-9447-0578c6f79c35 tempest-ServerActionsTestOtherA-1626454459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:34:22 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-2f374049-ce6b-4443-9447-0578c6f79c35 tempest-ServerActionsTestOtherA-1626454459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:34:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-2f374049-ce6b-4443-9447-0578c6f79c35 tempest-ServerActionsTestOtherA-1626454459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:34:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2f374049-ce6b-4443-9447-0578c6f79c35 tempest-ServerActionsTestOtherA-1626454459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:22 devstack sudo[102598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:34:22 devstack sudo[102598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:22 devstack sudo[102596]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5c6b7223-f8df-4c61-bd27-66ff12a23fd1 tempest-SnapshotsActionsTest-171329803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.83342a68-9975-41b3-8787-70d4e5de1d52" returned: 0 in 0.723s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5c6b7223-f8df-4c61-bd27-66ff12a23fd1 tempest-SnapshotsActionsTest-171329803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.517s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:34:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.497s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:34:22 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] Acquiring lock "cinder-quobyte-e3e52eec-bc40-42ee-a8b9-9e3f14333817-db378a89-f545-4cd0-a571-b46921bdf184" by "_create_volume_from_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:34:22 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] Lock "cinder-quobyte-e3e52eec-bc40-42ee-a8b9-9e3f14333817-db378a89-f545-4cd0-a571-b46921bdf184" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:34:22 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] Creating volume db378a89-f545-4cd0-a571-b46921bdf184 from snapshot e3e52eec-bc40-42ee-a8b9-9e3f14333817 {{(pid=93788) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 16:34:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:34:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:34:22 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:34:22 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:34:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:34:22 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:34:22 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] Acquiring lock "cinder-quobyte-db378a89-f545-4cd0-a571-b46921bdf184" by "_copy_volume_from_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:34:22 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-5c6b7223-f8df-4c61-bd27-66ff12a23fd1 tempest-SnapshotsActionsTest-171329803 None] Create snapshot completed successfully Jun 23 16:34:23 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] Lock "cinder-quobyte-db378a89-f545-4cd0-a571-b46921bdf184" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:34:23 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] snapshot: e3e52eec-bc40-42ee-a8b9-9e3f14333817, volume: db378a89-f545-4cd0-a571-b46921bdf184, {{(pid=93788) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 16:34:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:34:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:34:23 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:34:23 devstack sudo[102598]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:23 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:34:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:34:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2f374049-ce6b-4443-9447-0578c6f79c35 tempest-ServerActionsTestOtherA-1626454459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.784s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:23 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-2f374049-ce6b-4443-9447-0578c6f79c35 tempest-ServerActionsTestOtherA-1626454459 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:34:23 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-2f374049-ce6b-4443-9447-0578c6f79c35 tempest-ServerActionsTestOtherA-1626454459 None] Deleted volume successfully. Jun 23 16:34:23 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[327ccb92-85d6-41de-8f61-deff573d71d9]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:34:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200.e3e52eec-bc40-42ee-a8b9-9e3f14333817 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:23 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-2f374049-ce6b-4443-9447-0578c6f79c35 tempest-ServerActionsTestOtherA-1626454459 None] Lock "cinder-80319ecc-7a03-42da-8ae8-4d7d493a5066-delete_volume" released by "delete_volume" :: held 2.915s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:34:23 devstack sudo[102603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200.e3e52eec-bc40-42ee-a8b9-9e3f14333817 Jun 23 16:34:23 devstack sudo[102603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:23 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-1052c035-4199-4253-8bd3-97b722eb9e8a tempest-SnapshotsActionsTest-798685141 None] Acquiring lock "cinder-83342a68-9975-41b3-8787-70d4e5de1d52-delete_snapshot" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:34:24 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-1052c035-4199-4253-8bd3-97b722eb9e8a tempest-SnapshotsActionsTest-798685141 None] Lock "cinder-83342a68-9975-41b3-8787-70d4e5de1d52-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:34:24 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-1052c035-4199-4253-8bd3-97b722eb9e8a tempest-SnapshotsActionsTest-798685141 None] Acquiring lock "cinder-quobyte-3efa3889-11f1-4263-8bb3-178ada5775d2" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:34:24 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-1052c035-4199-4253-8bd3-97b722eb9e8a tempest-SnapshotsActionsTest-798685141 None] Lock "cinder-quobyte-3efa3889-11f1-4263-8bb3-178ada5775d2" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:34:24 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-1052c035-4199-4253-8bd3-97b722eb9e8a tempest-SnapshotsActionsTest-798685141 None] Acquiring lock "cinder-quobyte-83342a68-9975-41b3-8787-70d4e5de1d52" by "_delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:34:24 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-1052c035-4199-4253-8bd3-97b722eb9e8a tempest-SnapshotsActionsTest-798685141 None] Lock "cinder-quobyte-83342a68-9975-41b3-8787-70d4e5de1d52" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:34:24 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-1052c035-4199-4253-8bd3-97b722eb9e8a tempest-SnapshotsActionsTest-798685141 None] Deleting offline snapshot 83342a68-9975-41b3-8787-70d4e5de1d52 of volume 3efa3889-11f1-4263-8bb3-178ada5775d2 {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:34:24 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-1052c035-4199-4253-8bd3-97b722eb9e8a tempest-SnapshotsActionsTest-798685141 None] snapshot_file for this snap is: volume-3efa3889-11f1-4263-8bb3-178ada5775d2.83342a68-9975-41b3-8787-70d4e5de1d52 {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:34:24 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[91792bd3-0113-4699-b2d9-3a04846fa0c1]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:34:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1052c035-4199-4253-8bd3-97b722eb9e8a tempest-SnapshotsActionsTest-798685141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.83342a68-9975-41b3-8787-70d4e5de1d52 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:24 devstack sudo[102655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.83342a68-9975-41b3-8787-70d4e5de1d52 Jun 23 16:34:24 devstack sudo[102655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:24 devstack sudo[102603]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200.e3e52eec-bc40-42ee-a8b9-9e3f14333817" returned: 0 in 1.250s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:24 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:34:24 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200 {{(pid=93788) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 16:34:24 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] Creating direct copy from snapshot {{(pid=93788) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 16:34:24 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9bc6e3a-4d5d-43aa-9b92-bcaaf12f52f5]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:34:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:24 devstack sudo[102657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200 Jun 23 16:34:24 devstack sudo[102657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:25 devstack sudo[102655]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1052c035-4199-4253-8bd3-97b722eb9e8a tempest-SnapshotsActionsTest-798685141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.83342a68-9975-41b3-8787-70d4e5de1d52" returned: 0 in 0.955s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:25 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-1052c035-4199-4253-8bd3-97b722eb9e8a tempest-SnapshotsActionsTest-798685141 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3efa3889-11f1-4263-8bb3-178ada5775d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:34:25 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0870ca5b-930f-41da-a849-10bad9928d0e]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:34:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1052c035-4199-4253-8bd3-97b722eb9e8a tempest-SnapshotsActionsTest-798685141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:25 devstack sudo[102663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0 Jun 23 16:34:25 devstack sudo[102663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:25 devstack sudo[102657]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200" returned: 0 in 0.997s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:25 devstack cinder-volume[93788]: DEBUG cinder.utils [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] Path /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-db378a89-f545-4cd0-a571-b46921bdf184 not found in is_blk_device check {{(pid=93788) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 16:34:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-db378a89-f545-4cd0-a571-b46921bdf184 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:25 devstack sudo[102673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-db378a89-f545-4cd0-a571-b46921bdf184 Jun 23 16:34:25 devstack sudo[102673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:25 devstack cinder-volume[93788]: INFO cinder.volume.manager [req-b4d7d3f2-42a1-465b-8516-46f4562709ca req-32aba9f4-02fa-46de-be04-65333e2b0228 tempest-AttachVolumeTestJSON-1111501152 None] Terminate volume connection completed successfully. Jun 23 16:34:25 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-b4d7d3f2-42a1-465b-8516-46f4562709ca req-32aba9f4-02fa-46de-be04-65333e2b0228 tempest-AttachVolumeTestJSON-1111501152 None] Deleting attachment 6e768e1f-1137-4fd7-9d58-822d12c3b12f. {{(pid=93788) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 16:34:26 devstack sudo[102663]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1052c035-4199-4253-8bd3-97b722eb9e8a tempest-SnapshotsActionsTest-798685141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0" returned: 0 in 0.922s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:26 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-1052c035-4199-4253-8bd3-97b722eb9e8a tempest-SnapshotsActionsTest-798685141 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3efa3889-11f1-4263-8bb3-178ada5775d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:34:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1052c035-4199-4253-8bd3-97b722eb9e8a tempest-SnapshotsActionsTest-798685141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.83342a68-9975-41b3-8787-70d4e5de1d52 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:26 devstack sudo[102688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.83342a68-9975-41b3-8787-70d4e5de1d52 Jun 23 16:34:26 devstack sudo[102688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:28 devstack sudo[102688]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1052c035-4199-4253-8bd3-97b722eb9e8a tempest-SnapshotsActionsTest-798685141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.83342a68-9975-41b3-8787-70d4e5de1d52" returned: 0 in 2.013s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1052c035-4199-4253-8bd3-97b722eb9e8a tempest-SnapshotsActionsTest-798685141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.83342a68-9975-41b3-8787-70d4e5de1d52 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:28 devstack sudo[102721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.83342a68-9975-41b3-8787-70d4e5de1d52 Jun 23 16:34:28 devstack sudo[102721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:30 devstack sudo[102721]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1052c035-4199-4253-8bd3-97b722eb9e8a tempest-SnapshotsActionsTest-798685141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.83342a68-9975-41b3-8787-70d4e5de1d52" returned: 0 in 2.274s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:30 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-1052c035-4199-4253-8bd3-97b722eb9e8a tempest-SnapshotsActionsTest-798685141 None] Lock "cinder-quobyte-83342a68-9975-41b3-8787-70d4e5de1d52" released by "_delete_snapshot" :: held 6.371s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:34:30 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-1052c035-4199-4253-8bd3-97b722eb9e8a tempest-SnapshotsActionsTest-798685141 None] Lock "cinder-quobyte-3efa3889-11f1-4263-8bb3-178ada5775d2" released by "delete_snapshot" :: held 6.424s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:34:30 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-1052c035-4199-4253-8bd3-97b722eb9e8a tempest-SnapshotsActionsTest-798685141 None] Created reservations ['8b066a4d-4e5c-4c22-a53d-cc7fdaf5559d', 'b36cf614-a5cc-43f5-8d3c-72c950000bc7', '8ac9aeab-fa11-4418-905d-18e080546587', '6aaafb15-1074-4250-af5e-8784b42f2356'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:34:30 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-1052c035-4199-4253-8bd3-97b722eb9e8a tempest-SnapshotsActionsTest-798685141 None] Delete snapshot completed successfully. Jun 23 16:34:30 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-1052c035-4199-4253-8bd3-97b722eb9e8a tempest-SnapshotsActionsTest-798685141 None] Lock "cinder-83342a68-9975-41b3-8787-70d4e5de1d52-delete_snapshot" released by "delete_snapshot" :: held 6.970s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:34:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d345ec65-844c-4cce-af2b-7c28ca52ce0f tempest-SnapshotsActionsTest-171329803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:34:32 devstack sudo[102673]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-db378a89-f545-4cd0-a571-b46921bdf184" returned: 0 in 7.466s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:32 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01369ed-f9b8-4afa-9654-350c24214d16]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:34:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:32 devstack sudo[102803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200 Jun 23 16:34:32 devstack sudo[102803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:33 devstack sudo[102803]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:33 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200" returned: 0 in 1.007s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:33 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] Image conversion details: src /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200, size 1024.00 MB, duration 7.47 sec, destination /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-db378a89-f545-4cd0-a571-b46921bdf184 {{(pid=93788) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 16:34:33 devstack cinder-volume[93788]: INFO cinder.image.image_utils [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] Converted 1024.00 MB image at 137.12 MB/s Jun 23 16:34:33 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-db378a89-f545-4cd0-a571-b46921bdf184 is being set with open permissions: ugo+rw Jun 23 16:34:33 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-db378a89-f545-4cd0-a571-b46921bdf184 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:33 devstack sudo[102809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-db378a89-f545-4cd0-a571-b46921bdf184 Jun 23 16:34:33 devstack sudo[102809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:34 devstack sudo[102809]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-db378a89-f545-4cd0-a571-b46921bdf184" returned: 0 in 0.725s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:34 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] Lock "cinder-quobyte-db378a89-f545-4cd0-a571-b46921bdf184" released by "_copy_volume_from_snapshot" :: held 11.581s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:34:34 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] Lock "cinder-quobyte-e3e52eec-bc40-42ee-a8b9-9e3f14333817-db378a89-f545-4cd0-a571-b46921bdf184" released by "_create_volume_from_snapshot" :: held 11.621s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:34:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.648s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:34:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d345ec65-844c-4cce-af2b-7c28ca52ce0f tempest-SnapshotsActionsTest-171329803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.107s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:34:34 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-d345ec65-844c-4cce-af2b-7c28ca52ce0f tempest-SnapshotsActionsTest-171329803 None] Creating offline snapshot e073c58e-3f43-48c7-a86c-472211281bad of volume 3efa3889-11f1-4263-8bb3-178ada5775d2 {{(pid=93788) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:34:34 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b95f22b-705e-4a52-9498-f9c85419cfc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db378a89-f545-4cd0-a571-b46921bdf184', 'volume_size': 1, 'snapshot_id': 'e3e52eec-bc40-42ee-a8b9-9e3f14333817'}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:34:34 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75878ebb-3233-4051-aea5-6992e5c7cbc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:34:34 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[19dbe115-df74-4400-a2b8-988cf2d38d46]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:34:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d345ec65-844c-4cce-af2b-7c28ca52ce0f tempest-SnapshotsActionsTest-171329803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:34 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] Volume volume-db378a89-f545-4cd0-a571-b46921bdf184 (db378a89-f545-4cd0-a571-b46921bdf184): created successfully Jun 23 16:34:34 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75878ebb-3233-4051-aea5-6992e5c7cbc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:34:34 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] Flow 'volume_create_manager' (d0aa13c2-c44c-4666-bbaf-e145981eac17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:34:34 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-2bec2ddb-e45c-479b-8580-47ffdedae321 tempest-VolumesDeleteCascade-1735160611 None] Created volume successfully. Jun 23 16:34:34 devstack sudo[102812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0 Jun 23 16:34:34 devstack sudo[102812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:35 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-051e9699-0c37-4ead-bccc-35c769c725da tempest-VolumesDeleteCascade-1735160611 None] Acquiring lock "cinder-90c8de0f-e3ca-4eaa-ab70-ba49bc584200-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:34:35 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-051e9699-0c37-4ead-bccc-35c769c725da tempest-VolumesDeleteCascade-1735160611 None] Lock "cinder-90c8de0f-e3ca-4eaa-ab70-ba49bc584200-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:34:35 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-051e9699-0c37-4ead-bccc-35c769c725da tempest-VolumesDeleteCascade-1735160611 None] Performing cascade delete. {{(pid=93788) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 23 16:34:35 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-051e9699-0c37-4ead-bccc-35c769c725da tempest-VolumesDeleteCascade-1735160611 None] Acquiring lock "cinder-e3e52eec-bc40-42ee-a8b9-9e3f14333817-delete_snapshot" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:34:35 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-051e9699-0c37-4ead-bccc-35c769c725da tempest-VolumesDeleteCascade-1735160611 None] Lock "cinder-e3e52eec-bc40-42ee-a8b9-9e3f14333817-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:34:35 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-051e9699-0c37-4ead-bccc-35c769c725da tempest-VolumesDeleteCascade-1735160611 None] Acquiring lock "cinder-quobyte-90c8de0f-e3ca-4eaa-ab70-ba49bc584200" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:34:35 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-051e9699-0c37-4ead-bccc-35c769c725da tempest-VolumesDeleteCascade-1735160611 None] Lock "cinder-quobyte-90c8de0f-e3ca-4eaa-ab70-ba49bc584200" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:34:35 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-051e9699-0c37-4ead-bccc-35c769c725da tempest-VolumesDeleteCascade-1735160611 None] Acquiring lock "cinder-quobyte-e3e52eec-bc40-42ee-a8b9-9e3f14333817" by "_delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:34:35 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-051e9699-0c37-4ead-bccc-35c769c725da tempest-VolumesDeleteCascade-1735160611 None] Lock "cinder-quobyte-e3e52eec-bc40-42ee-a8b9-9e3f14333817" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:34:35 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-051e9699-0c37-4ead-bccc-35c769c725da tempest-VolumesDeleteCascade-1735160611 None] Deleting offline snapshot e3e52eec-bc40-42ee-a8b9-9e3f14333817 of volume 90c8de0f-e3ca-4eaa-ab70-ba49bc584200 {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:34:35 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-051e9699-0c37-4ead-bccc-35c769c725da tempest-VolumesDeleteCascade-1735160611 None] snapshot_file for this snap is: volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200.e3e52eec-bc40-42ee-a8b9-9e3f14333817 {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:34:35 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf91bc6-ce75-4490-996b-7d0e22f7b82c]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:34:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-051e9699-0c37-4ead-bccc-35c769c725da tempest-VolumesDeleteCascade-1735160611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200.e3e52eec-bc40-42ee-a8b9-9e3f14333817 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:35 devstack sudo[102814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200.e3e52eec-bc40-42ee-a8b9-9e3f14333817 Jun 23 16:34:35 devstack sudo[102814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:35 devstack sudo[102812]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d345ec65-844c-4cce-af2b-7c28ca52ce0f tempest-SnapshotsActionsTest-171329803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0" returned: 0 in 1.087s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:35 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-d345ec65-844c-4cce-af2b-7c28ca52ce0f tempest-SnapshotsActionsTest-171329803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3efa3889-11f1-4263-8bb3-178ada5775d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:34:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d345ec65-844c-4cce-af2b-7c28ca52ce0f tempest-SnapshotsActionsTest-171329803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.e073c58e-3f43-48c7-a86c-472211281bad 1G {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:35 devstack sudo[102819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.e073c58e-3f43-48c7-a86c-472211281bad 1G Jun 23 16:34:35 devstack sudo[102819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:36 devstack sudo[102814]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-051e9699-0c37-4ead-bccc-35c769c725da tempest-VolumesDeleteCascade-1735160611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200.e3e52eec-bc40-42ee-a8b9-9e3f14333817" returned: 0 in 1.025s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:36 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-051e9699-0c37-4ead-bccc-35c769c725da tempest-VolumesDeleteCascade-1735160611 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:34:36 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[959b880a-29a1-4e12-a27d-4088b6cd26a1]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:34:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-051e9699-0c37-4ead-bccc-35c769c725da tempest-VolumesDeleteCascade-1735160611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:36 devstack sudo[102825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200 Jun 23 16:34:36 devstack sudo[102825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:36 devstack sudo[102819]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d345ec65-844c-4cce-af2b-7c28ca52ce0f tempest-SnapshotsActionsTest-171329803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.e073c58e-3f43-48c7-a86c-472211281bad 1G" returned: 0 in 1.039s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d345ec65-844c-4cce-af2b-7c28ca52ce0f tempest-SnapshotsActionsTest-171329803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.e073c58e-3f43-48c7-a86c-472211281bad {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:36 devstack sudo[102831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.e073c58e-3f43-48c7-a86c-472211281bad Jun 23 16:34:36 devstack sudo[102831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:37 devstack sudo[102825]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-051e9699-0c37-4ead-bccc-35c769c725da tempest-VolumesDeleteCascade-1735160611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200" returned: 0 in 0.948s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-051e9699-0c37-4ead-bccc-35c769c725da tempest-VolumesDeleteCascade-1735160611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200.e3e52eec-bc40-42ee-a8b9-9e3f14333817 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:37 devstack sudo[102837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200.e3e52eec-bc40-42ee-a8b9-9e3f14333817 Jun 23 16:34:37 devstack sudo[102837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:37 devstack sudo[102831]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d345ec65-844c-4cce-af2b-7c28ca52ce0f tempest-SnapshotsActionsTest-171329803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.e073c58e-3f43-48c7-a86c-472211281bad" returned: 0 in 0.943s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:37 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-d345ec65-844c-4cce-af2b-7c28ca52ce0f tempest-SnapshotsActionsTest-171329803 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.e073c58e-3f43-48c7-a86c-472211281bad is being set with open permissions: ugo+rw Jun 23 16:34:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d345ec65-844c-4cce-af2b-7c28ca52ce0f tempest-SnapshotsActionsTest-171329803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.e073c58e-3f43-48c7-a86c-472211281bad {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:37 devstack sudo[102842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.e073c58e-3f43-48c7-a86c-472211281bad Jun 23 16:34:37 devstack sudo[102842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:38 devstack sudo[102837]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-051e9699-0c37-4ead-bccc-35c769c725da tempest-VolumesDeleteCascade-1735160611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200.e3e52eec-bc40-42ee-a8b9-9e3f14333817" returned: 0 in 0.924s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-051e9699-0c37-4ead-bccc-35c769c725da tempest-VolumesDeleteCascade-1735160611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200.e3e52eec-bc40-42ee-a8b9-9e3f14333817 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:38 devstack sudo[102847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200.e3e52eec-bc40-42ee-a8b9-9e3f14333817 Jun 23 16:34:38 devstack sudo[102847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:38 devstack sudo[102842]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d345ec65-844c-4cce-af2b-7c28ca52ce0f tempest-SnapshotsActionsTest-171329803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.e073c58e-3f43-48c7-a86c-472211281bad" returned: 0 in 0.968s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d345ec65-844c-4cce-af2b-7c28ca52ce0f tempest-SnapshotsActionsTest-171329803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.203s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:34:38 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-d345ec65-844c-4cce-af2b-7c28ca52ce0f tempest-SnapshotsActionsTest-171329803 None] Create snapshot completed successfully Jun 23 16:34:39 devstack sudo[102847]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-051e9699-0c37-4ead-bccc-35c769c725da tempest-VolumesDeleteCascade-1735160611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200.e3e52eec-bc40-42ee-a8b9-9e3f14333817" returned: 0 in 0.890s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:39 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-051e9699-0c37-4ead-bccc-35c769c725da tempest-VolumesDeleteCascade-1735160611 None] Lock "cinder-quobyte-e3e52eec-bc40-42ee-a8b9-9e3f14333817" released by "_delete_snapshot" :: held 3.896s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:34:39 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-051e9699-0c37-4ead-bccc-35c769c725da tempest-VolumesDeleteCascade-1735160611 None] Lock "cinder-quobyte-90c8de0f-e3ca-4eaa-ab70-ba49bc584200" released by "delete_snapshot" :: held 3.924s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:34:39 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-051e9699-0c37-4ead-bccc-35c769c725da tempest-VolumesDeleteCascade-1735160611 None] Created reservations ['a7e0551f-a0aa-4d8c-9e52-732fc062b6c0', 'd20d68c8-6aba-4da9-9288-9802d22cef42', 'b1b2f9b8-a9f0-49c5-b902-47dceeed5e95', '72c91eb7-8518-4be6-aa07-aa59ad13d882'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:34:39 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-051e9699-0c37-4ead-bccc-35c769c725da tempest-VolumesDeleteCascade-1735160611 None] Delete snapshot completed successfully. Jun 23 16:34:39 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-051e9699-0c37-4ead-bccc-35c769c725da tempest-VolumesDeleteCascade-1735160611 None] Lock "cinder-e3e52eec-bc40-42ee-a8b9-9e3f14333817-delete_snapshot" released by "delete_snapshot" :: held 4.093s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:34:39 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-051e9699-0c37-4ead-bccc-35c769c725da tempest-VolumesDeleteCascade-1735160611 None] Snapshots deleted, issuing volume delete {{(pid=93788) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 23 16:34:39 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-051e9699-0c37-4ead-bccc-35c769c725da tempest-VolumesDeleteCascade-1735160611 None] Acquiring lock "cinder-quobyte-90c8de0f-e3ca-4eaa-ab70-ba49bc584200" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:34:39 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-051e9699-0c37-4ead-bccc-35c769c725da tempest-VolumesDeleteCascade-1735160611 None] Lock "cinder-quobyte-90c8de0f-e3ca-4eaa-ab70-ba49bc584200" acquired by "delete_volume" :: waited 0.021s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:34:39 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7ed13a-1ad0-450f-9f2d-80911cd80d6f]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:34:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-051e9699-0c37-4ead-bccc-35c769c725da tempest-VolumesDeleteCascade-1735160611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:39 devstack sudo[102855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200 Jun 23 16:34:39 devstack sudo[102855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:39 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-0c6b7f6e-ed33-4627-9b8b-691fc7f016e8 tempest-SnapshotsActionsTest-798685141 None] Acquiring lock "cinder-e073c58e-3f43-48c7-a86c-472211281bad-delete_snapshot" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:34:40 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-0c6b7f6e-ed33-4627-9b8b-691fc7f016e8 tempest-SnapshotsActionsTest-798685141 None] Lock "cinder-e073c58e-3f43-48c7-a86c-472211281bad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:34:40 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-0c6b7f6e-ed33-4627-9b8b-691fc7f016e8 tempest-SnapshotsActionsTest-798685141 None] Acquiring lock "cinder-quobyte-3efa3889-11f1-4263-8bb3-178ada5775d2" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:34:40 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-0c6b7f6e-ed33-4627-9b8b-691fc7f016e8 tempest-SnapshotsActionsTest-798685141 None] Lock "cinder-quobyte-3efa3889-11f1-4263-8bb3-178ada5775d2" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:34:40 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-0c6b7f6e-ed33-4627-9b8b-691fc7f016e8 tempest-SnapshotsActionsTest-798685141 None] Acquiring lock "cinder-quobyte-e073c58e-3f43-48c7-a86c-472211281bad" by "_delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:34:40 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-0c6b7f6e-ed33-4627-9b8b-691fc7f016e8 tempest-SnapshotsActionsTest-798685141 None] Lock "cinder-quobyte-e073c58e-3f43-48c7-a86c-472211281bad" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:34:40 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-0c6b7f6e-ed33-4627-9b8b-691fc7f016e8 tempest-SnapshotsActionsTest-798685141 None] Deleting offline snapshot e073c58e-3f43-48c7-a86c-472211281bad of volume 3efa3889-11f1-4263-8bb3-178ada5775d2 {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:34:40 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-0c6b7f6e-ed33-4627-9b8b-691fc7f016e8 tempest-SnapshotsActionsTest-798685141 None] snapshot_file for this snap is: volume-3efa3889-11f1-4263-8bb3-178ada5775d2.e073c58e-3f43-48c7-a86c-472211281bad {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:34:40 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd79af1-4b2c-4e1c-af7f-3730df495e83]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:34:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0c6b7f6e-ed33-4627-9b8b-691fc7f016e8 tempest-SnapshotsActionsTest-798685141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.e073c58e-3f43-48c7-a86c-472211281bad {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:40 devstack sudo[102865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.e073c58e-3f43-48c7-a86c-472211281bad Jun 23 16:34:40 devstack sudo[102865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:40 devstack sudo[102855]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-051e9699-0c37-4ead-bccc-35c769c725da tempest-VolumesDeleteCascade-1735160611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200" returned: 0 in 1.035s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-051e9699-0c37-4ead-bccc-35c769c725da tempest-VolumesDeleteCascade-1735160611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:40 devstack sudo[102869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200 Jun 23 16:34:40 devstack sudo[102869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:41 devstack sudo[102865]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0c6b7f6e-ed33-4627-9b8b-691fc7f016e8 tempest-SnapshotsActionsTest-798685141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.e073c58e-3f43-48c7-a86c-472211281bad" returned: 0 in 0.912s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:41 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-0c6b7f6e-ed33-4627-9b8b-691fc7f016e8 tempest-SnapshotsActionsTest-798685141 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3efa3889-11f1-4263-8bb3-178ada5775d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:34:41 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4556b10-b97e-4161-ab2c-cd82a8aeaf2f]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:34:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0c6b7f6e-ed33-4627-9b8b-691fc7f016e8 tempest-SnapshotsActionsTest-798685141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:41 devstack sudo[102869]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-051e9699-0c37-4ead-bccc-35c769c725da tempest-VolumesDeleteCascade-1735160611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-90c8de0f-e3ca-4eaa-ab70-ba49bc584200" returned: 0 in 0.758s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:41 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-051e9699-0c37-4ead-bccc-35c769c725da tempest-VolumesDeleteCascade-1735160611 None] Lock "cinder-quobyte-90c8de0f-e3ca-4eaa-ab70-ba49bc584200" released by "delete_volume" :: held 1.869s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:34:41 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:SELECT=71,cinder:INSERT=27,cinder:UPDATE=74,cinder:DELETE=8 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:34:41 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:UPDATE=79,cinder:SELECT=78,cinder:INSERT=14,cinder:DELETE=6 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:34:41 devstack sudo[102880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0 Jun 23 16:34:41 devstack sudo[102880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:41 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-051e9699-0c37-4ead-bccc-35c769c725da tempest-VolumesDeleteCascade-1735160611 None] Created reservations ['9cb4365a-06d0-4b06-b596-ac0c3a00a4d8', 'd918d738-cc31-4d8b-b218-350812159456', '529f3bca-efc0-44eb-bfe3-6c1a3ed79b22', '67033156-4a1d-47f2-84ef-61b2bf15ff32'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:34:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-051e9699-0c37-4ead-bccc-35c769c725da tempest-VolumesDeleteCascade-1735160611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:34:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-051e9699-0c37-4ead-bccc-35c769c725da tempest-VolumesDeleteCascade-1735160611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:34:41 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-051e9699-0c37-4ead-bccc-35c769c725da tempest-VolumesDeleteCascade-1735160611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:34:41 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-051e9699-0c37-4ead-bccc-35c769c725da tempest-VolumesDeleteCascade-1735160611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:34:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-051e9699-0c37-4ead-bccc-35c769c725da tempest-VolumesDeleteCascade-1735160611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:34:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-051e9699-0c37-4ead-bccc-35c769c725da tempest-VolumesDeleteCascade-1735160611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:41 devstack sudo[102889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:34:41 devstack sudo[102889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:41 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ea12f126-3f3d-4025-a6ac-d8a8360e2fd9 tempest-VolumesDeleteCascade-1735160611 None] Acquiring lock "cinder-db378a89-f545-4cd0-a571-b46921bdf184-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:34:41 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ea12f126-3f3d-4025-a6ac-d8a8360e2fd9 tempest-VolumesDeleteCascade-1735160611 None] Lock "cinder-db378a89-f545-4cd0-a571-b46921bdf184-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:34:42 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ea12f126-3f3d-4025-a6ac-d8a8360e2fd9 tempest-VolumesDeleteCascade-1735160611 None] Acquiring lock "cinder-quobyte-db378a89-f545-4cd0-a571-b46921bdf184" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:34:42 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ea12f126-3f3d-4025-a6ac-d8a8360e2fd9 tempest-VolumesDeleteCascade-1735160611 None] Lock "cinder-quobyte-db378a89-f545-4cd0-a571-b46921bdf184" acquired by "delete_volume" :: waited 0.029s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:34:42 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c7b95c-0288-42c3-9124-457ad42ce03f]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:34:42 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ea12f126-3f3d-4025-a6ac-d8a8360e2fd9 tempest-VolumesDeleteCascade-1735160611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-db378a89-f545-4cd0-a571-b46921bdf184 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:42 devstack sudo[102880]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:42 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0c6b7f6e-ed33-4627-9b8b-691fc7f016e8 tempest-SnapshotsActionsTest-798685141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0" returned: 0 in 1.074s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:42 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-0c6b7f6e-ed33-4627-9b8b-691fc7f016e8 tempest-SnapshotsActionsTest-798685141 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3efa3889-11f1-4263-8bb3-178ada5775d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:34:42 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0c6b7f6e-ed33-4627-9b8b-691fc7f016e8 tempest-SnapshotsActionsTest-798685141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.e073c58e-3f43-48c7-a86c-472211281bad {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:42 devstack sudo[102910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.e073c58e-3f43-48c7-a86c-472211281bad Jun 23 16:34:42 devstack sudo[102910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:42 devstack sudo[102906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-db378a89-f545-4cd0-a571-b46921bdf184 Jun 23 16:34:42 devstack sudo[102906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:42 devstack sudo[102889]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:42 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-051e9699-0c37-4ead-bccc-35c769c725da tempest-VolumesDeleteCascade-1735160611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.341s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:42 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-051e9699-0c37-4ead-bccc-35c769c725da tempest-VolumesDeleteCascade-1735160611 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:34:42 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-051e9699-0c37-4ead-bccc-35c769c725da tempest-VolumesDeleteCascade-1735160611 None] Deleted volume successfully. Jun 23 16:34:42 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-051e9699-0c37-4ead-bccc-35c769c725da tempest-VolumesDeleteCascade-1735160611 None] Lock "cinder-90c8de0f-e3ca-4eaa-ab70-ba49bc584200-delete_volume" released by "delete_volume" :: held 7.732s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:34:43 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-dc3f604f-e651-41fe-90a9-367a9231bd78 tempest-GroupSnapshotsTest-1791257526 None] Group tempest-GroupSnapshotsTest-Group-2113787933: creating Jun 23 16:34:43 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-dc3f604f-e651-41fe-90a9-367a9231bd78 tempest-GroupSnapshotsTest-1791257526 None] Group tempest-GroupSnapshotsTest-Group-2113787933: created successfully Jun 23 16:34:43 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-dc3f604f-e651-41fe-90a9-367a9231bd78 tempest-GroupSnapshotsTest-1791257526 None] Create group completed successfully. Jun 23 16:34:43 devstack sudo[102906]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ea12f126-3f3d-4025-a6ac-d8a8360e2fd9 tempest-VolumesDeleteCascade-1735160611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-db378a89-f545-4cd0-a571-b46921bdf184" returned: 0 in 1.601s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ea12f126-3f3d-4025-a6ac-d8a8360e2fd9 tempest-VolumesDeleteCascade-1735160611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-db378a89-f545-4cd0-a571-b46921bdf184 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:43 devstack sudo[102983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-db378a89-f545-4cd0-a571-b46921bdf184 Jun 23 16:34:43 devstack sudo[102983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:43 devstack sudo[102910]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0c6b7f6e-ed33-4627-9b8b-691fc7f016e8 tempest-SnapshotsActionsTest-798685141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.e073c58e-3f43-48c7-a86c-472211281bad" returned: 0 in 1.779s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0c6b7f6e-ed33-4627-9b8b-691fc7f016e8 tempest-SnapshotsActionsTest-798685141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.e073c58e-3f43-48c7-a86c-472211281bad {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:43 devstack sudo[102988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.e073c58e-3f43-48c7-a86c-472211281bad Jun 23 16:34:43 devstack sudo[102988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:44 devstack sudo[102983]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ea12f126-3f3d-4025-a6ac-d8a8360e2fd9 tempest-VolumesDeleteCascade-1735160611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-db378a89-f545-4cd0-a571-b46921bdf184" returned: 0 in 0.776s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:44 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ea12f126-3f3d-4025-a6ac-d8a8360e2fd9 tempest-VolumesDeleteCascade-1735160611 None] Lock "cinder-quobyte-db378a89-f545-4cd0-a571-b46921bdf184" released by "delete_volume" :: held 2.454s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:34:44 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-ea12f126-3f3d-4025-a6ac-d8a8360e2fd9 tempest-VolumesDeleteCascade-1735160611 None] Created reservations ['9ad7e1e7-d2fa-4cc8-b36e-0801d312a405', '699bc18c-2feb-4459-81eb-3155ae7848b5', '596ea27a-ad06-4236-894d-f140a1b6a3c9', 'a24dba84-3be7-4133-98b4-11cdb40fc4ff'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:34:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ea12f126-3f3d-4025-a6ac-d8a8360e2fd9 tempest-VolumesDeleteCascade-1735160611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:34:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ea12f126-3f3d-4025-a6ac-d8a8360e2fd9 tempest-VolumesDeleteCascade-1735160611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:34:44 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-ea12f126-3f3d-4025-a6ac-d8a8360e2fd9 tempest-VolumesDeleteCascade-1735160611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:34:44 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-ea12f126-3f3d-4025-a6ac-d8a8360e2fd9 tempest-VolumesDeleteCascade-1735160611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:34:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ea12f126-3f3d-4025-a6ac-d8a8360e2fd9 tempest-VolumesDeleteCascade-1735160611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:34:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ea12f126-3f3d-4025-a6ac-d8a8360e2fd9 tempest-VolumesDeleteCascade-1735160611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:44 devstack sudo[102994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:34:44 devstack sudo[102994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:44 devstack sudo[102988]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0c6b7f6e-ed33-4627-9b8b-691fc7f016e8 tempest-SnapshotsActionsTest-798685141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.e073c58e-3f43-48c7-a86c-472211281bad" returned: 0 in 0.893s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:44 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-0c6b7f6e-ed33-4627-9b8b-691fc7f016e8 tempest-SnapshotsActionsTest-798685141 None] Lock "cinder-quobyte-e073c58e-3f43-48c7-a86c-472211281bad" released by "_delete_snapshot" :: held 4.825s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:34:44 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-0c6b7f6e-ed33-4627-9b8b-691fc7f016e8 tempest-SnapshotsActionsTest-798685141 None] Lock "cinder-quobyte-3efa3889-11f1-4263-8bb3-178ada5775d2" released by "delete_snapshot" :: held 4.862s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:34:45 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-0c6b7f6e-ed33-4627-9b8b-691fc7f016e8 tempest-SnapshotsActionsTest-798685141 None] Created reservations ['597362bc-c6f8-4df4-acf2-3c640882713e', '1f22d5bf-778a-49f8-901b-ce1d7cfe39f0', '7f3b2c12-54c9-407a-90a5-149ad4517260', '6295f3d1-a7c2-49f5-9f10-13ea4bea3d2d'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:34:45 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-0c6b7f6e-ed33-4627-9b8b-691fc7f016e8 tempest-SnapshotsActionsTest-798685141 None] Delete snapshot completed successfully. Jun 23 16:34:45 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-0c6b7f6e-ed33-4627-9b8b-691fc7f016e8 tempest-SnapshotsActionsTest-798685141 None] Lock "cinder-e073c58e-3f43-48c7-a86c-472211281bad-delete_snapshot" released by "delete_snapshot" :: held 5.127s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:34:45 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-af71993f-c036-449e-b5a8-7a55562a5181 tempest-GroupSnapshotsTest-1791257526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:34:45 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-af71993f-c036-449e-b5a8-7a55562a5181 tempest-GroupSnapshotsTest-1791257526 None] Flow 'volume_create_manager' (d3e2d6b2-6e1d-4950-972b-34ba3e12d578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:34:45 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-af71993f-c036-449e-b5a8-7a55562a5181 tempest-GroupSnapshotsTest-1791257526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5927062-7e9d-4ee3-86ad-d56d1ec115f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:34:46 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-af71993f-c036-449e-b5a8-7a55562a5181 tempest-GroupSnapshotsTest-1791257526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5927062-7e9d-4ee3-86ad-d56d1ec115f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1976301264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b6831b0d-d096-47a3-bef8-965eee09b9b5,host='devstack@QuobyteHD#QuobyteHD',id=0ce16a28-766a-4024-b50e-6f84a319624d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dce840d5703b4e59846cde5d1d050426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:34:46Z,use_quota=True,user_id='d42dedebf56a4672abe200b243a6ceca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a01eb45-99c2-49b7-a401-b120b0eadefa),volume_type_id=5a01eb45-99c2-49b7-a401-b120b0eadefa)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:34:46 devstack sudo[102994]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:46 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-af71993f-c036-449e-b5a8-7a55562a5181 tempest-GroupSnapshotsTest-1791257526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35777aa7-03ef-4efb-ba4c-ffc1687e9523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:34:46 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-af71993f-c036-449e-b5a8-7a55562a5181 tempest-GroupSnapshotsTest-1791257526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35777aa7-03ef-4efb-ba4c-ffc1687e9523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:34:46 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-af71993f-c036-449e-b5a8-7a55562a5181 tempest-GroupSnapshotsTest-1791257526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddb10b25-df0f-483a-94e6-56784ac4416c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:34:46 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-af71993f-c036-449e-b5a8-7a55562a5181 tempest-GroupSnapshotsTest-1791257526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddb10b25-df0f-483a-94e6-56784ac4416c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ce16a28-766a-4024-b50e-6f84a319624d', 'volume_name': 'volume-0ce16a28-766a-4024-b50e-6f84a319624d', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:34:46 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-af71993f-c036-449e-b5a8-7a55562a5181 tempest-GroupSnapshotsTest-1791257526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (766452f9-93d2-4184-898b-ed776bed682a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:34:46 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-af71993f-c036-449e-b5a8-7a55562a5181 tempest-GroupSnapshotsTest-1791257526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (766452f9-93d2-4184-898b-ed776bed682a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:34:46 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-af71993f-c036-449e-b5a8-7a55562a5181 tempest-GroupSnapshotsTest-1791257526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a99e0b3a-fef0-44fd-b2b7-cb94c555996c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:34:46 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-af71993f-c036-449e-b5a8-7a55562a5181 tempest-GroupSnapshotsTest-1791257526 None] Volume 0ce16a28-766a-4024-b50e-6f84a319624d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ce16a28-766a-4024-b50e-6f84a319624d', 'volume_size': 1} Jun 23 16:34:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-af71993f-c036-449e-b5a8-7a55562a5181 tempest-GroupSnapshotsTest-1791257526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:34:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-af71993f-c036-449e-b5a8-7a55562a5181 tempest-GroupSnapshotsTest-1791257526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:34:46 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-af71993f-c036-449e-b5a8-7a55562a5181 tempest-GroupSnapshotsTest-1791257526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b6831b0d-d096-47a3-bef8-965eee09b9b5,created_at=2026-06-23T14:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1976301264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b6831b0d-d096-47a3-bef8-965eee09b9b5,host='devstack@QuobyteHD#QuobyteHD',id=0ce16a28-766a-4024-b50e-6f84a319624d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dce840d5703b4e59846cde5d1d050426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:34:46Z,use_quota=True,user_id='d42dedebf56a4672abe200b243a6ceca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a01eb45-99c2-49b7-a401-b120b0eadefa),volume_type_id=5a01eb45-99c2-49b7-a401-b120b0eadefa)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:34:46 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-af71993f-c036-449e-b5a8-7a55562a5181 tempest-GroupSnapshotsTest-1791257526 None] Creating volume 0ce16a28-766a-4024-b50e-6f84a319624d {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:34:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-af71993f-c036-449e-b5a8-7a55562a5181 tempest-GroupSnapshotsTest-1791257526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:34:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-af71993f-c036-449e-b5a8-7a55562a5181 tempest-GroupSnapshotsTest-1791257526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:34:46 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-af71993f-c036-449e-b5a8-7a55562a5181 tempest-GroupSnapshotsTest-1791257526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:34:46 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-af71993f-c036-449e-b5a8-7a55562a5181 tempest-GroupSnapshotsTest-1791257526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:34:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-af71993f-c036-449e-b5a8-7a55562a5181 tempest-GroupSnapshotsTest-1791257526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:34:46 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-af71993f-c036-449e-b5a8-7a55562a5181 tempest-GroupSnapshotsTest-1791257526 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:34:46 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-af71993f-c036-449e-b5a8-7a55562a5181 tempest-GroupSnapshotsTest-1791257526 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:34:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-af71993f-c036-449e-b5a8-7a55562a5181 tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ea12f126-3f3d-4025-a6ac-d8a8360e2fd9 tempest-VolumesDeleteCascade-1735160611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.426s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:46 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-ea12f126-3f3d-4025-a6ac-d8a8360e2fd9 tempest-VolumesDeleteCascade-1735160611 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:34:46 devstack sudo[103003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d 1073741824 Jun 23 16:34:46 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-ea12f126-3f3d-4025-a6ac-d8a8360e2fd9 tempest-VolumesDeleteCascade-1735160611 None] Deleted volume successfully. Jun 23 16:34:46 devstack sudo[103003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-541e37b6-b40e-4e2b-966e-8272752889de tempest-SnapshotsActionsTest-171329803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:34:46 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ea12f126-3f3d-4025-a6ac-d8a8360e2fd9 tempest-VolumesDeleteCascade-1735160611 None] Lock "cinder-db378a89-f545-4cd0-a571-b46921bdf184-delete_volume" released by "delete_volume" :: held 4.296s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:34:47 devstack sudo[103003]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-af71993f-c036-449e-b5a8-7a55562a5181 tempest-GroupSnapshotsTest-1791257526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d 1073741824" returned: 0 in 1.117s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-af71993f-c036-449e-b5a8-7a55562a5181 tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:47 devstack sudo[103010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d Jun 23 16:34:47 devstack sudo[103010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:48 devstack sudo[103010]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-af71993f-c036-449e-b5a8-7a55562a5181 tempest-GroupSnapshotsTest-1791257526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d" returned: 0 in 0.731s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:48 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-af71993f-c036-449e-b5a8-7a55562a5181 tempest-GroupSnapshotsTest-1791257526 None] <== create_volume: return (1914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:34:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-af71993f-c036-449e-b5a8-7a55562a5181 tempest-GroupSnapshotsTest-1791257526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.917s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:34:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-541e37b6-b40e-4e2b-966e-8272752889de tempest-SnapshotsActionsTest-171329803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.818s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:34:48 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-541e37b6-b40e-4e2b-966e-8272752889de tempest-SnapshotsActionsTest-171329803 None] Creating offline snapshot 77173280-6bf3-4818-a7bb-1e9b68c77aef of volume 3efa3889-11f1-4263-8bb3-178ada5775d2 {{(pid=93788) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:34:48 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-af71993f-c036-449e-b5a8-7a55562a5181 tempest-GroupSnapshotsTest-1791257526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a99e0b3a-fef0-44fd-b2b7-cb94c555996c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ce16a28-766a-4024-b50e-6f84a319624d', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:34:48 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-af71993f-c036-449e-b5a8-7a55562a5181 tempest-GroupSnapshotsTest-1791257526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c355e1c1-661e-4d12-b3e9-54783520f547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:34:48 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[312f3ccd-68d0-4e67-8211-e429a320e811]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:34:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-541e37b6-b40e-4e2b-966e-8272752889de tempest-SnapshotsActionsTest-171329803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:48 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-af71993f-c036-449e-b5a8-7a55562a5181 tempest-GroupSnapshotsTest-1791257526 None] Volume volume-0ce16a28-766a-4024-b50e-6f84a319624d (0ce16a28-766a-4024-b50e-6f84a319624d): created successfully Jun 23 16:34:48 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-af71993f-c036-449e-b5a8-7a55562a5181 tempest-GroupSnapshotsTest-1791257526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c355e1c1-661e-4d12-b3e9-54783520f547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:34:48 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-af71993f-c036-449e-b5a8-7a55562a5181 tempest-GroupSnapshotsTest-1791257526 None] Flow 'volume_create_manager' (d3e2d6b2-6e1d-4950-972b-34ba3e12d578) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:34:48 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-af71993f-c036-449e-b5a8-7a55562a5181 tempest-GroupSnapshotsTest-1791257526 None] Created volume successfully. Jun 23 16:34:48 devstack sudo[103014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0 Jun 23 16:34:48 devstack sudo[103014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:48 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-5037f71f-2380-4685-8324-7df0e3dc6a48 tempest-GroupSnapshotsTest-1791257526 None] GroupSnapshot 9d9886a8-b872-4453-b412-33f2b4489e92: creating. Jun 23 16:34:48 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5037f71f-2380-4685-8324-7df0e3dc6a48 tempest-GroupSnapshotsTest-1791257526 None] Group snapshot 9d9886a8-b872-4453-b412-33f2b4489e92: creating. {{(pid=93788) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 23 16:34:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5037f71f-2380-4685-8324-7df0e3dc6a48 tempest-GroupSnapshotsTest-1791257526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:34:49 devstack sudo[103014]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-541e37b6-b40e-4e2b-966e-8272752889de tempest-SnapshotsActionsTest-171329803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0" returned: 0 in 0.910s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:49 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-541e37b6-b40e-4e2b-966e-8272752889de tempest-SnapshotsActionsTest-171329803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3efa3889-11f1-4263-8bb3-178ada5775d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:34:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-541e37b6-b40e-4e2b-966e-8272752889de tempest-SnapshotsActionsTest-171329803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.77173280-6bf3-4818-a7bb-1e9b68c77aef 1G {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:49 devstack sudo[103021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.77173280-6bf3-4818-a7bb-1e9b68c77aef 1G Jun 23 16:34:49 devstack sudo[103021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:49 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-4235dc25-5f24-44a4-a5fa-8d1faf24312f tempest-VolumesMetadataTest-860693086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:34:49 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4235dc25-5f24-44a4-a5fa-8d1faf24312f tempest-VolumesMetadataTest-860693086 None] Flow 'volume_create_manager' (d51e1a73-f3ad-4d9e-a49b-248a9660389b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:34:49 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4235dc25-5f24-44a4-a5fa-8d1faf24312f tempest-VolumesMetadataTest-860693086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e131bdaa-9e89-45ab-a989-dc32bd2ae513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:34:49 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4235dc25-5f24-44a4-a5fa-8d1faf24312f tempest-VolumesMetadataTest-860693086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e131bdaa-9e89-45ab-a989-dc32bd2ae513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:34:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-221738392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9db053fa-b3ae-473f-b17a-47e8da299313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8102a62eb3e54c75ba21b174abc73ff2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:34:50Z,use_quota=True,user_id='ce2ce1eac56f42e1a22f3a83a619b167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:34:49 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4235dc25-5f24-44a4-a5fa-8d1faf24312f tempest-VolumesMetadataTest-860693086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdae9b0d-a402-493d-991d-18d591a8078c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:34:49 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4235dc25-5f24-44a4-a5fa-8d1faf24312f tempest-VolumesMetadataTest-860693086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdae9b0d-a402-493d-991d-18d591a8078c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:34:49 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4235dc25-5f24-44a4-a5fa-8d1faf24312f tempest-VolumesMetadataTest-860693086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad3db8ff-a07e-4a96-8c7c-0e2dc630ec44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:34:49 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4235dc25-5f24-44a4-a5fa-8d1faf24312f tempest-VolumesMetadataTest-860693086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad3db8ff-a07e-4a96-8c7c-0e2dc630ec44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9db053fa-b3ae-473f-b17a-47e8da299313', 'volume_name': 'volume-9db053fa-b3ae-473f-b17a-47e8da299313', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:34:49 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4235dc25-5f24-44a4-a5fa-8d1faf24312f tempest-VolumesMetadataTest-860693086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f3e9db3-a664-4448-81b4-304a92f5c6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:34:49 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4235dc25-5f24-44a4-a5fa-8d1faf24312f tempest-VolumesMetadataTest-860693086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f3e9db3-a664-4448-81b4-304a92f5c6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:34:49 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4235dc25-5f24-44a4-a5fa-8d1faf24312f tempest-VolumesMetadataTest-860693086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7f542f1-90f8-4e8a-a4bb-084dfef8f617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:34:49 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-4235dc25-5f24-44a4-a5fa-8d1faf24312f tempest-VolumesMetadataTest-860693086 None] Volume 9db053fa-b3ae-473f-b17a-47e8da299313: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9db053fa-b3ae-473f-b17a-47e8da299313', 'volume_size': 1} Jun 23 16:34:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-4235dc25-5f24-44a4-a5fa-8d1faf24312f tempest-VolumesMetadataTest-860693086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:34:50 devstack sudo[103021]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-541e37b6-b40e-4e2b-966e-8272752889de tempest-SnapshotsActionsTest-171329803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.77173280-6bf3-4818-a7bb-1e9b68c77aef 1G" returned: 0 in 0.954s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-541e37b6-b40e-4e2b-966e-8272752889de tempest-SnapshotsActionsTest-171329803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.77173280-6bf3-4818-a7bb-1e9b68c77aef {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:50 devstack sudo[103026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.77173280-6bf3-4818-a7bb-1e9b68c77aef Jun 23 16:34:50 devstack sudo[103026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:50 devstack sudo[103026]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-541e37b6-b40e-4e2b-966e-8272752889de tempest-SnapshotsActionsTest-171329803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.77173280-6bf3-4818-a7bb-1e9b68c77aef" returned: 0 in 0.702s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:50 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-541e37b6-b40e-4e2b-966e-8272752889de tempest-SnapshotsActionsTest-171329803 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.77173280-6bf3-4818-a7bb-1e9b68c77aef is being set with open permissions: ugo+rw Jun 23 16:34:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-541e37b6-b40e-4e2b-966e-8272752889de tempest-SnapshotsActionsTest-171329803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.77173280-6bf3-4818-a7bb-1e9b68c77aef {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:50 devstack sudo[103031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.77173280-6bf3-4818-a7bb-1e9b68c77aef Jun 23 16:34:50 devstack sudo[103031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:51 devstack sudo[103031]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-541e37b6-b40e-4e2b-966e-8272752889de tempest-SnapshotsActionsTest-171329803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.77173280-6bf3-4818-a7bb-1e9b68c77aef" returned: 0 in 0.709s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-541e37b6-b40e-4e2b-966e-8272752889de tempest-SnapshotsActionsTest-171329803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.399s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:34:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5037f71f-2380-4685-8324-7df0e3dc6a48 tempest-GroupSnapshotsTest-1791257526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.668s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:34:51 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-5037f71f-2380-4685-8324-7df0e3dc6a48 tempest-GroupSnapshotsTest-1791257526 None] Creating offline snapshot 6034a2ac-fac9-4283-9002-78b06ee5e9bc of volume 0ce16a28-766a-4024-b50e-6f84a319624d {{(pid=93788) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:34:51 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-541e37b6-b40e-4e2b-966e-8272752889de tempest-SnapshotsActionsTest-171329803 None] Create snapshot completed successfully Jun 23 16:34:51 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ea2877-bebf-4736-b023-0e7ce0872bf1]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:34:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5037f71f-2380-4685-8324-7df0e3dc6a48 tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:51 devstack sudo[103034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d Jun 23 16:34:51 devstack sudo[103034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:52 devstack sudo[103034]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5037f71f-2380-4685-8324-7df0e3dc6a48 tempest-GroupSnapshotsTest-1791257526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d" returned: 0 in 0.831s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5037f71f-2380-4685-8324-7df0e3dc6a48 tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d.6034a2ac-fac9-4283-9002-78b06ee5e9bc 1G {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:52 devstack sudo[103039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d.6034a2ac-fac9-4283-9002-78b06ee5e9bc 1G Jun 23 16:34:52 devstack sudo[103039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:52 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-a3d352ef-0f19-4ea2-a9fb-a9dac099b098 tempest-SnapshotsActionsTest-798685141 None] Acquiring lock "cinder-77173280-6bf3-4818-a7bb-1e9b68c77aef-delete_snapshot" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:34:52 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-a3d352ef-0f19-4ea2-a9fb-a9dac099b098 tempest-SnapshotsActionsTest-798685141 None] Lock "cinder-77173280-6bf3-4818-a7bb-1e9b68c77aef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:34:52 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-a3d352ef-0f19-4ea2-a9fb-a9dac099b098 tempest-SnapshotsActionsTest-798685141 None] Acquiring lock "cinder-quobyte-3efa3889-11f1-4263-8bb3-178ada5775d2" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:34:52 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-a3d352ef-0f19-4ea2-a9fb-a9dac099b098 tempest-SnapshotsActionsTest-798685141 None] Lock "cinder-quobyte-3efa3889-11f1-4263-8bb3-178ada5775d2" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:34:52 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-a3d352ef-0f19-4ea2-a9fb-a9dac099b098 tempest-SnapshotsActionsTest-798685141 None] Acquiring lock "cinder-quobyte-77173280-6bf3-4818-a7bb-1e9b68c77aef" by "_delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:34:52 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-a3d352ef-0f19-4ea2-a9fb-a9dac099b098 tempest-SnapshotsActionsTest-798685141 None] Lock "cinder-quobyte-77173280-6bf3-4818-a7bb-1e9b68c77aef" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:34:52 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-a3d352ef-0f19-4ea2-a9fb-a9dac099b098 tempest-SnapshotsActionsTest-798685141 None] Deleting offline snapshot 77173280-6bf3-4818-a7bb-1e9b68c77aef of volume 3efa3889-11f1-4263-8bb3-178ada5775d2 {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:34:52 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-a3d352ef-0f19-4ea2-a9fb-a9dac099b098 tempest-SnapshotsActionsTest-798685141 None] snapshot_file for this snap is: volume-3efa3889-11f1-4263-8bb3-178ada5775d2.77173280-6bf3-4818-a7bb-1e9b68c77aef {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:34:52 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0eca2ac-d283-4db8-afb4-68c22540e7f8]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:34:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a3d352ef-0f19-4ea2-a9fb-a9dac099b098 tempest-SnapshotsActionsTest-798685141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.77173280-6bf3-4818-a7bb-1e9b68c77aef {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:52 devstack sudo[103041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.77173280-6bf3-4818-a7bb-1e9b68c77aef Jun 23 16:34:52 devstack sudo[103041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:53 devstack sudo[103039]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:53 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5037f71f-2380-4685-8324-7df0e3dc6a48 tempest-GroupSnapshotsTest-1791257526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d.6034a2ac-fac9-4283-9002-78b06ee5e9bc 1G" returned: 0 in 0.893s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:53 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5037f71f-2380-4685-8324-7df0e3dc6a48 tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ce16a28-766a-4024-b50e-6f84a319624d -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d.6034a2ac-fac9-4283-9002-78b06ee5e9bc {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:53 devstack sudo[103047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ce16a28-766a-4024-b50e-6f84a319624d -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d.6034a2ac-fac9-4283-9002-78b06ee5e9bc Jun 23 16:34:53 devstack sudo[103047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:53 devstack sudo[103041]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:53 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a3d352ef-0f19-4ea2-a9fb-a9dac099b098 tempest-SnapshotsActionsTest-798685141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.77173280-6bf3-4818-a7bb-1e9b68c77aef" returned: 0 in 0.834s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:53 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-a3d352ef-0f19-4ea2-a9fb-a9dac099b098 tempest-SnapshotsActionsTest-798685141 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3efa3889-11f1-4263-8bb3-178ada5775d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:34:53 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fde41c1-74d5-4ffc-812f-0088ddd4d46f]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:34:53 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a3d352ef-0f19-4ea2-a9fb-a9dac099b098 tempest-SnapshotsActionsTest-798685141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:53 devstack sudo[103052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0 Jun 23 16:34:53 devstack sudo[103052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:54 devstack sudo[103047]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5037f71f-2380-4685-8324-7df0e3dc6a48 tempest-GroupSnapshotsTest-1791257526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ce16a28-766a-4024-b50e-6f84a319624d -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d.6034a2ac-fac9-4283-9002-78b06ee5e9bc" returned: 0 in 0.783s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:54 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-5037f71f-2380-4685-8324-7df0e3dc6a48 tempest-GroupSnapshotsTest-1791257526 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d.6034a2ac-fac9-4283-9002-78b06ee5e9bc is being set with open permissions: ugo+rw: NotImplementedError Jun 23 16:34:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5037f71f-2380-4685-8324-7df0e3dc6a48 tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d.6034a2ac-fac9-4283-9002-78b06ee5e9bc {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:54 devstack sudo[103057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d.6034a2ac-fac9-4283-9002-78b06ee5e9bc Jun 23 16:34:54 devstack sudo[103057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:54 devstack sudo[103052]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a3d352ef-0f19-4ea2-a9fb-a9dac099b098 tempest-SnapshotsActionsTest-798685141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0" returned: 0 in 0.851s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:54 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-a3d352ef-0f19-4ea2-a9fb-a9dac099b098 tempest-SnapshotsActionsTest-798685141 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3efa3889-11f1-4263-8bb3-178ada5775d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:34:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a3d352ef-0f19-4ea2-a9fb-a9dac099b098 tempest-SnapshotsActionsTest-798685141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.77173280-6bf3-4818-a7bb-1e9b68c77aef {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:54 devstack sudo[103062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.77173280-6bf3-4818-a7bb-1e9b68c77aef Jun 23 16:34:54 devstack sudo[103062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:54 devstack sudo[103057]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5037f71f-2380-4685-8324-7df0e3dc6a48 tempest-GroupSnapshotsTest-1791257526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d.6034a2ac-fac9-4283-9002-78b06ee5e9bc" returned: 0 in 0.713s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5037f71f-2380-4685-8324-7df0e3dc6a48 tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:54 devstack sudo[103065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d.info Jun 23 16:34:54 devstack sudo[103065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:55 devstack sudo[103062]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a3d352ef-0f19-4ea2-a9fb-a9dac099b098 tempest-SnapshotsActionsTest-798685141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.77173280-6bf3-4818-a7bb-1e9b68c77aef" returned: 0 in 0.909s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a3d352ef-0f19-4ea2-a9fb-a9dac099b098 tempest-SnapshotsActionsTest-798685141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.77173280-6bf3-4818-a7bb-1e9b68c77aef {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:55 devstack sudo[103070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.77173280-6bf3-4818-a7bb-1e9b68c77aef Jun 23 16:34:55 devstack sudo[103070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:55 devstack sudo[103065]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5037f71f-2380-4685-8324-7df0e3dc6a48 tempest-GroupSnapshotsTest-1791257526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d.info" returned: 0 in 0.779s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:55 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-5037f71f-2380-4685-8324-7df0e3dc6a48 tempest-GroupSnapshotsTest-1791257526 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d.info is being set with open permissions: ugo+rw: NotImplementedError Jun 23 16:34:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5037f71f-2380-4685-8324-7df0e3dc6a48 tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:55 devstack sudo[103073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d.info Jun 23 16:34:55 devstack sudo[103073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:56 devstack sudo[103070]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a3d352ef-0f19-4ea2-a9fb-a9dac099b098 tempest-SnapshotsActionsTest-798685141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.77173280-6bf3-4818-a7bb-1e9b68c77aef" returned: 0 in 0.775s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:56 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-a3d352ef-0f19-4ea2-a9fb-a9dac099b098 tempest-SnapshotsActionsTest-798685141 None] Lock "cinder-quobyte-77173280-6bf3-4818-a7bb-1e9b68c77aef" released by "_delete_snapshot" :: held 3.484s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:34:56 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-a3d352ef-0f19-4ea2-a9fb-a9dac099b098 tempest-SnapshotsActionsTest-798685141 None] Lock "cinder-quobyte-3efa3889-11f1-4263-8bb3-178ada5775d2" released by "delete_snapshot" :: held 3.514s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:34:56 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-a3d352ef-0f19-4ea2-a9fb-a9dac099b098 tempest-SnapshotsActionsTest-798685141 None] Created reservations ['54e9bc76-58a6-4bc4-8ea8-b8549291b149', '4664a98c-7dd0-4750-9c56-7ca86356367f', '9d2006fb-965e-4bba-8e8d-101beec2a190', '94fe88f2-1300-4b9e-8335-af59bfaeeaed'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:34:56 devstack sudo[103073]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5037f71f-2380-4685-8324-7df0e3dc6a48 tempest-GroupSnapshotsTest-1791257526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d.info" returned: 0 in 0.740s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5037f71f-2380-4685-8324-7df0e3dc6a48 tempest-GroupSnapshotsTest-1791257526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.849s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:34:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-4235dc25-5f24-44a4-a5fa-8d1faf24312f tempest-VolumesMetadataTest-860693086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.590s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:34:56 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-4235dc25-5f24-44a4-a5fa-8d1faf24312f tempest-VolumesMetadataTest-860693086 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:34:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-221738392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9db053fa-b3ae-473f-b17a-47e8da299313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8102a62eb3e54c75ba21b174abc73ff2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:34:50Z,use_quota=True,user_id='ce2ce1eac56f42e1a22f3a83a619b167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:34:56 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-4235dc25-5f24-44a4-a5fa-8d1faf24312f tempest-VolumesMetadataTest-860693086 None] Creating volume 9db053fa-b3ae-473f-b17a-47e8da299313 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:34:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-4235dc25-5f24-44a4-a5fa-8d1faf24312f tempest-VolumesMetadataTest-860693086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:34:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-4235dc25-5f24-44a4-a5fa-8d1faf24312f tempest-VolumesMetadataTest-860693086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:34:56 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-4235dc25-5f24-44a4-a5fa-8d1faf24312f tempest-VolumesMetadataTest-860693086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:34:56 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-4235dc25-5f24-44a4-a5fa-8d1faf24312f tempest-VolumesMetadataTest-860693086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:34:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-4235dc25-5f24-44a4-a5fa-8d1faf24312f tempest-VolumesMetadataTest-860693086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:34:56 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-4235dc25-5f24-44a4-a5fa-8d1faf24312f tempest-VolumesMetadataTest-860693086 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:34:56 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-4235dc25-5f24-44a4-a5fa-8d1faf24312f tempest-VolumesMetadataTest-860693086 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:34:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4235dc25-5f24-44a4-a5fa-8d1faf24312f tempest-VolumesMetadataTest-860693086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9db053fa-b3ae-473f-b17a-47e8da299313 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:56 devstack sudo[103078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9db053fa-b3ae-473f-b17a-47e8da299313 1073741824 Jun 23 16:34:56 devstack sudo[103078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:56 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-a3d352ef-0f19-4ea2-a9fb-a9dac099b098 tempest-SnapshotsActionsTest-798685141 None] Delete snapshot completed successfully. Jun 23 16:34:56 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-a3d352ef-0f19-4ea2-a9fb-a9dac099b098 tempest-SnapshotsActionsTest-798685141 None] Lock "cinder-77173280-6bf3-4818-a7bb-1e9b68c77aef-delete_snapshot" released by "delete_snapshot" :: held 3.763s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:34:56 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-5037f71f-2380-4685-8324-7df0e3dc6a48 tempest-GroupSnapshotsTest-1791257526 None] group_snapshot 9d9886a8-b872-4453-b412-33f2b4489e92: created successfully Jun 23 16:34:57 devstack sudo[103078]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4235dc25-5f24-44a4-a5fa-8d1faf24312f tempest-VolumesMetadataTest-860693086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9db053fa-b3ae-473f-b17a-47e8da299313 1073741824" returned: 0 in 0.980s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:57 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-2f61dc20-5448-46a0-85ca-32db3a562428 tempest-SnapshotsActionsTest-171329803 None] Acquiring lock "cinder-300f904b-6ed6-4aae-a8bf-52765365fdc0-delete_snapshot" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:34:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4235dc25-5f24-44a4-a5fa-8d1faf24312f tempest-VolumesMetadataTest-860693086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9db053fa-b3ae-473f-b17a-47e8da299313 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:57 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-2f61dc20-5448-46a0-85ca-32db3a562428 tempest-SnapshotsActionsTest-171329803 None] Lock "cinder-300f904b-6ed6-4aae-a8bf-52765365fdc0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:34:57 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-2f61dc20-5448-46a0-85ca-32db3a562428 tempest-SnapshotsActionsTest-171329803 None] Acquiring lock "cinder-quobyte-3efa3889-11f1-4263-8bb3-178ada5775d2" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:34:57 devstack sudo[103084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9db053fa-b3ae-473f-b17a-47e8da299313 Jun 23 16:34:57 devstack sudo[103084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:57 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-2f61dc20-5448-46a0-85ca-32db3a562428 tempest-SnapshotsActionsTest-171329803 None] Lock "cinder-quobyte-3efa3889-11f1-4263-8bb3-178ada5775d2" acquired by "delete_snapshot" :: waited 0.033s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:34:57 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-2f61dc20-5448-46a0-85ca-32db3a562428 tempest-SnapshotsActionsTest-171329803 None] Acquiring lock "cinder-quobyte-300f904b-6ed6-4aae-a8bf-52765365fdc0" by "_delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:34:57 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-2f61dc20-5448-46a0-85ca-32db3a562428 tempest-SnapshotsActionsTest-171329803 None] Lock "cinder-quobyte-300f904b-6ed6-4aae-a8bf-52765365fdc0" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:34:57 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-2f61dc20-5448-46a0-85ca-32db3a562428 tempest-SnapshotsActionsTest-171329803 None] Deleting offline snapshot 300f904b-6ed6-4aae-a8bf-52765365fdc0 of volume 3efa3889-11f1-4263-8bb3-178ada5775d2 {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:34:57 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-2f61dc20-5448-46a0-85ca-32db3a562428 tempest-SnapshotsActionsTest-171329803 None] snapshot_file for this snap is: volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0 {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:34:57 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce91161c-a6cf-4b08-be85-29e571065989]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:34:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2f61dc20-5448-46a0-85ca-32db3a562428 tempest-SnapshotsActionsTest-171329803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:57 devstack sudo[103086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0 Jun 23 16:34:57 devstack sudo[103086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:58 devstack sudo[103084]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4235dc25-5f24-44a4-a5fa-8d1faf24312f tempest-VolumesMetadataTest-860693086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9db053fa-b3ae-473f-b17a-47e8da299313" returned: 0 in 0.709s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:58 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-4235dc25-5f24-44a4-a5fa-8d1faf24312f tempest-VolumesMetadataTest-860693086 None] <== create_volume: return (1748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:34:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-4235dc25-5f24-44a4-a5fa-8d1faf24312f tempest-VolumesMetadataTest-860693086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.751s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:34:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4235dc25-5f24-44a4-a5fa-8d1faf24312f tempest-VolumesMetadataTest-860693086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7f542f1-90f8-4e8a-a4bb-084dfef8f617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9db053fa-b3ae-473f-b17a-47e8da299313', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:34:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4235dc25-5f24-44a4-a5fa-8d1faf24312f tempest-VolumesMetadataTest-860693086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (312efe83-8348-4b2f-8569-3fa42eb48233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:34:58 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-4235dc25-5f24-44a4-a5fa-8d1faf24312f tempest-VolumesMetadataTest-860693086 None] Volume volume-9db053fa-b3ae-473f-b17a-47e8da299313 (9db053fa-b3ae-473f-b17a-47e8da299313): created successfully Jun 23 16:34:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4235dc25-5f24-44a4-a5fa-8d1faf24312f tempest-VolumesMetadataTest-860693086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (312efe83-8348-4b2f-8569-3fa42eb48233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:34:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4235dc25-5f24-44a4-a5fa-8d1faf24312f tempest-VolumesMetadataTest-860693086 None] Flow 'volume_create_manager' (d51e1a73-f3ad-4d9e-a49b-248a9660389b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:34:58 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-4235dc25-5f24-44a4-a5fa-8d1faf24312f tempest-VolumesMetadataTest-860693086 None] Created volume successfully. Jun 23 16:34:58 devstack sudo[103086]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2f61dc20-5448-46a0-85ca-32db3a562428 tempest-SnapshotsActionsTest-171329803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0" returned: 0 in 0.889s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:58 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-2f61dc20-5448-46a0-85ca-32db3a562428 tempest-SnapshotsActionsTest-171329803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3efa3889-11f1-4263-8bb3-178ada5775d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:34:58 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2901008-0686-48f7-a31b-9ceebdaf4695]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:34:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2f61dc20-5448-46a0-85ca-32db3a562428 tempest-SnapshotsActionsTest-171329803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:58 devstack sudo[103093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2 Jun 23 16:34:58 devstack sudo[103093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-733941c5-e1da-4302-94c2-e10def5043cb tempest-GroupSnapshotsTest-1791257526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:34:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-733941c5-e1da-4302-94c2-e10def5043cb tempest-GroupSnapshotsTest-1791257526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:34:58 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-733941c5-e1da-4302-94c2-e10def5043cb tempest-GroupSnapshotsTest-1791257526 None] Acquiring lock "cinder-quobyte-6034a2ac-fac9-4283-9002-78b06ee5e9bc-387de6d0-62c8-4e33-b6cd-d4fc67f38ae9" by "_create_volume_from_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:34:58 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-733941c5-e1da-4302-94c2-e10def5043cb tempest-GroupSnapshotsTest-1791257526 None] Lock "cinder-quobyte-6034a2ac-fac9-4283-9002-78b06ee5e9bc-387de6d0-62c8-4e33-b6cd-d4fc67f38ae9" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:34:58 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-733941c5-e1da-4302-94c2-e10def5043cb tempest-GroupSnapshotsTest-1791257526 None] Creating volume 387de6d0-62c8-4e33-b6cd-d4fc67f38ae9 from snapshot 6034a2ac-fac9-4283-9002-78b06ee5e9bc {{(pid=93788) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 16:34:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-733941c5-e1da-4302-94c2-e10def5043cb tempest-GroupSnapshotsTest-1791257526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:34:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-733941c5-e1da-4302-94c2-e10def5043cb tempest-GroupSnapshotsTest-1791257526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:34:58 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-733941c5-e1da-4302-94c2-e10def5043cb tempest-GroupSnapshotsTest-1791257526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:34:58 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-733941c5-e1da-4302-94c2-e10def5043cb tempest-GroupSnapshotsTest-1791257526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:34:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-733941c5-e1da-4302-94c2-e10def5043cb tempest-GroupSnapshotsTest-1791257526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:34:58 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-733941c5-e1da-4302-94c2-e10def5043cb tempest-GroupSnapshotsTest-1791257526 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:34:58 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-733941c5-e1da-4302-94c2-e10def5043cb tempest-GroupSnapshotsTest-1791257526 None] Acquiring lock "cinder-quobyte-387de6d0-62c8-4e33-b6cd-d4fc67f38ae9" by "_copy_volume_from_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:34:58 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-733941c5-e1da-4302-94c2-e10def5043cb tempest-GroupSnapshotsTest-1791257526 None] Lock "cinder-quobyte-387de6d0-62c8-4e33-b6cd-d4fc67f38ae9" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:34:58 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-733941c5-e1da-4302-94c2-e10def5043cb tempest-GroupSnapshotsTest-1791257526 None] snapshot: 6034a2ac-fac9-4283-9002-78b06ee5e9bc, volume: 387de6d0-62c8-4e33-b6cd-d4fc67f38ae9, {{(pid=93788) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 16:34:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-733941c5-e1da-4302-94c2-e10def5043cb tempest-GroupSnapshotsTest-1791257526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:34:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-733941c5-e1da-4302-94c2-e10def5043cb tempest-GroupSnapshotsTest-1791257526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:34:58 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-733941c5-e1da-4302-94c2-e10def5043cb tempest-GroupSnapshotsTest-1791257526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:34:58 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-733941c5-e1da-4302-94c2-e10def5043cb tempest-GroupSnapshotsTest-1791257526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:34:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-733941c5-e1da-4302-94c2-e10def5043cb tempest-GroupSnapshotsTest-1791257526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:34:58 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e33a65-4fdb-4626-8d14-0900e225d680]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:34:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-733941c5-e1da-4302-94c2-e10def5043cb tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d.6034a2ac-fac9-4283-9002-78b06ee5e9bc {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:58 devstack sudo[103095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d.6034a2ac-fac9-4283-9002-78b06ee5e9bc Jun 23 16:34:58 devstack sudo[103095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:59 devstack sudo[103093]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2f61dc20-5448-46a0-85ca-32db3a562428 tempest-SnapshotsActionsTest-171329803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2" returned: 0 in 0.860s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2f61dc20-5448-46a0-85ca-32db3a562428 tempest-SnapshotsActionsTest-171329803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:59 devstack sudo[103100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0 Jun 23 16:34:59 devstack sudo[103100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:34:59 devstack sudo[103095]: pam_unix(sudo:session): session closed for user root Jun 23 16:34:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-733941c5-e1da-4302-94c2-e10def5043cb tempest-GroupSnapshotsTest-1791257526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d.6034a2ac-fac9-4283-9002-78b06ee5e9bc" returned: 0 in 0.931s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:34:59 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-733941c5-e1da-4302-94c2-e10def5043cb tempest-GroupSnapshotsTest-1791257526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ce16a28-766a-4024-b50e-6f84a319624d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:34:59 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-733941c5-e1da-4302-94c2-e10def5043cb tempest-GroupSnapshotsTest-1791257526 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d {{(pid=93788) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 16:34:59 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-733941c5-e1da-4302-94c2-e10def5043cb tempest-GroupSnapshotsTest-1791257526 None] Creating direct copy from snapshot {{(pid=93788) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 16:34:59 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc4b70e-2fc4-4959-9b28-ca3f9402fcbd]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:34:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-733941c5-e1da-4302-94c2-e10def5043cb tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:34:59 devstack sudo[103105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d Jun 23 16:34:59 devstack sudo[103105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:35:00 devstack sudo[103100]: pam_unix(sudo:session): session closed for user root Jun 23 16:35:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2f61dc20-5448-46a0-85ca-32db3a562428 tempest-SnapshotsActionsTest-171329803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0" returned: 0 in 0.928s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:35:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2f61dc20-5448-46a0-85ca-32db3a562428 tempest-SnapshotsActionsTest-171329803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:35:00 devstack sudo[103111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0 Jun 23 16:35:00 devstack sudo[103111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:35:00 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-f324ccc9-b889-4deb-9398-00dbe17df3ef tempest-VolumesMetadataTest-860693086 None] Acquiring lock "cinder-9db053fa-b3ae-473f-b17a-47e8da299313-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:35:00 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-f324ccc9-b889-4deb-9398-00dbe17df3ef tempest-VolumesMetadataTest-860693086 None] Lock "cinder-9db053fa-b3ae-473f-b17a-47e8da299313-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:35:00 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-f324ccc9-b889-4deb-9398-00dbe17df3ef tempest-VolumesMetadataTest-860693086 None] Acquiring lock "cinder-quobyte-9db053fa-b3ae-473f-b17a-47e8da299313" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:35:00 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-f324ccc9-b889-4deb-9398-00dbe17df3ef tempest-VolumesMetadataTest-860693086 None] Lock "cinder-quobyte-9db053fa-b3ae-473f-b17a-47e8da299313" acquired by "delete_volume" :: waited 0.022s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:35:00 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[74528500-1ea5-41d7-a0f4-1b319f90e5c0]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:35:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f324ccc9-b889-4deb-9398-00dbe17df3ef tempest-VolumesMetadataTest-860693086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9db053fa-b3ae-473f-b17a-47e8da299313 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:35:00 devstack sudo[103105]: pam_unix(sudo:session): session closed for user root Jun 23 16:35:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-733941c5-e1da-4302-94c2-e10def5043cb tempest-GroupSnapshotsTest-1791257526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d" returned: 0 in 0.893s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:35:00 devstack cinder-volume[93788]: DEBUG cinder.utils [None req-733941c5-e1da-4302-94c2-e10def5043cb tempest-GroupSnapshotsTest-1791257526 None] Path /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-387de6d0-62c8-4e33-b6cd-d4fc67f38ae9 not found in is_blk_device check {{(pid=93788) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 16:35:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-733941c5-e1da-4302-94c2-e10def5043cb tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-387de6d0-62c8-4e33-b6cd-d4fc67f38ae9 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:35:00 devstack sudo[103117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9db053fa-b3ae-473f-b17a-47e8da299313 Jun 23 16:35:00 devstack sudo[103117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:35:00 devstack sudo[103118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-387de6d0-62c8-4e33-b6cd-d4fc67f38ae9 Jun 23 16:35:00 devstack sudo[103118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:35:01 devstack sudo[103111]: pam_unix(sudo:session): session closed for user root Jun 23 16:35:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2f61dc20-5448-46a0-85ca-32db3a562428 tempest-SnapshotsActionsTest-171329803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2.300f904b-6ed6-4aae-a8bf-52765365fdc0" returned: 0 in 0.780s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:35:01 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-2f61dc20-5448-46a0-85ca-32db3a562428 tempest-SnapshotsActionsTest-171329803 None] Lock "cinder-quobyte-300f904b-6ed6-4aae-a8bf-52765365fdc0" released by "_delete_snapshot" :: held 3.610s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:35:01 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-2f61dc20-5448-46a0-85ca-32db3a562428 tempest-SnapshotsActionsTest-171329803 None] Lock "cinder-quobyte-3efa3889-11f1-4263-8bb3-178ada5775d2" released by "delete_snapshot" :: held 3.642s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:35:01 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-2f61dc20-5448-46a0-85ca-32db3a562428 tempest-SnapshotsActionsTest-171329803 None] Created reservations ['3ff022f8-de1e-43d0-aea1-5d23c3ded763', '89836026-8f69-4d6e-acae-7f9c6d979f91', '2cc16200-f8cd-4cbe-8d14-0fea46802c94', '9cfbbc16-12f5-4c47-902f-93fe26c7928b'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:35:01 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-2f61dc20-5448-46a0-85ca-32db3a562428 tempest-SnapshotsActionsTest-171329803 None] Delete snapshot completed successfully. Jun 23 16:35:01 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-2f61dc20-5448-46a0-85ca-32db3a562428 tempest-SnapshotsActionsTest-171329803 None] Lock "cinder-300f904b-6ed6-4aae-a8bf-52765365fdc0-delete_snapshot" released by "delete_snapshot" :: held 3.841s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:35:01 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:35:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:35:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:35:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:35:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:35:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:35:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:35:01 devstack sudo[103117]: pam_unix(sudo:session): session closed for user root Jun 23 16:35:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f324ccc9-b889-4deb-9398-00dbe17df3ef tempest-VolumesMetadataTest-860693086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9db053fa-b3ae-473f-b17a-47e8da299313" returned: 0 in 0.848s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:35:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f324ccc9-b889-4deb-9398-00dbe17df3ef tempest-VolumesMetadataTest-860693086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9db053fa-b3ae-473f-b17a-47e8da299313 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:35:01 devstack sudo[103129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:35:01 devstack sudo[103129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:35:01 devstack sudo[103130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9db053fa-b3ae-473f-b17a-47e8da299313 Jun 23 16:35:01 devstack sudo[103130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:35:02 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-f4550449-f6c3-40a8-b562-35d7c1d6522b tempest-SnapshotsActionsTest-171329803 None] Acquiring lock "cinder-3efa3889-11f1-4263-8bb3-178ada5775d2-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:35:02 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-f4550449-f6c3-40a8-b562-35d7c1d6522b tempest-SnapshotsActionsTest-171329803 None] Lock "cinder-3efa3889-11f1-4263-8bb3-178ada5775d2-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:35:02 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-f4550449-f6c3-40a8-b562-35d7c1d6522b tempest-SnapshotsActionsTest-171329803 None] Acquiring lock "cinder-quobyte-3efa3889-11f1-4263-8bb3-178ada5775d2" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:35:02 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-f4550449-f6c3-40a8-b562-35d7c1d6522b tempest-SnapshotsActionsTest-171329803 None] Lock "cinder-quobyte-3efa3889-11f1-4263-8bb3-178ada5775d2" acquired by "delete_volume" :: waited 0.076s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:35:02 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d161ee92-c255-49f3-baa5-0c671de72aa8]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:35:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f4550449-f6c3-40a8-b562-35d7c1d6522b tempest-SnapshotsActionsTest-171329803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:35:03 devstack sudo[103129]: pam_unix(sudo:session): session closed for user root Jun 23 16:35:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.852s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:35:03 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:35:03 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager._thread_info {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:35:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread count: 8 {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 16:35:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread info: [<_MainThread(MainThread, started 126303828988032)>, , , , , , , ] {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 16:35:03 devstack sudo[103145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2 Jun 23 16:35:03 devstack sudo[103145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:35:03 devstack sudo[103130]: pam_unix(sudo:session): session closed for user root Jun 23 16:35:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f324ccc9-b889-4deb-9398-00dbe17df3ef tempest-VolumesMetadataTest-860693086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9db053fa-b3ae-473f-b17a-47e8da299313" returned: 0 in 2.411s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:35:03 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-f324ccc9-b889-4deb-9398-00dbe17df3ef tempest-VolumesMetadataTest-860693086 None] Lock "cinder-quobyte-9db053fa-b3ae-473f-b17a-47e8da299313" released by "delete_volume" :: held 3.360s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:35:04 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-f324ccc9-b889-4deb-9398-00dbe17df3ef tempest-VolumesMetadataTest-860693086 None] Created reservations ['870ba5de-badf-4ca7-97b1-22eccf6df310', '91bec48a-e0b9-4470-a833-af2ba9b475f4', 'c556045a-8dab-4510-abc8-0c3a983908ad', '2aa64f2e-2e34-449d-9482-f507a7dd3c9a'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:35:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f324ccc9-b889-4deb-9398-00dbe17df3ef tempest-VolumesMetadataTest-860693086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:35:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f324ccc9-b889-4deb-9398-00dbe17df3ef tempest-VolumesMetadataTest-860693086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:35:04 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-f324ccc9-b889-4deb-9398-00dbe17df3ef tempest-VolumesMetadataTest-860693086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:35:04 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-f324ccc9-b889-4deb-9398-00dbe17df3ef tempest-VolumesMetadataTest-860693086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:35:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f324ccc9-b889-4deb-9398-00dbe17df3ef tempest-VolumesMetadataTest-860693086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:35:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f324ccc9-b889-4deb-9398-00dbe17df3ef tempest-VolumesMetadataTest-860693086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:35:04 devstack sudo[103148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:35:04 devstack sudo[103148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:35:05 devstack sudo[103145]: pam_unix(sudo:session): session closed for user root Jun 23 16:35:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f4550449-f6c3-40a8-b562-35d7c1d6522b tempest-SnapshotsActionsTest-171329803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2" returned: 0 in 2.263s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:35:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f4550449-f6c3-40a8-b562-35d7c1d6522b tempest-SnapshotsActionsTest-171329803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:35:05 devstack sudo[103153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2 Jun 23 16:35:05 devstack sudo[103153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:35:06 devstack sudo[103148]: pam_unix(sudo:session): session closed for user root Jun 23 16:35:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f324ccc9-b889-4deb-9398-00dbe17df3ef tempest-VolumesMetadataTest-860693086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 2.786s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:35:07 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-f324ccc9-b889-4deb-9398-00dbe17df3ef tempest-VolumesMetadataTest-860693086 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:35:07 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-f324ccc9-b889-4deb-9398-00dbe17df3ef tempest-VolumesMetadataTest-860693086 None] Deleted volume successfully. Jun 23 16:35:07 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-f324ccc9-b889-4deb-9398-00dbe17df3ef tempest-VolumesMetadataTest-860693086 None] Lock "cinder-9db053fa-b3ae-473f-b17a-47e8da299313-delete_volume" released by "delete_volume" :: held 6.685s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:35:07 devstack sudo[103153]: pam_unix(sudo:session): session closed for user root Jun 23 16:35:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f4550449-f6c3-40a8-b562-35d7c1d6522b tempest-SnapshotsActionsTest-171329803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3efa3889-11f1-4263-8bb3-178ada5775d2" returned: 0 in 2.145s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:35:07 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-f4550449-f6c3-40a8-b562-35d7c1d6522b tempest-SnapshotsActionsTest-171329803 None] Lock "cinder-quobyte-3efa3889-11f1-4263-8bb3-178ada5775d2" released by "delete_volume" :: held 4.663s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:35:07 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-f4550449-f6c3-40a8-b562-35d7c1d6522b tempest-SnapshotsActionsTest-171329803 None] Created reservations ['3e6c800f-2ce0-4850-9158-b9be7592fbff', '3787ed5f-8901-462c-acc0-4ec56f9dcc65', 'f2530974-9038-4b82-b58e-b749949aef80', 'e9d1f0fe-49d5-4039-8b8d-971c9853c4fa'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:35:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f4550449-f6c3-40a8-b562-35d7c1d6522b tempest-SnapshotsActionsTest-171329803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:35:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f4550449-f6c3-40a8-b562-35d7c1d6522b tempest-SnapshotsActionsTest-171329803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:35:07 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-f4550449-f6c3-40a8-b562-35d7c1d6522b tempest-SnapshotsActionsTest-171329803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:35:07 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-f4550449-f6c3-40a8-b562-35d7c1d6522b tempest-SnapshotsActionsTest-171329803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:35:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f4550449-f6c3-40a8-b562-35d7c1d6522b tempest-SnapshotsActionsTest-171329803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:35:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f4550449-f6c3-40a8-b562-35d7c1d6522b tempest-SnapshotsActionsTest-171329803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:35:07 devstack sudo[103164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:35:07 devstack sudo[103164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:35:07 devstack sudo[103118]: pam_unix(sudo:session): session closed for user root Jun 23 16:35:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-733941c5-e1da-4302-94c2-e10def5043cb tempest-GroupSnapshotsTest-1791257526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-387de6d0-62c8-4e33-b6cd-d4fc67f38ae9" returned: 0 in 7.188s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:35:07 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8283c1c-b5fd-4c88-bacf-d322c8bf341d]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:35:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-733941c5-e1da-4302-94c2-e10def5043cb tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:35:07 devstack sudo[103166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d Jun 23 16:35:07 devstack sudo[103166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:35:08 devstack sudo[103164]: pam_unix(sudo:session): session closed for user root Jun 23 16:35:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f4550449-f6c3-40a8-b562-35d7c1d6522b tempest-SnapshotsActionsTest-171329803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.938s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:35:08 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-f4550449-f6c3-40a8-b562-35d7c1d6522b tempest-SnapshotsActionsTest-171329803 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:35:08 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-f4550449-f6c3-40a8-b562-35d7c1d6522b tempest-SnapshotsActionsTest-171329803 None] Deleted volume successfully. Jun 23 16:35:08 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-f4550449-f6c3-40a8-b562-35d7c1d6522b tempest-SnapshotsActionsTest-171329803 None] Lock "cinder-3efa3889-11f1-4263-8bb3-178ada5775d2-delete_volume" released by "delete_volume" :: held 6.548s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:35:09 devstack sudo[103166]: pam_unix(sudo:session): session closed for user root Jun 23 16:35:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-733941c5-e1da-4302-94c2-e10def5043cb tempest-GroupSnapshotsTest-1791257526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d" returned: 0 in 1.763s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:35:09 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-733941c5-e1da-4302-94c2-e10def5043cb tempest-GroupSnapshotsTest-1791257526 None] Image conversion details: src /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d, size 1024.00 MB, duration 7.19 sec, destination /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-387de6d0-62c8-4e33-b6cd-d4fc67f38ae9 {{(pid=93788) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 16:35:09 devstack cinder-volume[93788]: INFO cinder.image.image_utils [None req-733941c5-e1da-4302-94c2-e10def5043cb tempest-GroupSnapshotsTest-1791257526 None] Converted 1024.00 MB image at 142.43 MB/s Jun 23 16:35:09 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-733941c5-e1da-4302-94c2-e10def5043cb tempest-GroupSnapshotsTest-1791257526 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-387de6d0-62c8-4e33-b6cd-d4fc67f38ae9 is being set with open permissions: ugo+rw: NotImplementedError Jun 23 16:35:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-733941c5-e1da-4302-94c2-e10def5043cb tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-387de6d0-62c8-4e33-b6cd-d4fc67f38ae9 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:35:09 devstack sudo[103254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-387de6d0-62c8-4e33-b6cd-d4fc67f38ae9 Jun 23 16:35:09 devstack sudo[103254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:35:10 devstack sudo[103254]: pam_unix(sudo:session): session closed for user root Jun 23 16:35:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-733941c5-e1da-4302-94c2-e10def5043cb tempest-GroupSnapshotsTest-1791257526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-387de6d0-62c8-4e33-b6cd-d4fc67f38ae9" returned: 0 in 1.079s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:35:10 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-733941c5-e1da-4302-94c2-e10def5043cb tempest-GroupSnapshotsTest-1791257526 None] Lock "cinder-quobyte-387de6d0-62c8-4e33-b6cd-d4fc67f38ae9" released by "_copy_volume_from_snapshot" :: held 12.006s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:35:10 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-733941c5-e1da-4302-94c2-e10def5043cb tempest-GroupSnapshotsTest-1791257526 None] Lock "cinder-quobyte-6034a2ac-fac9-4283-9002-78b06ee5e9bc-387de6d0-62c8-4e33-b6cd-d4fc67f38ae9" released by "_create_volume_from_snapshot" :: held 12.063s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:35:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-733941c5-e1da-4302-94c2-e10def5043cb tempest-GroupSnapshotsTest-1791257526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.095s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:35:10 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-733941c5-e1da-4302-94c2-e10def5043cb tempest-GroupSnapshotsTest-1791257526 None] Create group from source-snapshot-9d9886a8-b872-4453-b412-33f2b4489e92 completed successfully. Jun 23 16:35:12 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-2477006d-e2ba-4388-9a8b-816f373296e0 tempest-GroupSnapshotsTest-1791257526 None] Acquiring lock "cinder-quobyte-387de6d0-62c8-4e33-b6cd-d4fc67f38ae9" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:35:12 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-2477006d-e2ba-4388-9a8b-816f373296e0 tempest-GroupSnapshotsTest-1791257526 None] Lock "cinder-quobyte-387de6d0-62c8-4e33-b6cd-d4fc67f38ae9" acquired by "delete_volume" :: waited 0.035s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:35:12 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[89587364-c143-4821-af76-bae0964487a4]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:35:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2477006d-e2ba-4388-9a8b-816f373296e0 tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-387de6d0-62c8-4e33-b6cd-d4fc67f38ae9 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:35:12 devstack sudo[103272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-387de6d0-62c8-4e33-b6cd-d4fc67f38ae9 Jun 23 16:35:12 devstack sudo[103272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:35:13 devstack sudo[103272]: pam_unix(sudo:session): session closed for user root Jun 23 16:35:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2477006d-e2ba-4388-9a8b-816f373296e0 tempest-GroupSnapshotsTest-1791257526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-387de6d0-62c8-4e33-b6cd-d4fc67f38ae9" returned: 0 in 0.935s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:35:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2477006d-e2ba-4388-9a8b-816f373296e0 tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-387de6d0-62c8-4e33-b6cd-d4fc67f38ae9 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:35:13 devstack sudo[103277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-387de6d0-62c8-4e33-b6cd-d4fc67f38ae9 Jun 23 16:35:13 devstack sudo[103277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:35:13 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c64142a-a505-4b8e-aa66-b332c1bc9cb6 tempest-VolumesTransfersTest-1066913520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:35:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5c64142a-a505-4b8e-aa66-b332c1bc9cb6 tempest-VolumesTransfersTest-1066913520 None] Flow 'volume_create_manager' (f1463991-0120-4fd0-9268-053d50b63095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:35:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5c64142a-a505-4b8e-aa66-b332c1bc9cb6 tempest-VolumesTransfersTest-1066913520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd708471-e29c-4cfb-a4c5-3b0d3ea062fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:35:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5c64142a-a505-4b8e-aa66-b332c1bc9cb6 tempest-VolumesTransfersTest-1066913520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd708471-e29c-4cfb-a4c5-3b0d3ea062fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-582970868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=304fae17-f457-4a2f-be4a-60fe04bb3006,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e30f3e70511f4c81bff443f7b72e3227',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:35:14Z,use_quota=True,user_id='23e8856a263e456db8f5daca33884f3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:35:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5c64142a-a505-4b8e-aa66-b332c1bc9cb6 tempest-VolumesTransfersTest-1066913520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07db5336-4f7f-43b0-ab74-3dc12575b646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:35:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5c64142a-a505-4b8e-aa66-b332c1bc9cb6 tempest-VolumesTransfersTest-1066913520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07db5336-4f7f-43b0-ab74-3dc12575b646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:35:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5c64142a-a505-4b8e-aa66-b332c1bc9cb6 tempest-VolumesTransfersTest-1066913520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f52e66b-856b-4228-83eb-e340fe820b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:35:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5c64142a-a505-4b8e-aa66-b332c1bc9cb6 tempest-VolumesTransfersTest-1066913520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f52e66b-856b-4228-83eb-e340fe820b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '304fae17-f457-4a2f-be4a-60fe04bb3006', 'volume_name': 'volume-304fae17-f457-4a2f-be4a-60fe04bb3006', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:35:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5c64142a-a505-4b8e-aa66-b332c1bc9cb6 tempest-VolumesTransfersTest-1066913520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdf19c38-fd9e-47bb-a517-7b6fd0fcb7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:35:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5c64142a-a505-4b8e-aa66-b332c1bc9cb6 tempest-VolumesTransfersTest-1066913520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdf19c38-fd9e-47bb-a517-7b6fd0fcb7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:35:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5c64142a-a505-4b8e-aa66-b332c1bc9cb6 tempest-VolumesTransfersTest-1066913520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39520bcc-ce70-4fda-8704-3c934794d25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:35:13 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-5c64142a-a505-4b8e-aa66-b332c1bc9cb6 tempest-VolumesTransfersTest-1066913520 None] Volume 304fae17-f457-4a2f-be4a-60fe04bb3006: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-304fae17-f457-4a2f-be4a-60fe04bb3006', 'volume_size': 1} Jun 23 16:35:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5c64142a-a505-4b8e-aa66-b332c1bc9cb6 tempest-VolumesTransfersTest-1066913520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:35:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5c64142a-a505-4b8e-aa66-b332c1bc9cb6 tempest-VolumesTransfersTest-1066913520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:35:13 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-5c64142a-a505-4b8e-aa66-b332c1bc9cb6 tempest-VolumesTransfersTest-1066913520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-582970868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=304fae17-f457-4a2f-be4a-60fe04bb3006,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e30f3e70511f4c81bff443f7b72e3227',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:35:14Z,use_quota=True,user_id='23e8856a263e456db8f5daca33884f3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:35:13 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-5c64142a-a505-4b8e-aa66-b332c1bc9cb6 tempest-VolumesTransfersTest-1066913520 None] Creating volume 304fae17-f457-4a2f-be4a-60fe04bb3006 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:35:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5c64142a-a505-4b8e-aa66-b332c1bc9cb6 tempest-VolumesTransfersTest-1066913520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:35:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5c64142a-a505-4b8e-aa66-b332c1bc9cb6 tempest-VolumesTransfersTest-1066913520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:35:13 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-5c64142a-a505-4b8e-aa66-b332c1bc9cb6 tempest-VolumesTransfersTest-1066913520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:35:13 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-5c64142a-a505-4b8e-aa66-b332c1bc9cb6 tempest-VolumesTransfersTest-1066913520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:35:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5c64142a-a505-4b8e-aa66-b332c1bc9cb6 tempest-VolumesTransfersTest-1066913520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:35:13 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-5c64142a-a505-4b8e-aa66-b332c1bc9cb6 tempest-VolumesTransfersTest-1066913520 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:35:13 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-5c64142a-a505-4b8e-aa66-b332c1bc9cb6 tempest-VolumesTransfersTest-1066913520 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:35:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5c64142a-a505-4b8e-aa66-b332c1bc9cb6 tempest-VolumesTransfersTest-1066913520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-304fae17-f457-4a2f-be4a-60fe04bb3006 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:35:13 devstack sudo[103279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-304fae17-f457-4a2f-be4a-60fe04bb3006 1073741824 Jun 23 16:35:13 devstack sudo[103279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:35:14 devstack sudo[103277]: pam_unix(sudo:session): session closed for user root Jun 23 16:35:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2477006d-e2ba-4388-9a8b-816f373296e0 tempest-GroupSnapshotsTest-1791257526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-387de6d0-62c8-4e33-b6cd-d4fc67f38ae9" returned: 0 in 0.897s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:35:14 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-2477006d-e2ba-4388-9a8b-816f373296e0 tempest-GroupSnapshotsTest-1791257526 None] Lock "cinder-quobyte-387de6d0-62c8-4e33-b6cd-d4fc67f38ae9" released by "delete_volume" :: held 1.892s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:35:14 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-2477006d-e2ba-4388-9a8b-816f373296e0 tempest-GroupSnapshotsTest-1791257526 None] Created reservations ['f13b0ac1-4b9f-487b-8453-2bc4edf759d8'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:35:14 devstack cinder-volume[93788]: WARNING cinder.quota [None req-2477006d-e2ba-4388-9a8b-816f373296e0 tempest-GroupSnapshotsTest-1791257526 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1150162968 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1150162968, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:35:14 devstack cinder-volume[93788]: WARNING cinder.quota [None req-2477006d-e2ba-4388-9a8b-816f373296e0 tempest-GroupSnapshotsTest-1791257526 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1150162968 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1150162968, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:35:14 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-2477006d-e2ba-4388-9a8b-816f373296e0 tempest-GroupSnapshotsTest-1791257526 None] Created reservations ['79b30bf3-6ecc-4542-aecc-1c103570383a', '94990dea-0efd-4655-9a10-a5931173f8e2', '2b8460ae-d84c-4784-99e5-16356b9d18ba', '94ec0076-0ed9-406f-9387-17df54779589'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:35:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-2477006d-e2ba-4388-9a8b-816f373296e0 tempest-GroupSnapshotsTest-1791257526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:35:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-2477006d-e2ba-4388-9a8b-816f373296e0 tempest-GroupSnapshotsTest-1791257526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:35:14 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-2477006d-e2ba-4388-9a8b-816f373296e0 tempest-GroupSnapshotsTest-1791257526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:35:14 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-2477006d-e2ba-4388-9a8b-816f373296e0 tempest-GroupSnapshotsTest-1791257526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:35:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-2477006d-e2ba-4388-9a8b-816f373296e0 tempest-GroupSnapshotsTest-1791257526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:35:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2477006d-e2ba-4388-9a8b-816f373296e0 tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:35:14 devstack sudo[103284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:35:14 devstack sudo[103284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:35:14 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-8063da00-375c-4e8c-ad12-d3781a1bd9f5 tempest-GroupSnapshotsTest-1791257526 None] group_snapshot 9d9886a8-b872-4453-b412-33f2b4489e92: deleting Jun 23 16:35:15 devstack sudo[103279]: pam_unix(sudo:session): session closed for user root Jun 23 16:35:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5c64142a-a505-4b8e-aa66-b332c1bc9cb6 tempest-VolumesTransfersTest-1066913520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-304fae17-f457-4a2f-be4a-60fe04bb3006 1073741824" returned: 0 in 1.129s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:35:15 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8063da00-375c-4e8c-ad12-d3781a1bd9f5 tempest-GroupSnapshotsTest-1791257526 None] group_snapshot 9d9886a8-b872-4453-b412-33f2b4489e92: deleting {{(pid=93788) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 23 16:35:15 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-8063da00-375c-4e8c-ad12-d3781a1bd9f5 tempest-GroupSnapshotsTest-1791257526 None] Acquiring lock "cinder-quobyte-0ce16a28-766a-4024-b50e-6f84a319624d" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:35:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5c64142a-a505-4b8e-aa66-b332c1bc9cb6 tempest-VolumesTransfersTest-1066913520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-304fae17-f457-4a2f-be4a-60fe04bb3006 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:35:15 devstack sudo[103290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-304fae17-f457-4a2f-be4a-60fe04bb3006 Jun 23 16:35:15 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-8063da00-375c-4e8c-ad12-d3781a1bd9f5 tempest-GroupSnapshotsTest-1791257526 None] Lock "cinder-quobyte-0ce16a28-766a-4024-b50e-6f84a319624d" acquired by "delete_snapshot" :: waited 0.043s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:35:15 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-8063da00-375c-4e8c-ad12-d3781a1bd9f5 tempest-GroupSnapshotsTest-1791257526 None] Acquiring lock "cinder-quobyte-6034a2ac-fac9-4283-9002-78b06ee5e9bc" by "_delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:35:15 devstack sudo[103290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:35:15 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-8063da00-375c-4e8c-ad12-d3781a1bd9f5 tempest-GroupSnapshotsTest-1791257526 None] Lock "cinder-quobyte-6034a2ac-fac9-4283-9002-78b06ee5e9bc" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:35:15 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-8063da00-375c-4e8c-ad12-d3781a1bd9f5 tempest-GroupSnapshotsTest-1791257526 None] Deleting offline snapshot 6034a2ac-fac9-4283-9002-78b06ee5e9bc of volume 0ce16a28-766a-4024-b50e-6f84a319624d {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:35:15 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-8063da00-375c-4e8c-ad12-d3781a1bd9f5 tempest-GroupSnapshotsTest-1791257526 None] snapshot_file for this snap is: volume-0ce16a28-766a-4024-b50e-6f84a319624d.6034a2ac-fac9-4283-9002-78b06ee5e9bc {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:35:15 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1461b331-eb07-403c-8c3b-95ab407b37d4]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:35:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8063da00-375c-4e8c-ad12-d3781a1bd9f5 tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d.6034a2ac-fac9-4283-9002-78b06ee5e9bc {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:35:15 devstack sudo[103292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d.6034a2ac-fac9-4283-9002-78b06ee5e9bc Jun 23 16:35:15 devstack sudo[103292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:35:15 devstack sudo[103284]: pam_unix(sudo:session): session closed for user root Jun 23 16:35:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2477006d-e2ba-4388-9a8b-816f373296e0 tempest-GroupSnapshotsTest-1791257526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.068s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:35:15 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-2477006d-e2ba-4388-9a8b-816f373296e0 tempest-GroupSnapshotsTest-1791257526 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:35:15 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-2477006d-e2ba-4388-9a8b-816f373296e0 tempest-GroupSnapshotsTest-1791257526 None] Delete group completed successfully. Jun 23 16:35:16 devstack sudo[103290]: pam_unix(sudo:session): session closed for user root Jun 23 16:35:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5c64142a-a505-4b8e-aa66-b332c1bc9cb6 tempest-VolumesTransfersTest-1066913520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-304fae17-f457-4a2f-be4a-60fe04bb3006" returned: 0 in 1.124s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:35:16 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-5c64142a-a505-4b8e-aa66-b332c1bc9cb6 tempest-VolumesTransfersTest-1066913520 None] <== create_volume: return (2322ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:35:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5c64142a-a505-4b8e-aa66-b332c1bc9cb6 tempest-VolumesTransfersTest-1066913520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.326s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:35:16 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5c64142a-a505-4b8e-aa66-b332c1bc9cb6 tempest-VolumesTransfersTest-1066913520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39520bcc-ce70-4fda-8704-3c934794d25b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-304fae17-f457-4a2f-be4a-60fe04bb3006', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:35:16 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5c64142a-a505-4b8e-aa66-b332c1bc9cb6 tempest-VolumesTransfersTest-1066913520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d785d90-0ae8-4d2a-9531-72f3d4248e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:35:16 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-5c64142a-a505-4b8e-aa66-b332c1bc9cb6 tempest-VolumesTransfersTest-1066913520 None] Volume volume-304fae17-f457-4a2f-be4a-60fe04bb3006 (304fae17-f457-4a2f-be4a-60fe04bb3006): created successfully Jun 23 16:35:16 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5c64142a-a505-4b8e-aa66-b332c1bc9cb6 tempest-VolumesTransfersTest-1066913520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d785d90-0ae8-4d2a-9531-72f3d4248e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:35:16 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5c64142a-a505-4b8e-aa66-b332c1bc9cb6 tempest-VolumesTransfersTest-1066913520 None] Flow 'volume_create_manager' (f1463991-0120-4fd0-9268-053d50b63095) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:35:16 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-5c64142a-a505-4b8e-aa66-b332c1bc9cb6 tempest-VolumesTransfersTest-1066913520 None] Created volume successfully. Jun 23 16:35:16 devstack sudo[103292]: pam_unix(sudo:session): session closed for user root Jun 23 16:35:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8063da00-375c-4e8c-ad12-d3781a1bd9f5 tempest-GroupSnapshotsTest-1791257526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d.6034a2ac-fac9-4283-9002-78b06ee5e9bc" returned: 0 in 1.046s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:35:16 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-8063da00-375c-4e8c-ad12-d3781a1bd9f5 tempest-GroupSnapshotsTest-1791257526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ce16a28-766a-4024-b50e-6f84a319624d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:35:16 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b244632-4bfc-4867-a03e-87ad87453942]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:35:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8063da00-375c-4e8c-ad12-d3781a1bd9f5 tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:35:16 devstack sudo[103300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d Jun 23 16:35:16 devstack sudo[103300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:35:17 devstack sudo[103300]: pam_unix(sudo:session): session closed for user root Jun 23 16:35:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8063da00-375c-4e8c-ad12-d3781a1bd9f5 tempest-GroupSnapshotsTest-1791257526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d" returned: 0 in 0.914s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:35:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8063da00-375c-4e8c-ad12-d3781a1bd9f5 tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d.6034a2ac-fac9-4283-9002-78b06ee5e9bc {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:35:17 devstack sudo[103306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d.6034a2ac-fac9-4283-9002-78b06ee5e9bc Jun 23 16:35:17 devstack sudo[103306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:35:18 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-c6f6edeb-3e12-4d6d-8ecc-35f3b1004eae tempest-VolumesTransfersTest-1941154206 None] Transfer volume completed successfully. Jun 23 16:35:18 devstack sudo[103306]: pam_unix(sudo:session): session closed for user root Jun 23 16:35:18 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8063da00-375c-4e8c-ad12-d3781a1bd9f5 tempest-GroupSnapshotsTest-1791257526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d.6034a2ac-fac9-4283-9002-78b06ee5e9bc" returned: 0 in 1.138s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:35:18 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8063da00-375c-4e8c-ad12-d3781a1bd9f5 tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d.6034a2ac-fac9-4283-9002-78b06ee5e9bc {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:35:18 devstack sudo[103311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d.6034a2ac-fac9-4283-9002-78b06ee5e9bc Jun 23 16:35:18 devstack sudo[103311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:35:19 devstack sudo[103311]: pam_unix(sudo:session): session closed for user root Jun 23 16:35:19 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8063da00-375c-4e8c-ad12-d3781a1bd9f5 tempest-GroupSnapshotsTest-1791257526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d.6034a2ac-fac9-4283-9002-78b06ee5e9bc" returned: 0 in 0.882s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:35:19 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-8063da00-375c-4e8c-ad12-d3781a1bd9f5 tempest-GroupSnapshotsTest-1791257526 None] Lock "cinder-quobyte-6034a2ac-fac9-4283-9002-78b06ee5e9bc" released by "_delete_snapshot" :: held 4.132s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:35:19 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-8063da00-375c-4e8c-ad12-d3781a1bd9f5 tempest-GroupSnapshotsTest-1791257526 None] Lock "cinder-quobyte-0ce16a28-766a-4024-b50e-6f84a319624d" released by "delete_snapshot" :: held 4.199s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:35:19 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d08d50a7-770f-4aee-a19c-b8b30992df72 tempest-VolumesTransfersTest-170442864 None] Acquiring lock "cinder-304fae17-f457-4a2f-be4a-60fe04bb3006-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:35:19 devstack cinder-volume[93788]: WARNING cinder.quota [None req-8063da00-375c-4e8c-ad12-d3781a1bd9f5 tempest-GroupSnapshotsTest-1791257526 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1150162968 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1150162968, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:35:19 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d08d50a7-770f-4aee-a19c-b8b30992df72 tempest-VolumesTransfersTest-170442864 None] Lock "cinder-304fae17-f457-4a2f-be4a-60fe04bb3006-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:35:19 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-8063da00-375c-4e8c-ad12-d3781a1bd9f5 tempest-GroupSnapshotsTest-1791257526 None] Created reservations ['c3ecd769-8210-479f-ab94-25be0f14eca7', '905a5cb9-62ed-45f1-81eb-ac0c673950f0', '8f681f2d-f8e9-49f2-af7f-c6dd63dda630', '1820f651-08f8-4dbc-9478-49405e4e53b5'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:35:19 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d08d50a7-770f-4aee-a19c-b8b30992df72 tempest-VolumesTransfersTest-170442864 None] Acquiring lock "cinder-quobyte-304fae17-f457-4a2f-be4a-60fe04bb3006" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:35:19 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d08d50a7-770f-4aee-a19c-b8b30992df72 tempest-VolumesTransfersTest-170442864 None] Lock "cinder-quobyte-304fae17-f457-4a2f-be4a-60fe04bb3006" acquired by "delete_volume" :: waited 0.029s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:35:19 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59e0ecd-4391-4acf-adfd-217d9175a38b]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:35:19 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d08d50a7-770f-4aee-a19c-b8b30992df72 tempest-VolumesTransfersTest-170442864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-304fae17-f457-4a2f-be4a-60fe04bb3006 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:35:19 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-8063da00-375c-4e8c-ad12-d3781a1bd9f5 tempest-GroupSnapshotsTest-1791257526 None] group_snapshot 9d9886a8-b872-4453-b412-33f2b4489e92: deleted successfully Jun 23 16:35:19 devstack sudo[103315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-304fae17-f457-4a2f-be4a-60fe04bb3006 Jun 23 16:35:19 devstack sudo[103315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:35:20 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b5a0fec0-c9a4-49bd-99ae-724127338e23 tempest-GroupSnapshotsTest-1791257526 None] Acquiring lock "cinder-quobyte-0ce16a28-766a-4024-b50e-6f84a319624d" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:35:20 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b5a0fec0-c9a4-49bd-99ae-724127338e23 tempest-GroupSnapshotsTest-1791257526 None] Lock "cinder-quobyte-0ce16a28-766a-4024-b50e-6f84a319624d" acquired by "delete_volume" :: waited 0.027s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:35:20 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[80bee2a8-b2ec-4a32-92e6-ae98c047a028]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:35:20 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b5a0fec0-c9a4-49bd-99ae-724127338e23 tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:35:20 devstack sudo[103315]: pam_unix(sudo:session): session closed for user root Jun 23 16:35:20 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d08d50a7-770f-4aee-a19c-b8b30992df72 tempest-VolumesTransfersTest-170442864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-304fae17-f457-4a2f-be4a-60fe04bb3006" returned: 0 in 0.975s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:35:20 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d08d50a7-770f-4aee-a19c-b8b30992df72 tempest-VolumesTransfersTest-170442864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-304fae17-f457-4a2f-be4a-60fe04bb3006 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:35:20 devstack sudo[103323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d Jun 23 16:35:20 devstack sudo[103323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:35:20 devstack sudo[103325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-304fae17-f457-4a2f-be4a-60fe04bb3006 Jun 23 16:35:20 devstack sudo[103325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:35:21 devstack sudo[103325]: pam_unix(sudo:session): session closed for user root Jun 23 16:35:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d08d50a7-770f-4aee-a19c-b8b30992df72 tempest-VolumesTransfersTest-170442864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-304fae17-f457-4a2f-be4a-60fe04bb3006" returned: 0 in 0.740s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:35:21 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d08d50a7-770f-4aee-a19c-b8b30992df72 tempest-VolumesTransfersTest-170442864 None] Lock "cinder-quobyte-304fae17-f457-4a2f-be4a-60fe04bb3006" released by "delete_volume" :: held 1.784s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:35:21 devstack sudo[103323]: pam_unix(sudo:session): session closed for user root Jun 23 16:35:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b5a0fec0-c9a4-49bd-99ae-724127338e23 tempest-GroupSnapshotsTest-1791257526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d" returned: 0 in 0.935s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:35:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b5a0fec0-c9a4-49bd-99ae-724127338e23 tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:35:21 devstack sudo[103331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d Jun 23 16:35:21 devstack sudo[103331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:35:21 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-d08d50a7-770f-4aee-a19c-b8b30992df72 tempest-VolumesTransfersTest-170442864 None] Created reservations ['71bd2d79-6bcb-4d5f-b7be-daac0c2a54fd', 'b4148f0e-f8c9-49d3-af5a-7212b7f4433b', '97749f06-6429-4819-be6b-7c364c943253', '3da73d11-71e0-4841-8305-bc494d71663e'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:35:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d08d50a7-770f-4aee-a19c-b8b30992df72 tempest-VolumesTransfersTest-170442864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:35:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d08d50a7-770f-4aee-a19c-b8b30992df72 tempest-VolumesTransfersTest-170442864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:35:21 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-d08d50a7-770f-4aee-a19c-b8b30992df72 tempest-VolumesTransfersTest-170442864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:35:21 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-d08d50a7-770f-4aee-a19c-b8b30992df72 tempest-VolumesTransfersTest-170442864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:35:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d08d50a7-770f-4aee-a19c-b8b30992df72 tempest-VolumesTransfersTest-170442864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:35:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d08d50a7-770f-4aee-a19c-b8b30992df72 tempest-VolumesTransfersTest-170442864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:35:21 devstack sudo[103334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:35:21 devstack sudo[103334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:35:22 devstack sudo[103331]: pam_unix(sudo:session): session closed for user root Jun 23 16:35:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b5a0fec0-c9a4-49bd-99ae-724127338e23 tempest-GroupSnapshotsTest-1791257526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0ce16a28-766a-4024-b50e-6f84a319624d" returned: 0 in 0.908s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:35:22 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b5a0fec0-c9a4-49bd-99ae-724127338e23 tempest-GroupSnapshotsTest-1791257526 None] Lock "cinder-quobyte-0ce16a28-766a-4024-b50e-6f84a319624d" released by "delete_volume" :: held 1.943s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:35:22 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-b5a0fec0-c9a4-49bd-99ae-724127338e23 tempest-GroupSnapshotsTest-1791257526 None] Created reservations ['1d1bd9c5-14cd-44c3-93f0-394b96c0bdfe'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:35:22 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-84cbce27-dbc0-4b92-a955-a691fc108e20 tempest-VolumesTransfersTest-1066913520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:35:22 devstack sudo[103334]: pam_unix(sudo:session): session closed for user root Jun 23 16:35:22 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-84cbce27-dbc0-4b92-a955-a691fc108e20 tempest-VolumesTransfersTest-1066913520 None] Flow 'volume_create_manager' (f8cf17ce-d399-4d18-9331-b45591e97c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:35:22 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-84cbce27-dbc0-4b92-a955-a691fc108e20 tempest-VolumesTransfersTest-1066913520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed1616ed-6dc3-4d60-be31-badad790beaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:35:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d08d50a7-770f-4aee-a19c-b8b30992df72 tempest-VolumesTransfersTest-170442864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.068s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:35:22 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-d08d50a7-770f-4aee-a19c-b8b30992df72 tempest-VolumesTransfersTest-170442864 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:35:22 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-84cbce27-dbc0-4b92-a955-a691fc108e20 tempest-VolumesTransfersTest-1066913520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed1616ed-6dc3-4d60-be31-badad790beaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-490182911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17364352-654b-4000-8561-42594d2167a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e30f3e70511f4c81bff443f7b72e3227',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:35:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:35:23Z,use_quota=True,user_id='23e8856a263e456db8f5daca33884f3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:35:22 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-84cbce27-dbc0-4b92-a955-a691fc108e20 tempest-VolumesTransfersTest-1066913520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8395343-632a-4280-a70a-b5ad71ff0132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:35:22 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-84cbce27-dbc0-4b92-a955-a691fc108e20 tempest-VolumesTransfersTest-1066913520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8395343-632a-4280-a70a-b5ad71ff0132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:35:22 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-84cbce27-dbc0-4b92-a955-a691fc108e20 tempest-VolumesTransfersTest-1066913520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e558e420-cc9e-46a9-8293-f877cef79b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:35:22 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-84cbce27-dbc0-4b92-a955-a691fc108e20 tempest-VolumesTransfersTest-1066913520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e558e420-cc9e-46a9-8293-f877cef79b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17364352-654b-4000-8561-42594d2167a1', 'volume_name': 'volume-17364352-654b-4000-8561-42594d2167a1', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:35:22 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-84cbce27-dbc0-4b92-a955-a691fc108e20 tempest-VolumesTransfersTest-1066913520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (865f91fc-a878-4420-acdf-12544344d0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:35:22 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-84cbce27-dbc0-4b92-a955-a691fc108e20 tempest-VolumesTransfersTest-1066913520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (865f91fc-a878-4420-acdf-12544344d0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:35:22 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-84cbce27-dbc0-4b92-a955-a691fc108e20 tempest-VolumesTransfersTest-1066913520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (255bf51c-a2dd-420e-bea2-621e5b9a852a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:35:22 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-84cbce27-dbc0-4b92-a955-a691fc108e20 tempest-VolumesTransfersTest-1066913520 None] Volume 17364352-654b-4000-8561-42594d2167a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17364352-654b-4000-8561-42594d2167a1', 'volume_size': 1} Jun 23 16:35:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-84cbce27-dbc0-4b92-a955-a691fc108e20 tempest-VolumesTransfersTest-1066913520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:35:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-84cbce27-dbc0-4b92-a955-a691fc108e20 tempest-VolumesTransfersTest-1066913520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:35:22 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-84cbce27-dbc0-4b92-a955-a691fc108e20 tempest-VolumesTransfersTest-1066913520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-490182911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17364352-654b-4000-8561-42594d2167a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e30f3e70511f4c81bff443f7b72e3227',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:35:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:35:23Z,use_quota=True,user_id='23e8856a263e456db8f5daca33884f3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:35:22 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-84cbce27-dbc0-4b92-a955-a691fc108e20 tempest-VolumesTransfersTest-1066913520 None] Creating volume 17364352-654b-4000-8561-42594d2167a1 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:35:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-84cbce27-dbc0-4b92-a955-a691fc108e20 tempest-VolumesTransfersTest-1066913520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:35:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-84cbce27-dbc0-4b92-a955-a691fc108e20 tempest-VolumesTransfersTest-1066913520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:35:22 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-84cbce27-dbc0-4b92-a955-a691fc108e20 tempest-VolumesTransfersTest-1066913520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:35:22 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-84cbce27-dbc0-4b92-a955-a691fc108e20 tempest-VolumesTransfersTest-1066913520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:35:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-84cbce27-dbc0-4b92-a955-a691fc108e20 tempest-VolumesTransfersTest-1066913520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:35:22 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-84cbce27-dbc0-4b92-a955-a691fc108e20 tempest-VolumesTransfersTest-1066913520 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:35:22 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-84cbce27-dbc0-4b92-a955-a691fc108e20 tempest-VolumesTransfersTest-1066913520 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:35:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-84cbce27-dbc0-4b92-a955-a691fc108e20 tempest-VolumesTransfersTest-1066913520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-17364352-654b-4000-8561-42594d2167a1 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:35:22 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-d08d50a7-770f-4aee-a19c-b8b30992df72 tempest-VolumesTransfersTest-170442864 None] Deleted volume successfully. Jun 23 16:35:22 devstack cinder-volume[93788]: WARNING cinder.db.api [None req-b5a0fec0-c9a4-49bd-99ae-724127338e23 tempest-GroupSnapshotsTest-1791257526 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1150162968'] Jun 23 16:35:22 devstack sudo[103338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-17364352-654b-4000-8561-42594d2167a1 1073741824 Jun 23 16:35:22 devstack sudo[103338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:35:22 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-b5a0fec0-c9a4-49bd-99ae-724127338e23 tempest-GroupSnapshotsTest-1791257526 None] Created reservations ['61e5fc7a-f180-4360-9130-6ca53159e41c', '4a7000ae-682d-40a6-b08f-621793b534e1', '142c3019-b75f-495f-b61f-f7c2dd244578', '5390495e-6df9-45de-b0b3-856a3d72ecc2'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:35:22 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d08d50a7-770f-4aee-a19c-b8b30992df72 tempest-VolumesTransfersTest-170442864 None] Lock "cinder-304fae17-f457-4a2f-be4a-60fe04bb3006-delete_volume" released by "delete_volume" :: held 3.334s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:35:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b5a0fec0-c9a4-49bd-99ae-724127338e23 tempest-GroupSnapshotsTest-1791257526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:35:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b5a0fec0-c9a4-49bd-99ae-724127338e23 tempest-GroupSnapshotsTest-1791257526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:35:22 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b5a0fec0-c9a4-49bd-99ae-724127338e23 tempest-GroupSnapshotsTest-1791257526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:35:22 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b5a0fec0-c9a4-49bd-99ae-724127338e23 tempest-GroupSnapshotsTest-1791257526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:35:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b5a0fec0-c9a4-49bd-99ae-724127338e23 tempest-GroupSnapshotsTest-1791257526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:35:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b5a0fec0-c9a4-49bd-99ae-724127338e23 tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:35:22 devstack sudo[103340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:35:22 devstack sudo[103340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:35:23 devstack sudo[103340]: pam_unix(sudo:session): session closed for user root Jun 23 16:35:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b5a0fec0-c9a4-49bd-99ae-724127338e23 tempest-GroupSnapshotsTest-1791257526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.698s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:35:23 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-b5a0fec0-c9a4-49bd-99ae-724127338e23 tempest-GroupSnapshotsTest-1791257526 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:35:23 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-b5a0fec0-c9a4-49bd-99ae-724127338e23 tempest-GroupSnapshotsTest-1791257526 None] Delete group completed successfully. Jun 23 16:35:23 devstack sudo[103338]: pam_unix(sudo:session): session closed for user root Jun 23 16:35:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-84cbce27-dbc0-4b92-a955-a691fc108e20 tempest-VolumesTransfersTest-1066913520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-17364352-654b-4000-8561-42594d2167a1 1073741824" returned: 0 in 0.947s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:35:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-84cbce27-dbc0-4b92-a955-a691fc108e20 tempest-VolumesTransfersTest-1066913520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-17364352-654b-4000-8561-42594d2167a1 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:35:23 devstack sudo[103347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-17364352-654b-4000-8561-42594d2167a1 Jun 23 16:35:23 devstack sudo[103347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:35:24 devstack sudo[103347]: pam_unix(sudo:session): session closed for user root Jun 23 16:35:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-84cbce27-dbc0-4b92-a955-a691fc108e20 tempest-VolumesTransfersTest-1066913520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-17364352-654b-4000-8561-42594d2167a1" returned: 0 in 0.721s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:35:24 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-84cbce27-dbc0-4b92-a955-a691fc108e20 tempest-VolumesTransfersTest-1066913520 None] <== create_volume: return (1713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:35:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-84cbce27-dbc0-4b92-a955-a691fc108e20 tempest-VolumesTransfersTest-1066913520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.715s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:35:24 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-84cbce27-dbc0-4b92-a955-a691fc108e20 tempest-VolumesTransfersTest-1066913520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (255bf51c-a2dd-420e-bea2-621e5b9a852a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17364352-654b-4000-8561-42594d2167a1', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:35:24 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-84cbce27-dbc0-4b92-a955-a691fc108e20 tempest-VolumesTransfersTest-1066913520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70d29767-e7dc-4432-b30c-a65be597878b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:35:24 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-ded52fc8-ca6e-4b11-954b-165451ffb567 tempest-GroupSnapshotsTest-1791257526 None] Group tempest-GroupSnapshotsTest-Group-1549663370: creating Jun 23 16:35:24 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-84cbce27-dbc0-4b92-a955-a691fc108e20 tempest-VolumesTransfersTest-1066913520 None] Volume volume-17364352-654b-4000-8561-42594d2167a1 (17364352-654b-4000-8561-42594d2167a1): created successfully Jun 23 16:35:24 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-84cbce27-dbc0-4b92-a955-a691fc108e20 tempest-VolumesTransfersTest-1066913520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70d29767-e7dc-4432-b30c-a65be597878b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:35:24 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-84cbce27-dbc0-4b92-a955-a691fc108e20 tempest-VolumesTransfersTest-1066913520 None] Flow 'volume_create_manager' (f8cf17ce-d399-4d18-9331-b45591e97c28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:35:24 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-84cbce27-dbc0-4b92-a955-a691fc108e20 tempest-VolumesTransfersTest-1066913520 None] Created volume successfully. Jun 23 16:35:24 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-ded52fc8-ca6e-4b11-954b-165451ffb567 tempest-GroupSnapshotsTest-1791257526 None] Group tempest-GroupSnapshotsTest-Group-1549663370: created successfully Jun 23 16:35:24 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-ded52fc8-ca6e-4b11-954b-165451ffb567 tempest-GroupSnapshotsTest-1791257526 None] Create group completed successfully. Jun 23 16:35:24 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-f3ec626f-3107-4c17-b8f7-404d25639bbb tempest-VolumesTransfersTest-170442864 None] Acquiring lock "cinder-17364352-654b-4000-8561-42594d2167a1-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:35:25 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-f3ec626f-3107-4c17-b8f7-404d25639bbb tempest-VolumesTransfersTest-170442864 None] Lock "cinder-17364352-654b-4000-8561-42594d2167a1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:35:25 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-f3ec626f-3107-4c17-b8f7-404d25639bbb tempest-VolumesTransfersTest-170442864 None] Acquiring lock "cinder-quobyte-17364352-654b-4000-8561-42594d2167a1" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:35:25 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-f3ec626f-3107-4c17-b8f7-404d25639bbb tempest-VolumesTransfersTest-170442864 None] Lock "cinder-quobyte-17364352-654b-4000-8561-42594d2167a1" acquired by "delete_volume" :: waited 0.019s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:35:25 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcab5083-1b54-43d6-aa6d-73f03c0b5b3d]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:35:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f3ec626f-3107-4c17-b8f7-404d25639bbb tempest-VolumesTransfersTest-170442864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-17364352-654b-4000-8561-42594d2167a1 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:35:25 devstack sudo[103352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-17364352-654b-4000-8561-42594d2167a1 Jun 23 16:35:25 devstack sudo[103352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:35:26 devstack sudo[103352]: pam_unix(sudo:session): session closed for user root Jun 23 16:35:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f3ec626f-3107-4c17-b8f7-404d25639bbb tempest-VolumesTransfersTest-170442864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-17364352-654b-4000-8561-42594d2167a1" returned: 0 in 1.059s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:35:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f3ec626f-3107-4c17-b8f7-404d25639bbb tempest-VolumesTransfersTest-170442864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-17364352-654b-4000-8561-42594d2167a1 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:35:26 devstack sudo[103357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-17364352-654b-4000-8561-42594d2167a1 Jun 23 16:35:26 devstack sudo[103357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:35:26 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-73609486-ce91-4eac-b4ad-d5a60ce2f2db tempest-GroupSnapshotsTest-1791257526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:35:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-73609486-ce91-4eac-b4ad-d5a60ce2f2db tempest-GroupSnapshotsTest-1791257526 None] Flow 'volume_create_manager' (a8281c28-738d-4d85-b398-71658875b623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:35:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-73609486-ce91-4eac-b4ad-d5a60ce2f2db tempest-GroupSnapshotsTest-1791257526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b09e36c-8bce-4312-baf9-5926827c13c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:35:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-73609486-ce91-4eac-b4ad-d5a60ce2f2db tempest-GroupSnapshotsTest-1791257526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b09e36c-8bce-4312-baf9-5926827c13c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-800476816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=77db8f01-19ac-40f0-93e0-104ffc1ae421,host='devstack@QuobyteHD#QuobyteHD',id=4c305931-6883-4db9-a9b0-120bc5f58ec3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dce840d5703b4e59846cde5d1d050426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:35:26Z,use_quota=True,user_id='d42dedebf56a4672abe200b243a6ceca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b363de09-3e68-46eb-ac58-dc10feee9686),volume_type_id=b363de09-3e68-46eb-ac58-dc10feee9686)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:35:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-73609486-ce91-4eac-b4ad-d5a60ce2f2db tempest-GroupSnapshotsTest-1791257526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25f1a1a2-b292-44d6-b287-31c85499187e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:35:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-73609486-ce91-4eac-b4ad-d5a60ce2f2db tempest-GroupSnapshotsTest-1791257526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25f1a1a2-b292-44d6-b287-31c85499187e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:35:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-73609486-ce91-4eac-b4ad-d5a60ce2f2db tempest-GroupSnapshotsTest-1791257526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03c7e357-b138-4816-b4a4-532e3847d5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:35:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-73609486-ce91-4eac-b4ad-d5a60ce2f2db tempest-GroupSnapshotsTest-1791257526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03c7e357-b138-4816-b4a4-532e3847d5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c305931-6883-4db9-a9b0-120bc5f58ec3', 'volume_name': 'volume-4c305931-6883-4db9-a9b0-120bc5f58ec3', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:35:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-73609486-ce91-4eac-b4ad-d5a60ce2f2db tempest-GroupSnapshotsTest-1791257526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18e85e11-f398-47b7-9bb4-aab8f4b4274c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:35:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-73609486-ce91-4eac-b4ad-d5a60ce2f2db tempest-GroupSnapshotsTest-1791257526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18e85e11-f398-47b7-9bb4-aab8f4b4274c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:35:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-73609486-ce91-4eac-b4ad-d5a60ce2f2db tempest-GroupSnapshotsTest-1791257526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (149173df-255d-4163-aaee-338dd6d82eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:35:26 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-73609486-ce91-4eac-b4ad-d5a60ce2f2db tempest-GroupSnapshotsTest-1791257526 None] Volume 4c305931-6883-4db9-a9b0-120bc5f58ec3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c305931-6883-4db9-a9b0-120bc5f58ec3', 'volume_size': 1} Jun 23 16:35:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-73609486-ce91-4eac-b4ad-d5a60ce2f2db tempest-GroupSnapshotsTest-1791257526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:35:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-73609486-ce91-4eac-b4ad-d5a60ce2f2db tempest-GroupSnapshotsTest-1791257526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:35:26 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-73609486-ce91-4eac-b4ad-d5a60ce2f2db tempest-GroupSnapshotsTest-1791257526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=77db8f01-19ac-40f0-93e0-104ffc1ae421,created_at=2026-06-23T14:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-800476816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=77db8f01-19ac-40f0-93e0-104ffc1ae421,host='devstack@QuobyteHD#QuobyteHD',id=4c305931-6883-4db9-a9b0-120bc5f58ec3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dce840d5703b4e59846cde5d1d050426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:35:26Z,use_quota=True,user_id='d42dedebf56a4672abe200b243a6ceca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b363de09-3e68-46eb-ac58-dc10feee9686),volume_type_id=b363de09-3e68-46eb-ac58-dc10feee9686)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:35:26 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-73609486-ce91-4eac-b4ad-d5a60ce2f2db tempest-GroupSnapshotsTest-1791257526 None] Creating volume 4c305931-6883-4db9-a9b0-120bc5f58ec3 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:35:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-73609486-ce91-4eac-b4ad-d5a60ce2f2db tempest-GroupSnapshotsTest-1791257526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:35:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-73609486-ce91-4eac-b4ad-d5a60ce2f2db tempest-GroupSnapshotsTest-1791257526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:35:26 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-73609486-ce91-4eac-b4ad-d5a60ce2f2db tempest-GroupSnapshotsTest-1791257526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:35:26 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-73609486-ce91-4eac-b4ad-d5a60ce2f2db tempest-GroupSnapshotsTest-1791257526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:35:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-73609486-ce91-4eac-b4ad-d5a60ce2f2db tempest-GroupSnapshotsTest-1791257526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:35:26 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-73609486-ce91-4eac-b4ad-d5a60ce2f2db tempest-GroupSnapshotsTest-1791257526 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:35:26 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-73609486-ce91-4eac-b4ad-d5a60ce2f2db tempest-GroupSnapshotsTest-1791257526 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:35:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-73609486-ce91-4eac-b4ad-d5a60ce2f2db tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c305931-6883-4db9-a9b0-120bc5f58ec3 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:35:26 devstack sudo[103359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c305931-6883-4db9-a9b0-120bc5f58ec3 1073741824 Jun 23 16:35:26 devstack sudo[103359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:35:27 devstack sudo[103357]: pam_unix(sudo:session): session closed for user root Jun 23 16:35:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f3ec626f-3107-4c17-b8f7-404d25639bbb tempest-VolumesTransfersTest-170442864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-17364352-654b-4000-8561-42594d2167a1" returned: 0 in 0.938s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:35:27 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-f3ec626f-3107-4c17-b8f7-404d25639bbb tempest-VolumesTransfersTest-170442864 None] Lock "cinder-quobyte-17364352-654b-4000-8561-42594d2167a1" released by "delete_volume" :: held 2.051s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:35:27 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-f3ec626f-3107-4c17-b8f7-404d25639bbb tempest-VolumesTransfersTest-170442864 None] Created reservations ['9989c770-0941-4aa8-aa1f-78b9c87e3d4c', 'a328395e-dd4a-4bcc-8b5d-0fb51e81acc0', 'b0e32558-1a58-48d6-aafa-6931d40a6107', '2d7f454b-f337-47f2-a1ed-4adf4ed3bff0'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:35:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f3ec626f-3107-4c17-b8f7-404d25639bbb tempest-VolumesTransfersTest-170442864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:35:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f3ec626f-3107-4c17-b8f7-404d25639bbb tempest-VolumesTransfersTest-170442864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:35:27 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-f3ec626f-3107-4c17-b8f7-404d25639bbb tempest-VolumesTransfersTest-170442864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:35:27 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-f3ec626f-3107-4c17-b8f7-404d25639bbb tempest-VolumesTransfersTest-170442864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:35:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f3ec626f-3107-4c17-b8f7-404d25639bbb tempest-VolumesTransfersTest-170442864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:35:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f3ec626f-3107-4c17-b8f7-404d25639bbb tempest-VolumesTransfersTest-170442864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:35:27 devstack sudo[103362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:35:27 devstack sudo[103362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:35:28 devstack sudo[103359]: pam_unix(sudo:session): session closed for user root Jun 23 16:35:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-73609486-ce91-4eac-b4ad-d5a60ce2f2db tempest-GroupSnapshotsTest-1791257526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c305931-6883-4db9-a9b0-120bc5f58ec3 1073741824" returned: 0 in 1.621s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:35:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-73609486-ce91-4eac-b4ad-d5a60ce2f2db tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c305931-6883-4db9-a9b0-120bc5f58ec3 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:35:28 devstack sudo[103384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c305931-6883-4db9-a9b0-120bc5f58ec3 Jun 23 16:35:28 devstack sudo[103384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:35:28 devstack sudo[103362]: pam_unix(sudo:session): session closed for user root Jun 23 16:35:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f3ec626f-3107-4c17-b8f7-404d25639bbb tempest-VolumesTransfersTest-170442864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.221s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:35:28 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-f3ec626f-3107-4c17-b8f7-404d25639bbb tempest-VolumesTransfersTest-170442864 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:35:28 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-f3ec626f-3107-4c17-b8f7-404d25639bbb tempest-VolumesTransfersTest-170442864 None] Deleted volume successfully. Jun 23 16:35:28 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-f3ec626f-3107-4c17-b8f7-404d25639bbb tempest-VolumesTransfersTest-170442864 None] Lock "cinder-17364352-654b-4000-8561-42594d2167a1-delete_volume" released by "delete_volume" :: held 3.622s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:35:29 devstack sudo[103384]: pam_unix(sudo:session): session closed for user root Jun 23 16:35:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-73609486-ce91-4eac-b4ad-d5a60ce2f2db tempest-GroupSnapshotsTest-1791257526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c305931-6883-4db9-a9b0-120bc5f58ec3" returned: 0 in 0.952s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:35:29 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-73609486-ce91-4eac-b4ad-d5a60ce2f2db tempest-GroupSnapshotsTest-1791257526 None] <== create_volume: return (2681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:35:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-73609486-ce91-4eac-b4ad-d5a60ce2f2db tempest-GroupSnapshotsTest-1791257526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.684s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:35:29 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-73609486-ce91-4eac-b4ad-d5a60ce2f2db tempest-GroupSnapshotsTest-1791257526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (149173df-255d-4163-aaee-338dd6d82eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c305931-6883-4db9-a9b0-120bc5f58ec3', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:35:29 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-73609486-ce91-4eac-b4ad-d5a60ce2f2db tempest-GroupSnapshotsTest-1791257526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db91cf77-c2f8-443e-b816-6cc13ee0e921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:35:29 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-73609486-ce91-4eac-b4ad-d5a60ce2f2db tempest-GroupSnapshotsTest-1791257526 None] Volume volume-4c305931-6883-4db9-a9b0-120bc5f58ec3 (4c305931-6883-4db9-a9b0-120bc5f58ec3): created successfully Jun 23 16:35:29 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-73609486-ce91-4eac-b4ad-d5a60ce2f2db tempest-GroupSnapshotsTest-1791257526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db91cf77-c2f8-443e-b816-6cc13ee0e921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:35:29 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-73609486-ce91-4eac-b4ad-d5a60ce2f2db tempest-GroupSnapshotsTest-1791257526 None] Flow 'volume_create_manager' (a8281c28-738d-4d85-b398-71658875b623) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:35:29 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-73609486-ce91-4eac-b4ad-d5a60ce2f2db tempest-GroupSnapshotsTest-1791257526 None] Created volume successfully. Jun 23 16:35:31 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5a501d7-e343-4fc5-9949-b94990f3840e tempest-GroupSnapshotsTest-1791257526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:35:31 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5a501d7-e343-4fc5-9949-b94990f3840e tempest-GroupSnapshotsTest-1791257526 None] Flow 'volume_create_manager' (44065fc9-7b25-47ef-8b2a-536da1255718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:35:31 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5a501d7-e343-4fc5-9949-b94990f3840e tempest-GroupSnapshotsTest-1791257526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fb3645d-435c-4cf7-945a-96d7d479d5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:35:31 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5a501d7-e343-4fc5-9949-b94990f3840e tempest-GroupSnapshotsTest-1791257526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fb3645d-435c-4cf7-945a-96d7d479d5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:35:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-651237406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=77db8f01-19ac-40f0-93e0-104ffc1ae421,host='devstack@QuobyteHD#QuobyteHD',id=9dbfeb3b-e28e-496c-bf2e-834b1c1a4022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dce840d5703b4e59846cde5d1d050426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:35:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:35:31Z,use_quota=True,user_id='d42dedebf56a4672abe200b243a6ceca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b363de09-3e68-46eb-ac58-dc10feee9686),volume_type_id=b363de09-3e68-46eb-ac58-dc10feee9686)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:35:31 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5a501d7-e343-4fc5-9949-b94990f3840e tempest-GroupSnapshotsTest-1791257526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ba7dc32-b650-4043-ae7e-7f1a49e49a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:35:31 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5a501d7-e343-4fc5-9949-b94990f3840e tempest-GroupSnapshotsTest-1791257526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ba7dc32-b650-4043-ae7e-7f1a49e49a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:35:31 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5a501d7-e343-4fc5-9949-b94990f3840e tempest-GroupSnapshotsTest-1791257526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (655a2317-ef7e-47c0-a677-00d1cba9c585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:35:31 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5a501d7-e343-4fc5-9949-b94990f3840e tempest-GroupSnapshotsTest-1791257526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (655a2317-ef7e-47c0-a677-00d1cba9c585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dbfeb3b-e28e-496c-bf2e-834b1c1a4022', 'volume_name': 'volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:35:31 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5a501d7-e343-4fc5-9949-b94990f3840e tempest-GroupSnapshotsTest-1791257526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d50032f-6044-4af0-ac38-8de802c55050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:35:31 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5a501d7-e343-4fc5-9949-b94990f3840e tempest-GroupSnapshotsTest-1791257526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d50032f-6044-4af0-ac38-8de802c55050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:35:31 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5a501d7-e343-4fc5-9949-b94990f3840e tempest-GroupSnapshotsTest-1791257526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a759ac05-b950-4e8c-ae56-49fc63a024f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:35:31 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-c5a501d7-e343-4fc5-9949-b94990f3840e tempest-GroupSnapshotsTest-1791257526 None] Volume 9dbfeb3b-e28e-496c-bf2e-834b1c1a4022: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022', 'volume_size': 1} Jun 23 16:35:31 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-c5a501d7-e343-4fc5-9949-b94990f3840e tempest-GroupSnapshotsTest-1791257526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:35:31 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-c5a501d7-e343-4fc5-9949-b94990f3840e tempest-GroupSnapshotsTest-1791257526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:35:31 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-c5a501d7-e343-4fc5-9949-b94990f3840e tempest-GroupSnapshotsTest-1791257526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=77db8f01-19ac-40f0-93e0-104ffc1ae421,created_at=2026-06-23T14:35:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-651237406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=77db8f01-19ac-40f0-93e0-104ffc1ae421,host='devstack@QuobyteHD#QuobyteHD',id=9dbfeb3b-e28e-496c-bf2e-834b1c1a4022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dce840d5703b4e59846cde5d1d050426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:35:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:35:31Z,use_quota=True,user_id='d42dedebf56a4672abe200b243a6ceca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b363de09-3e68-46eb-ac58-dc10feee9686),volume_type_id=b363de09-3e68-46eb-ac58-dc10feee9686)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:35:31 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-c5a501d7-e343-4fc5-9949-b94990f3840e tempest-GroupSnapshotsTest-1791257526 None] Creating volume 9dbfeb3b-e28e-496c-bf2e-834b1c1a4022 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:35:31 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-c5a501d7-e343-4fc5-9949-b94990f3840e tempest-GroupSnapshotsTest-1791257526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:35:31 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-c5a501d7-e343-4fc5-9949-b94990f3840e tempest-GroupSnapshotsTest-1791257526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:35:31 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-c5a501d7-e343-4fc5-9949-b94990f3840e tempest-GroupSnapshotsTest-1791257526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:35:31 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-c5a501d7-e343-4fc5-9949-b94990f3840e tempest-GroupSnapshotsTest-1791257526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:35:31 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-c5a501d7-e343-4fc5-9949-b94990f3840e tempest-GroupSnapshotsTest-1791257526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:35:31 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-c5a501d7-e343-4fc5-9949-b94990f3840e tempest-GroupSnapshotsTest-1791257526 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:35:31 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-c5a501d7-e343-4fc5-9949-b94990f3840e tempest-GroupSnapshotsTest-1791257526 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:35:31 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c5a501d7-e343-4fc5-9949-b94990f3840e tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:35:31 devstack sudo[103430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022 1073741824 Jun 23 16:35:31 devstack sudo[103430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:35:32 devstack sudo[103430]: pam_unix(sudo:session): session closed for user root Jun 23 16:35:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c5a501d7-e343-4fc5-9949-b94990f3840e tempest-GroupSnapshotsTest-1791257526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022 1073741824" returned: 0 in 1.450s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:35:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c5a501d7-e343-4fc5-9949-b94990f3840e tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:35:32 devstack sudo[103438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022 Jun 23 16:35:32 devstack sudo[103438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:35:33 devstack sudo[103438]: pam_unix(sudo:session): session closed for user root Jun 23 16:35:33 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c5a501d7-e343-4fc5-9949-b94990f3840e tempest-GroupSnapshotsTest-1791257526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022" returned: 0 in 0.943s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:35:33 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-c5a501d7-e343-4fc5-9949-b94990f3840e tempest-GroupSnapshotsTest-1791257526 None] <== create_volume: return (2452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:35:33 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-c5a501d7-e343-4fc5-9949-b94990f3840e tempest-GroupSnapshotsTest-1791257526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.456s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:35:33 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5a501d7-e343-4fc5-9949-b94990f3840e tempest-GroupSnapshotsTest-1791257526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a759ac05-b950-4e8c-ae56-49fc63a024f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:35:33 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5a501d7-e343-4fc5-9949-b94990f3840e tempest-GroupSnapshotsTest-1791257526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e5298fe-dadb-45e1-9760-eed5776c5a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:35:33 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-c5a501d7-e343-4fc5-9949-b94990f3840e tempest-GroupSnapshotsTest-1791257526 None] Volume volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022 (9dbfeb3b-e28e-496c-bf2e-834b1c1a4022): created successfully Jun 23 16:35:33 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5a501d7-e343-4fc5-9949-b94990f3840e tempest-GroupSnapshotsTest-1791257526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e5298fe-dadb-45e1-9760-eed5776c5a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:35:33 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5a501d7-e343-4fc5-9949-b94990f3840e tempest-GroupSnapshotsTest-1791257526 None] Flow 'volume_create_manager' (44065fc9-7b25-47ef-8b2a-536da1255718) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:35:33 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-c5a501d7-e343-4fc5-9949-b94990f3840e tempest-GroupSnapshotsTest-1791257526 None] Created volume successfully. Jun 23 16:35:35 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-c51a5b55-78a5-4464-910c-3b9147908052 tempest-GroupSnapshotsTest-1791257526 None] Update group completed successfully. Jun 23 16:35:36 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-97692f83-1559-41df-a2a8-a6b3d5c339b1 tempest-GroupSnapshotsTest-1791257526 None] Update group completed successfully. Jun 23 16:35:37 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-095fe318-61a0-46b0-9a86-9220c108a231 tempest-GroupSnapshotsTest-1791257526 None] Update group completed successfully. Jun 23 16:35:39 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-c135e136-e0f1-4a67-aae1-bdf8696e562b tempest-GroupSnapshotsTest-1791257526 None] Update group completed successfully. Jun 23 16:35:41 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-1c3aa555-2f32-49a3-8c64-4f9925400a3c tempest-GroupSnapshotsTest-1791257526 None] GroupSnapshot 6246523c-ca2e-492e-9794-d62d74220d69: creating. Jun 23 16:35:41 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-1c3aa555-2f32-49a3-8c64-4f9925400a3c tempest-GroupSnapshotsTest-1791257526 None] Group snapshot 6246523c-ca2e-492e-9794-d62d74220d69: creating. {{(pid=93788) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 23 16:35:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-1c3aa555-2f32-49a3-8c64-4f9925400a3c tempest-GroupSnapshotsTest-1791257526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:35:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-1c3aa555-2f32-49a3-8c64-4f9925400a3c tempest-GroupSnapshotsTest-1791257526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:35:41 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-1c3aa555-2f32-49a3-8c64-4f9925400a3c tempest-GroupSnapshotsTest-1791257526 None] Creating offline snapshot bccb01c7-0b48-4526-b3a9-c43f38ef234d of volume 9dbfeb3b-e28e-496c-bf2e-834b1c1a4022 {{(pid=93788) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:35:41 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df9890c-6916-4b68-98fc-7a2b4bcf9528]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:35:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1c3aa555-2f32-49a3-8c64-4f9925400a3c tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:35:41 devstack sudo[103527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022 Jun 23 16:35:41 devstack sudo[103527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:35:42 devstack sudo[103527]: pam_unix(sudo:session): session closed for user root Jun 23 16:35:42 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1c3aa555-2f32-49a3-8c64-4f9925400a3c tempest-GroupSnapshotsTest-1791257526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022" returned: 0 in 1.044s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:35:42 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1c3aa555-2f32-49a3-8c64-4f9925400a3c tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022.bccb01c7-0b48-4526-b3a9-c43f38ef234d 1G {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:35:42 devstack sudo[103532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022.bccb01c7-0b48-4526-b3a9-c43f38ef234d 1G Jun 23 16:35:42 devstack sudo[103532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:35:43 devstack sudo[103532]: pam_unix(sudo:session): session closed for user root Jun 23 16:35:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1c3aa555-2f32-49a3-8c64-4f9925400a3c tempest-GroupSnapshotsTest-1791257526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022.bccb01c7-0b48-4526-b3a9-c43f38ef234d 1G" returned: 0 in 1.245s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:35:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1c3aa555-2f32-49a3-8c64-4f9925400a3c tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022.bccb01c7-0b48-4526-b3a9-c43f38ef234d {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:35:43 devstack sudo[103537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022.bccb01c7-0b48-4526-b3a9-c43f38ef234d Jun 23 16:35:43 devstack sudo[103537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:35:44 devstack sudo[103537]: pam_unix(sudo:session): session closed for user root Jun 23 16:35:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1c3aa555-2f32-49a3-8c64-4f9925400a3c tempest-GroupSnapshotsTest-1791257526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022.bccb01c7-0b48-4526-b3a9-c43f38ef234d" returned: 0 in 1.009s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:35:44 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-1c3aa555-2f32-49a3-8c64-4f9925400a3c tempest-GroupSnapshotsTest-1791257526 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022.bccb01c7-0b48-4526-b3a9-c43f38ef234d is being set with open permissions: ugo+rw: NotImplementedError Jun 23 16:35:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1c3aa555-2f32-49a3-8c64-4f9925400a3c tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022.bccb01c7-0b48-4526-b3a9-c43f38ef234d {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:35:44 devstack sudo[103542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022.bccb01c7-0b48-4526-b3a9-c43f38ef234d Jun 23 16:35:44 devstack sudo[103542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:35:45 devstack sudo[103542]: pam_unix(sudo:session): session closed for user root Jun 23 16:35:45 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1c3aa555-2f32-49a3-8c64-4f9925400a3c tempest-GroupSnapshotsTest-1791257526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022.bccb01c7-0b48-4526-b3a9-c43f38ef234d" returned: 0 in 1.051s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:35:45 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:SELECT=100,cinder:INSERT=30,cinder:UPDATE=114,cinder:DELETE=6 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:35:45 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:SELECT=110,cinder:INSERT=27,cinder:UPDATE=126,cinder:DELETE=7 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:35:45 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1c3aa555-2f32-49a3-8c64-4f9925400a3c tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:35:45 devstack sudo[103545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022.info Jun 23 16:35:45 devstack sudo[103545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:35:46 devstack sudo[103545]: pam_unix(sudo:session): session closed for user root Jun 23 16:35:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1c3aa555-2f32-49a3-8c64-4f9925400a3c tempest-GroupSnapshotsTest-1791257526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022.info" returned: 0 in 1.228s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:35:46 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-1c3aa555-2f32-49a3-8c64-4f9925400a3c tempest-GroupSnapshotsTest-1791257526 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022.info is being set with open permissions: ugo+rw: NotImplementedError Jun 23 16:35:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1c3aa555-2f32-49a3-8c64-4f9925400a3c tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:35:46 devstack sudo[103554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022.info Jun 23 16:35:46 devstack sudo[103554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:35:47 devstack sudo[103554]: pam_unix(sudo:session): session closed for user root Jun 23 16:35:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1c3aa555-2f32-49a3-8c64-4f9925400a3c tempest-GroupSnapshotsTest-1791257526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022.info" returned: 0 in 0.960s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:35:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-1c3aa555-2f32-49a3-8c64-4f9925400a3c tempest-GroupSnapshotsTest-1791257526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.683s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:35:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-1c3aa555-2f32-49a3-8c64-4f9925400a3c tempest-GroupSnapshotsTest-1791257526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:35:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-1c3aa555-2f32-49a3-8c64-4f9925400a3c tempest-GroupSnapshotsTest-1791257526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:35:47 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-1c3aa555-2f32-49a3-8c64-4f9925400a3c tempest-GroupSnapshotsTest-1791257526 None] Creating offline snapshot e85e22c4-6528-44c6-9180-9f13c8ca672b of volume 4c305931-6883-4db9-a9b0-120bc5f58ec3 {{(pid=93788) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:35:47 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ea2331-41e2-45b5-9c37-f7e0f00f48ae]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:35:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1c3aa555-2f32-49a3-8c64-4f9925400a3c tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c305931-6883-4db9-a9b0-120bc5f58ec3 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:35:48 devstack sudo[103559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c305931-6883-4db9-a9b0-120bc5f58ec3 Jun 23 16:35:48 devstack sudo[103559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:35:49 devstack sudo[103559]: pam_unix(sudo:session): session closed for user root Jun 23 16:35:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1c3aa555-2f32-49a3-8c64-4f9925400a3c tempest-GroupSnapshotsTest-1791257526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c305931-6883-4db9-a9b0-120bc5f58ec3" returned: 0 in 1.474s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:35:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1c3aa555-2f32-49a3-8c64-4f9925400a3c tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c305931-6883-4db9-a9b0-120bc5f58ec3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c305931-6883-4db9-a9b0-120bc5f58ec3.e85e22c4-6528-44c6-9180-9f13c8ca672b 1G {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:35:49 devstack sudo[103566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c305931-6883-4db9-a9b0-120bc5f58ec3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c305931-6883-4db9-a9b0-120bc5f58ec3.e85e22c4-6528-44c6-9180-9f13c8ca672b 1G Jun 23 16:35:49 devstack sudo[103566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:35:50 devstack sudo[103566]: pam_unix(sudo:session): session closed for user root Jun 23 16:35:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1c3aa555-2f32-49a3-8c64-4f9925400a3c tempest-GroupSnapshotsTest-1791257526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c305931-6883-4db9-a9b0-120bc5f58ec3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c305931-6883-4db9-a9b0-120bc5f58ec3.e85e22c4-6528-44c6-9180-9f13c8ca672b 1G" returned: 0 in 1.265s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:35:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1c3aa555-2f32-49a3-8c64-4f9925400a3c tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c305931-6883-4db9-a9b0-120bc5f58ec3 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c305931-6883-4db9-a9b0-120bc5f58ec3.e85e22c4-6528-44c6-9180-9f13c8ca672b {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:35:50 devstack sudo[103573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c305931-6883-4db9-a9b0-120bc5f58ec3 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c305931-6883-4db9-a9b0-120bc5f58ec3.e85e22c4-6528-44c6-9180-9f13c8ca672b Jun 23 16:35:50 devstack sudo[103573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:35:51 devstack sudo[103573]: pam_unix(sudo:session): session closed for user root Jun 23 16:35:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1c3aa555-2f32-49a3-8c64-4f9925400a3c tempest-GroupSnapshotsTest-1791257526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c305931-6883-4db9-a9b0-120bc5f58ec3 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c305931-6883-4db9-a9b0-120bc5f58ec3.e85e22c4-6528-44c6-9180-9f13c8ca672b" returned: 0 in 1.091s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:35:51 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-1c3aa555-2f32-49a3-8c64-4f9925400a3c tempest-GroupSnapshotsTest-1791257526 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c305931-6883-4db9-a9b0-120bc5f58ec3.e85e22c4-6528-44c6-9180-9f13c8ca672b is being set with open permissions: ugo+rw: NotImplementedError Jun 23 16:35:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1c3aa555-2f32-49a3-8c64-4f9925400a3c tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c305931-6883-4db9-a9b0-120bc5f58ec3.e85e22c4-6528-44c6-9180-9f13c8ca672b {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:35:51 devstack sudo[103602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c305931-6883-4db9-a9b0-120bc5f58ec3.e85e22c4-6528-44c6-9180-9f13c8ca672b Jun 23 16:35:51 devstack sudo[103602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:35:52 devstack sudo[103602]: pam_unix(sudo:session): session closed for user root Jun 23 16:35:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1c3aa555-2f32-49a3-8c64-4f9925400a3c tempest-GroupSnapshotsTest-1791257526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c305931-6883-4db9-a9b0-120bc5f58ec3.e85e22c4-6528-44c6-9180-9f13c8ca672b" returned: 0 in 0.789s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:35:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1c3aa555-2f32-49a3-8c64-4f9925400a3c tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c305931-6883-4db9-a9b0-120bc5f58ec3.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:35:52 devstack sudo[103605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c305931-6883-4db9-a9b0-120bc5f58ec3.info Jun 23 16:35:52 devstack sudo[103605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:35:53 devstack sudo[103605]: pam_unix(sudo:session): session closed for user root Jun 23 16:35:53 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1c3aa555-2f32-49a3-8c64-4f9925400a3c tempest-GroupSnapshotsTest-1791257526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c305931-6883-4db9-a9b0-120bc5f58ec3.info" returned: 0 in 0.798s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:35:53 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-1c3aa555-2f32-49a3-8c64-4f9925400a3c tempest-GroupSnapshotsTest-1791257526 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c305931-6883-4db9-a9b0-120bc5f58ec3.info is being set with open permissions: ugo+rw: NotImplementedError Jun 23 16:35:53 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1c3aa555-2f32-49a3-8c64-4f9925400a3c tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c305931-6883-4db9-a9b0-120bc5f58ec3.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:35:53 devstack sudo[103608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c305931-6883-4db9-a9b0-120bc5f58ec3.info Jun 23 16:35:53 devstack sudo[103608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:35:54 devstack sudo[103608]: pam_unix(sudo:session): session closed for user root Jun 23 16:35:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1c3aa555-2f32-49a3-8c64-4f9925400a3c tempest-GroupSnapshotsTest-1791257526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c305931-6883-4db9-a9b0-120bc5f58ec3.info" returned: 0 in 0.756s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:35:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-1c3aa555-2f32-49a3-8c64-4f9925400a3c tempest-GroupSnapshotsTest-1791257526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.319s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:35:54 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-1c3aa555-2f32-49a3-8c64-4f9925400a3c tempest-GroupSnapshotsTest-1791257526 None] group_snapshot 6246523c-ca2e-492e-9794-d62d74220d69: created successfully Jun 23 16:35:55 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-c26943d3-6f0a-45a1-b10f-984bcc4b62f7 tempest-GroupSnapshotsTest-1791257526 None] group_snapshot 6246523c-ca2e-492e-9794-d62d74220d69: deleting Jun 23 16:35:55 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c26943d3-6f0a-45a1-b10f-984bcc4b62f7 tempest-GroupSnapshotsTest-1791257526 None] group_snapshot 6246523c-ca2e-492e-9794-d62d74220d69: deleting {{(pid=93788) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 23 16:35:55 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-c26943d3-6f0a-45a1-b10f-984bcc4b62f7 tempest-GroupSnapshotsTest-1791257526 None] Acquiring lock "cinder-quobyte-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:35:55 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-c26943d3-6f0a-45a1-b10f-984bcc4b62f7 tempest-GroupSnapshotsTest-1791257526 None] Lock "cinder-quobyte-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022" acquired by "delete_snapshot" :: waited 0.045s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:35:55 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-c26943d3-6f0a-45a1-b10f-984bcc4b62f7 tempest-GroupSnapshotsTest-1791257526 None] Acquiring lock "cinder-quobyte-bccb01c7-0b48-4526-b3a9-c43f38ef234d" by "_delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:35:55 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-c26943d3-6f0a-45a1-b10f-984bcc4b62f7 tempest-GroupSnapshotsTest-1791257526 None] Lock "cinder-quobyte-bccb01c7-0b48-4526-b3a9-c43f38ef234d" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:35:55 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-c26943d3-6f0a-45a1-b10f-984bcc4b62f7 tempest-GroupSnapshotsTest-1791257526 None] Deleting offline snapshot bccb01c7-0b48-4526-b3a9-c43f38ef234d of volume 9dbfeb3b-e28e-496c-bf2e-834b1c1a4022 {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:35:55 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-c26943d3-6f0a-45a1-b10f-984bcc4b62f7 tempest-GroupSnapshotsTest-1791257526 None] snapshot_file for this snap is: volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022.bccb01c7-0b48-4526-b3a9-c43f38ef234d {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:35:55 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d932fd3f-47a4-431d-b577-0890c246d429]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:35:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c26943d3-6f0a-45a1-b10f-984bcc4b62f7 tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022.bccb01c7-0b48-4526-b3a9-c43f38ef234d {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:35:55 devstack sudo[103611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022.bccb01c7-0b48-4526-b3a9-c43f38ef234d Jun 23 16:35:55 devstack sudo[103611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:35:56 devstack sudo[103611]: pam_unix(sudo:session): session closed for user root Jun 23 16:35:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c26943d3-6f0a-45a1-b10f-984bcc4b62f7 tempest-GroupSnapshotsTest-1791257526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022.bccb01c7-0b48-4526-b3a9-c43f38ef234d" returned: 0 in 0.922s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:35:56 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-c26943d3-6f0a-45a1-b10f-984bcc4b62f7 tempest-GroupSnapshotsTest-1791257526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:35:56 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ae15ee-0f6c-4b72-ac04-11eb1597704e]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:35:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c26943d3-6f0a-45a1-b10f-984bcc4b62f7 tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:35:56 devstack sudo[103616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022 Jun 23 16:35:56 devstack sudo[103616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:35:57 devstack sudo[103616]: pam_unix(sudo:session): session closed for user root Jun 23 16:35:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c26943d3-6f0a-45a1-b10f-984bcc4b62f7 tempest-GroupSnapshotsTest-1791257526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022" returned: 0 in 1.147s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:35:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c26943d3-6f0a-45a1-b10f-984bcc4b62f7 tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022.bccb01c7-0b48-4526-b3a9-c43f38ef234d {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:35:57 devstack sudo[103621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022.bccb01c7-0b48-4526-b3a9-c43f38ef234d Jun 23 16:35:57 devstack sudo[103621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:35:58 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-93498277-74c8-4115-9dc3-ba798f938142 tempest-VolumesActionsTest-1224009287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:35:58 devstack sudo[103621]: pam_unix(sudo:session): session closed for user root Jun 23 16:35:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-93498277-74c8-4115-9dc3-ba798f938142 tempest-VolumesActionsTest-1224009287 None] Flow 'volume_create_manager' (aa623a6a-e688-451e-8ccc-2b2f94eb2c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:35:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-93498277-74c8-4115-9dc3-ba798f938142 tempest-VolumesActionsTest-1224009287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a41e4ea3-fe7a-4796-9772-4a7cf996962d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:35:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c26943d3-6f0a-45a1-b10f-984bcc4b62f7 tempest-GroupSnapshotsTest-1791257526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022.bccb01c7-0b48-4526-b3a9-c43f38ef234d" returned: 0 in 1.203s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:35:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c26943d3-6f0a-45a1-b10f-984bcc4b62f7 tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022.bccb01c7-0b48-4526-b3a9-c43f38ef234d {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:35:59 devstack sudo[103627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022.bccb01c7-0b48-4526-b3a9-c43f38ef234d Jun 23 16:35:59 devstack sudo[103627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:35:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-93498277-74c8-4115-9dc3-ba798f938142 tempest-VolumesActionsTest-1224009287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a41e4ea3-fe7a-4796-9772-4a7cf996962d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:35:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-472919621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3434346-f7a9-4aaa-8210-6e8c244d1a95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47744a691d8046d0a19cc80e2dccbde5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:35:59Z,use_quota=True,user_id='1eaa39a65cff4c6b9930e6dca421eab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:35:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-93498277-74c8-4115-9dc3-ba798f938142 tempest-VolumesActionsTest-1224009287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d6023a9-8b33-4f9f-b4dd-9e3e1f31966b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:35:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-93498277-74c8-4115-9dc3-ba798f938142 tempest-VolumesActionsTest-1224009287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d6023a9-8b33-4f9f-b4dd-9e3e1f31966b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:35:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-93498277-74c8-4115-9dc3-ba798f938142 tempest-VolumesActionsTest-1224009287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (200d2ebc-c990-4221-a125-bd1aee9b7e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:35:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-93498277-74c8-4115-9dc3-ba798f938142 tempest-VolumesActionsTest-1224009287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (200d2ebc-c990-4221-a125-bd1aee9b7e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3434346-f7a9-4aaa-8210-6e8c244d1a95', 'volume_name': 'volume-e3434346-f7a9-4aaa-8210-6e8c244d1a95', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:35:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-93498277-74c8-4115-9dc3-ba798f938142 tempest-VolumesActionsTest-1224009287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf213f7f-4c3e-4271-90da-e3a4686a94a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:35:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-93498277-74c8-4115-9dc3-ba798f938142 tempest-VolumesActionsTest-1224009287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf213f7f-4c3e-4271-90da-e3a4686a94a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:35:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-93498277-74c8-4115-9dc3-ba798f938142 tempest-VolumesActionsTest-1224009287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (271afa0d-daa9-4394-ba86-81f57239f9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:35:59 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-93498277-74c8-4115-9dc3-ba798f938142 tempest-VolumesActionsTest-1224009287 None] Volume e3434346-f7a9-4aaa-8210-6e8c244d1a95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3434346-f7a9-4aaa-8210-6e8c244d1a95', 'volume_size': 1} Jun 23 16:35:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-93498277-74c8-4115-9dc3-ba798f938142 tempest-VolumesActionsTest-1224009287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:35:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-93498277-74c8-4115-9dc3-ba798f938142 tempest-VolumesActionsTest-1224009287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:35:59 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-93498277-74c8-4115-9dc3-ba798f938142 tempest-VolumesActionsTest-1224009287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:35:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-472919621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3434346-f7a9-4aaa-8210-6e8c244d1a95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47744a691d8046d0a19cc80e2dccbde5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:35:59Z,use_quota=True,user_id='1eaa39a65cff4c6b9930e6dca421eab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:35:59 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-93498277-74c8-4115-9dc3-ba798f938142 tempest-VolumesActionsTest-1224009287 None] Creating volume e3434346-f7a9-4aaa-8210-6e8c244d1a95 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:35:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-93498277-74c8-4115-9dc3-ba798f938142 tempest-VolumesActionsTest-1224009287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:35:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-93498277-74c8-4115-9dc3-ba798f938142 tempest-VolumesActionsTest-1224009287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:35:59 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-93498277-74c8-4115-9dc3-ba798f938142 tempest-VolumesActionsTest-1224009287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:35:59 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-93498277-74c8-4115-9dc3-ba798f938142 tempest-VolumesActionsTest-1224009287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:35:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-93498277-74c8-4115-9dc3-ba798f938142 tempest-VolumesActionsTest-1224009287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:35:59 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-93498277-74c8-4115-9dc3-ba798f938142 tempest-VolumesActionsTest-1224009287 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:35:59 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-93498277-74c8-4115-9dc3-ba798f938142 tempest-VolumesActionsTest-1224009287 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:35:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-93498277-74c8-4115-9dc3-ba798f938142 tempest-VolumesActionsTest-1224009287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3434346-f7a9-4aaa-8210-6e8c244d1a95 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:35:59 devstack sudo[103629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3434346-f7a9-4aaa-8210-6e8c244d1a95 1073741824 Jun 23 16:35:59 devstack sudo[103629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:00 devstack sudo[103627]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c26943d3-6f0a-45a1-b10f-984bcc4b62f7 tempest-GroupSnapshotsTest-1791257526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022.bccb01c7-0b48-4526-b3a9-c43f38ef234d" returned: 0 in 1.281s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:00 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-c26943d3-6f0a-45a1-b10f-984bcc4b62f7 tempest-GroupSnapshotsTest-1791257526 None] Lock "cinder-quobyte-bccb01c7-0b48-4526-b3a9-c43f38ef234d" released by "_delete_snapshot" :: held 4.733s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:36:00 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-c26943d3-6f0a-45a1-b10f-984bcc4b62f7 tempest-GroupSnapshotsTest-1791257526 None] Lock "cinder-quobyte-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022" released by "delete_snapshot" :: held 4.791s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:36:00 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-c26943d3-6f0a-45a1-b10f-984bcc4b62f7 tempest-GroupSnapshotsTest-1791257526 None] Acquiring lock "cinder-quobyte-4c305931-6883-4db9-a9b0-120bc5f58ec3" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:36:00 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-c26943d3-6f0a-45a1-b10f-984bcc4b62f7 tempest-GroupSnapshotsTest-1791257526 None] Lock "cinder-quobyte-4c305931-6883-4db9-a9b0-120bc5f58ec3" acquired by "delete_snapshot" :: waited 0.043s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:36:00 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-c26943d3-6f0a-45a1-b10f-984bcc4b62f7 tempest-GroupSnapshotsTest-1791257526 None] Acquiring lock "cinder-quobyte-e85e22c4-6528-44c6-9180-9f13c8ca672b" by "_delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:36:00 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-c26943d3-6f0a-45a1-b10f-984bcc4b62f7 tempest-GroupSnapshotsTest-1791257526 None] Lock "cinder-quobyte-e85e22c4-6528-44c6-9180-9f13c8ca672b" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:36:00 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-c26943d3-6f0a-45a1-b10f-984bcc4b62f7 tempest-GroupSnapshotsTest-1791257526 None] Deleting offline snapshot e85e22c4-6528-44c6-9180-9f13c8ca672b of volume 4c305931-6883-4db9-a9b0-120bc5f58ec3 {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:36:00 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-c26943d3-6f0a-45a1-b10f-984bcc4b62f7 tempest-GroupSnapshotsTest-1791257526 None] snapshot_file for this snap is: volume-4c305931-6883-4db9-a9b0-120bc5f58ec3.e85e22c4-6528-44c6-9180-9f13c8ca672b {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:36:00 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec23deef-c6e3-471c-9915-5452a6c00a00]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:36:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c26943d3-6f0a-45a1-b10f-984bcc4b62f7 tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c305931-6883-4db9-a9b0-120bc5f58ec3.e85e22c4-6528-44c6-9180-9f13c8ca672b {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:00 devstack sudo[103629]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-93498277-74c8-4115-9dc3-ba798f938142 tempest-VolumesActionsTest-1224009287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3434346-f7a9-4aaa-8210-6e8c244d1a95 1073741824" returned: 0 in 1.726s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:00 devstack sudo[103636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c305931-6883-4db9-a9b0-120bc5f58ec3.e85e22c4-6528-44c6-9180-9f13c8ca672b Jun 23 16:36:00 devstack sudo[103636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-93498277-74c8-4115-9dc3-ba798f938142 tempest-VolumesActionsTest-1224009287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3434346-f7a9-4aaa-8210-6e8c244d1a95 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:01 devstack sudo[103640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3434346-f7a9-4aaa-8210-6e8c244d1a95 Jun 23 16:36:01 devstack sudo[103640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:01 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:36:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:36:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:36:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:36:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:36:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:36:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:01 devstack sudo[103642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:36:01 devstack sudo[103642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:01 devstack sudo[103640]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-93498277-74c8-4115-9dc3-ba798f938142 tempest-VolumesActionsTest-1224009287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3434346-f7a9-4aaa-8210-6e8c244d1a95" returned: 0 in 0.971s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-93498277-74c8-4115-9dc3-ba798f938142 tempest-VolumesActionsTest-1224009287 None] <== create_volume: return (2795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:36:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-93498277-74c8-4115-9dc3-ba798f938142 tempest-VolumesActionsTest-1224009287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.798s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:36:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-93498277-74c8-4115-9dc3-ba798f938142 tempest-VolumesActionsTest-1224009287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (271afa0d-daa9-4394-ba86-81f57239f9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3434346-f7a9-4aaa-8210-6e8c244d1a95', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:36:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-93498277-74c8-4115-9dc3-ba798f938142 tempest-VolumesActionsTest-1224009287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38a26235-87bf-4807-a839-e887696b26dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:36:01 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-93498277-74c8-4115-9dc3-ba798f938142 tempest-VolumesActionsTest-1224009287 None] Volume volume-e3434346-f7a9-4aaa-8210-6e8c244d1a95 (e3434346-f7a9-4aaa-8210-6e8c244d1a95): created successfully Jun 23 16:36:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-93498277-74c8-4115-9dc3-ba798f938142 tempest-VolumesActionsTest-1224009287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38a26235-87bf-4807-a839-e887696b26dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:36:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-93498277-74c8-4115-9dc3-ba798f938142 tempest-VolumesActionsTest-1224009287 None] Flow 'volume_create_manager' (aa623a6a-e688-451e-8ccc-2b2f94eb2c9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:36:02 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-93498277-74c8-4115-9dc3-ba798f938142 tempest-VolumesActionsTest-1224009287 None] Created volume successfully. Jun 23 16:36:02 devstack sudo[103636]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c26943d3-6f0a-45a1-b10f-984bcc4b62f7 tempest-GroupSnapshotsTest-1791257526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c305931-6883-4db9-a9b0-120bc5f58ec3.e85e22c4-6528-44c6-9180-9f13c8ca672b" returned: 0 in 1.498s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:02 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-c26943d3-6f0a-45a1-b10f-984bcc4b62f7 tempest-GroupSnapshotsTest-1791257526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c305931-6883-4db9-a9b0-120bc5f58ec3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:36:02 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7d2f0a-9d55-431a-b65e-f29529cc4ca0]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:36:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c26943d3-6f0a-45a1-b10f-984bcc4b62f7 tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c305931-6883-4db9-a9b0-120bc5f58ec3 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:02 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-59020032-10dd-46bc-bcf8-1a95a5a18bbd tempest-AttachVolumeTestJSON-1111501152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:36:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-59020032-10dd-46bc-bcf8-1a95a5a18bbd tempest-AttachVolumeTestJSON-1111501152 None] Flow 'volume_create_manager' (1363a7c8-e39c-468c-ae4b-a942b56ec215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:36:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-59020032-10dd-46bc-bcf8-1a95a5a18bbd tempest-AttachVolumeTestJSON-1111501152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e941d3bb-3136-4184-a4af-d5b876aaf082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:36:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-59020032-10dd-46bc-bcf8-1a95a5a18bbd tempest-AttachVolumeTestJSON-1111501152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e941d3bb-3136-4184-a4af-d5b876aaf082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1818714372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57d7e545-00fc-40df-a244-1c6bc8a1e607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e57d651cfd04e00826ec703018aca5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:36:02Z,use_quota=True,user_id='f831cea18f3c4738b5b0b0388ed86b3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:36:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-59020032-10dd-46bc-bcf8-1a95a5a18bbd tempest-AttachVolumeTestJSON-1111501152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ba214ae-7bc3-4958-af09-6f85d939f49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:36:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-59020032-10dd-46bc-bcf8-1a95a5a18bbd tempest-AttachVolumeTestJSON-1111501152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ba214ae-7bc3-4958-af09-6f85d939f49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:36:02 devstack sudo[103649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c305931-6883-4db9-a9b0-120bc5f58ec3 Jun 23 16:36:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-59020032-10dd-46bc-bcf8-1a95a5a18bbd tempest-AttachVolumeTestJSON-1111501152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dc23e44-fa37-4f13-8ac2-05be6d490a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:36:02 devstack sudo[103649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-59020032-10dd-46bc-bcf8-1a95a5a18bbd tempest-AttachVolumeTestJSON-1111501152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dc23e44-fa37-4f13-8ac2-05be6d490a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57d7e545-00fc-40df-a244-1c6bc8a1e607', 'volume_name': 'volume-57d7e545-00fc-40df-a244-1c6bc8a1e607', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:36:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-59020032-10dd-46bc-bcf8-1a95a5a18bbd tempest-AttachVolumeTestJSON-1111501152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0df53837-79c2-41eb-ae9b-cb923bf69571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:36:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-59020032-10dd-46bc-bcf8-1a95a5a18bbd tempest-AttachVolumeTestJSON-1111501152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0df53837-79c2-41eb-ae9b-cb923bf69571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:36:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-59020032-10dd-46bc-bcf8-1a95a5a18bbd tempest-AttachVolumeTestJSON-1111501152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a81bc86f-c81d-4427-b189-af5355b7cdad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:36:02 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-59020032-10dd-46bc-bcf8-1a95a5a18bbd tempest-AttachVolumeTestJSON-1111501152 None] Volume 57d7e545-00fc-40df-a244-1c6bc8a1e607: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57d7e545-00fc-40df-a244-1c6bc8a1e607', 'volume_size': 1} Jun 23 16:36:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-59020032-10dd-46bc-bcf8-1a95a5a18bbd tempest-AttachVolumeTestJSON-1111501152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:36:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-59020032-10dd-46bc-bcf8-1a95a5a18bbd tempest-AttachVolumeTestJSON-1111501152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:36:02 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-59020032-10dd-46bc-bcf8-1a95a5a18bbd tempest-AttachVolumeTestJSON-1111501152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1818714372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57d7e545-00fc-40df-a244-1c6bc8a1e607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e57d651cfd04e00826ec703018aca5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:36:02Z,use_quota=True,user_id='f831cea18f3c4738b5b0b0388ed86b3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:36:02 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-59020032-10dd-46bc-bcf8-1a95a5a18bbd tempest-AttachVolumeTestJSON-1111501152 None] Creating volume 57d7e545-00fc-40df-a244-1c6bc8a1e607 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:36:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-59020032-10dd-46bc-bcf8-1a95a5a18bbd tempest-AttachVolumeTestJSON-1111501152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:36:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-59020032-10dd-46bc-bcf8-1a95a5a18bbd tempest-AttachVolumeTestJSON-1111501152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:36:02 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-59020032-10dd-46bc-bcf8-1a95a5a18bbd tempest-AttachVolumeTestJSON-1111501152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:36:02 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-59020032-10dd-46bc-bcf8-1a95a5a18bbd tempest-AttachVolumeTestJSON-1111501152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:36:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-59020032-10dd-46bc-bcf8-1a95a5a18bbd tempest-AttachVolumeTestJSON-1111501152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:36:02 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-59020032-10dd-46bc-bcf8-1a95a5a18bbd tempest-AttachVolumeTestJSON-1111501152 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:36:02 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-59020032-10dd-46bc-bcf8-1a95a5a18bbd tempest-AttachVolumeTestJSON-1111501152 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:36:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-59020032-10dd-46bc-bcf8-1a95a5a18bbd tempest-AttachVolumeTestJSON-1111501152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-57d7e545-00fc-40df-a244-1c6bc8a1e607 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:02 devstack sudo[103652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-57d7e545-00fc-40df-a244-1c6bc8a1e607 1073741824 Jun 23 16:36:02 devstack sudo[103652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:02 devstack sudo[103642]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.280s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:02 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:36:02 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager._thread_info {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:36:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread count: 8 {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 16:36:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread info: [<_MainThread(MainThread, started 126303828988032)>, , , , , , , ] {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 16:36:03 devstack sudo[103649]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c26943d3-6f0a-45a1-b10f-984bcc4b62f7 tempest-GroupSnapshotsTest-1791257526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c305931-6883-4db9-a9b0-120bc5f58ec3" returned: 0 in 1.035s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c26943d3-6f0a-45a1-b10f-984bcc4b62f7 tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c305931-6883-4db9-a9b0-120bc5f58ec3.e85e22c4-6528-44c6-9180-9f13c8ca672b {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:03 devstack sudo[103664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c305931-6883-4db9-a9b0-120bc5f58ec3.e85e22c4-6528-44c6-9180-9f13c8ca672b Jun 23 16:36:03 devstack sudo[103664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:03 devstack sudo[103652]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-59020032-10dd-46bc-bcf8-1a95a5a18bbd tempest-AttachVolumeTestJSON-1111501152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-57d7e545-00fc-40df-a244-1c6bc8a1e607 1073741824" returned: 0 in 1.283s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-59020032-10dd-46bc-bcf8-1a95a5a18bbd tempest-AttachVolumeTestJSON-1111501152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-57d7e545-00fc-40df-a244-1c6bc8a1e607 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:03 devstack sudo[103670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-57d7e545-00fc-40df-a244-1c6bc8a1e607 Jun 23 16:36:03 devstack sudo[103670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:04 devstack sudo[103664]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c26943d3-6f0a-45a1-b10f-984bcc4b62f7 tempest-GroupSnapshotsTest-1791257526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c305931-6883-4db9-a9b0-120bc5f58ec3.e85e22c4-6528-44c6-9180-9f13c8ca672b" returned: 0 in 1.159s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c26943d3-6f0a-45a1-b10f-984bcc4b62f7 tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c305931-6883-4db9-a9b0-120bc5f58ec3.e85e22c4-6528-44c6-9180-9f13c8ca672b {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:04 devstack sudo[103677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c305931-6883-4db9-a9b0-120bc5f58ec3.e85e22c4-6528-44c6-9180-9f13c8ca672b Jun 23 16:36:04 devstack sudo[103677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:04 devstack sudo[103670]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-59020032-10dd-46bc-bcf8-1a95a5a18bbd tempest-AttachVolumeTestJSON-1111501152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-57d7e545-00fc-40df-a244-1c6bc8a1e607" returned: 0 in 0.935s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:04 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-59020032-10dd-46bc-bcf8-1a95a5a18bbd tempest-AttachVolumeTestJSON-1111501152 None] <== create_volume: return (2312ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:36:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-59020032-10dd-46bc-bcf8-1a95a5a18bbd tempest-AttachVolumeTestJSON-1111501152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.314s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:36:04 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-59020032-10dd-46bc-bcf8-1a95a5a18bbd tempest-AttachVolumeTestJSON-1111501152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a81bc86f-c81d-4427-b189-af5355b7cdad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57d7e545-00fc-40df-a244-1c6bc8a1e607', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:36:04 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-59020032-10dd-46bc-bcf8-1a95a5a18bbd tempest-AttachVolumeTestJSON-1111501152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da5fe91d-6f9b-4fb3-9601-710d81ac7e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:36:04 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-59020032-10dd-46bc-bcf8-1a95a5a18bbd tempest-AttachVolumeTestJSON-1111501152 None] Volume volume-57d7e545-00fc-40df-a244-1c6bc8a1e607 (57d7e545-00fc-40df-a244-1c6bc8a1e607): created successfully Jun 23 16:36:04 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-59020032-10dd-46bc-bcf8-1a95a5a18bbd tempest-AttachVolumeTestJSON-1111501152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da5fe91d-6f9b-4fb3-9601-710d81ac7e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:36:04 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-59020032-10dd-46bc-bcf8-1a95a5a18bbd tempest-AttachVolumeTestJSON-1111501152 None] Flow 'volume_create_manager' (1363a7c8-e39c-468c-ae4b-a942b56ec215) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:36:04 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-59020032-10dd-46bc-bcf8-1a95a5a18bbd tempest-AttachVolumeTestJSON-1111501152 None] Created volume successfully. Jun 23 16:36:05 devstack sudo[103677]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c26943d3-6f0a-45a1-b10f-984bcc4b62f7 tempest-GroupSnapshotsTest-1791257526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c305931-6883-4db9-a9b0-120bc5f58ec3.e85e22c4-6528-44c6-9180-9f13c8ca672b" returned: 0 in 0.785s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:05 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-c26943d3-6f0a-45a1-b10f-984bcc4b62f7 tempest-GroupSnapshotsTest-1791257526 None] Lock "cinder-quobyte-e85e22c4-6528-44c6-9180-9f13c8ca672b" released by "_delete_snapshot" :: held 4.632s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:36:05 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-c26943d3-6f0a-45a1-b10f-984bcc4b62f7 tempest-GroupSnapshotsTest-1791257526 None] Lock "cinder-quobyte-4c305931-6883-4db9-a9b0-120bc5f58ec3" released by "delete_snapshot" :: held 4.681s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:36:05 devstack cinder-volume[93788]: WARNING cinder.quota [None req-c26943d3-6f0a-45a1-b10f-984bcc4b62f7 tempest-GroupSnapshotsTest-1791257526 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-60648579 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-60648579, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:36:05 devstack cinder-volume[93788]: WARNING cinder.quota [None req-c26943d3-6f0a-45a1-b10f-984bcc4b62f7 tempest-GroupSnapshotsTest-1791257526 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-60648579 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-60648579, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:36:05 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-c26943d3-6f0a-45a1-b10f-984bcc4b62f7 tempest-GroupSnapshotsTest-1791257526 None] Created reservations ['0aaa72ac-0bd6-4712-a266-4f5c3358f8d1', '0f3a1e92-0d29-45db-be12-57988d5271ef', 'ae89a774-aa55-45bc-8c49-a77fa98bb487', 'd3cafac8-1b7f-4e67-9ec3-053a2951e582'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:36:05 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-c26943d3-6f0a-45a1-b10f-984bcc4b62f7 tempest-GroupSnapshotsTest-1791257526 None] Created reservations ['616168a8-455a-42a2-8657-0f04b16f434b', 'ceb01452-28fb-46f9-bb7c-4989e003609d', 'd25dc8b3-1a94-4f7b-a8f7-343bcb388921', '8e5edd38-1497-4866-85de-ac92fe78d8cc'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:36:05 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-c26943d3-6f0a-45a1-b10f-984bcc4b62f7 tempest-GroupSnapshotsTest-1791257526 None] group_snapshot 6246523c-ca2e-492e-9794-d62d74220d69: deleted successfully Jun 23 16:36:06 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-11358e92-18d9-42a1-ad1f-58c4a3019ade tempest-GroupSnapshotsTest-1791257526 None] Acquiring lock "cinder-quobyte-4c305931-6883-4db9-a9b0-120bc5f58ec3" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:36:06 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-11358e92-18d9-42a1-ad1f-58c4a3019ade tempest-GroupSnapshotsTest-1791257526 None] Lock "cinder-quobyte-4c305931-6883-4db9-a9b0-120bc5f58ec3" acquired by "delete_volume" :: waited 0.020s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:36:06 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[68211fa9-b2dd-4289-a1a5-816d660fca0b]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:36:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-11358e92-18d9-42a1-ad1f-58c4a3019ade tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c305931-6883-4db9-a9b0-120bc5f58ec3 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:06 devstack sudo[103684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c305931-6883-4db9-a9b0-120bc5f58ec3 Jun 23 16:36:06 devstack sudo[103684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:06 devstack sudo[103684]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-11358e92-18d9-42a1-ad1f-58c4a3019ade tempest-GroupSnapshotsTest-1791257526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c305931-6883-4db9-a9b0-120bc5f58ec3" returned: 0 in 0.789s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-11358e92-18d9-42a1-ad1f-58c4a3019ade tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c305931-6883-4db9-a9b0-120bc5f58ec3 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:06 devstack sudo[103689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c305931-6883-4db9-a9b0-120bc5f58ec3 Jun 23 16:36:06 devstack sudo[103689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:07 devstack sudo[103689]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-11358e92-18d9-42a1-ad1f-58c4a3019ade tempest-GroupSnapshotsTest-1791257526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c305931-6883-4db9-a9b0-120bc5f58ec3" returned: 0 in 0.834s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:07 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-11358e92-18d9-42a1-ad1f-58c4a3019ade tempest-GroupSnapshotsTest-1791257526 None] Lock "cinder-quobyte-4c305931-6883-4db9-a9b0-120bc5f58ec3" released by "delete_volume" :: held 1.706s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:36:07 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-11358e92-18d9-42a1-ad1f-58c4a3019ade tempest-GroupSnapshotsTest-1791257526 None] Acquiring lock "cinder-quobyte-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:36:07 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-11358e92-18d9-42a1-ad1f-58c4a3019ade tempest-GroupSnapshotsTest-1791257526 None] Lock "cinder-quobyte-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022" acquired by "delete_volume" :: waited 0.018s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:36:07 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[7143df49-bebc-44cc-9376-04a22426c69f]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:36:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-11358e92-18d9-42a1-ad1f-58c4a3019ade tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:07 devstack sudo[103692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022 Jun 23 16:36:07 devstack sudo[103692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-fd65dbbf-38ed-4820-8f3b-cbfc9951f735 req-686573d5-c83d-4938-8ad5-5cdb8d9c7e25 tempest-AttachVolumeTestJSON-1111501152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:36:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-fd65dbbf-38ed-4820-8f3b-cbfc9951f735 req-686573d5-c83d-4938-8ad5-5cdb8d9c7e25 tempest-AttachVolumeTestJSON-1111501152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:36:08 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2f3bf1-0537-45a4-836a-5ae7bcdbc7c2]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:36:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-fd65dbbf-38ed-4820-8f3b-cbfc9951f735 req-686573d5-c83d-4938-8ad5-5cdb8d9c7e25 tempest-AttachVolumeTestJSON-1111501152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-57d7e545-00fc-40df-a244-1c6bc8a1e607 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:08 devstack sudo[103703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-57d7e545-00fc-40df-a244-1c6bc8a1e607 Jun 23 16:36:08 devstack sudo[103703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:09 devstack sudo[103692]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-11358e92-18d9-42a1-ad1f-58c4a3019ade tempest-GroupSnapshotsTest-1791257526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022" returned: 0 in 1.146s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-11358e92-18d9-42a1-ad1f-58c4a3019ade tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:09 devstack sudo[103708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022 Jun 23 16:36:09 devstack sudo[103708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:09 devstack sudo[103703]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-fd65dbbf-38ed-4820-8f3b-cbfc9951f735 req-686573d5-c83d-4938-8ad5-5cdb8d9c7e25 tempest-AttachVolumeTestJSON-1111501152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-57d7e545-00fc-40df-a244-1c6bc8a1e607" returned: 0 in 1.098s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-fd65dbbf-38ed-4820-8f3b-cbfc9951f735 req-686573d5-c83d-4938-8ad5-5cdb8d9c7e25 tempest-AttachVolumeTestJSON-1111501152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.131s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:36:09 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-fd65dbbf-38ed-4820-8f3b-cbfc9951f735 req-686573d5-c83d-4938-8ad5-5cdb8d9c7e25 tempest-AttachVolumeTestJSON-1111501152 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e', 'name': 'volume-57d7e545-00fc-40df-a244-1c6bc8a1e607', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '751f4357-931f-4434-976e-aea8e1ec581d', 'enforce_multipath': True} {{(pid=93788) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 16:36:09 devstack cinder-volume[93788]: INFO cinder.volume.manager [req-fd65dbbf-38ed-4820-8f3b-cbfc9951f735 req-686573d5-c83d-4938-8ad5-5cdb8d9c7e25 tempest-AttachVolumeTestJSON-1111501152 None] attachment_update completed successfully. Jun 23 16:36:09 devstack sudo[103708]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-11358e92-18d9-42a1-ad1f-58c4a3019ade tempest-GroupSnapshotsTest-1791257526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022" returned: 0 in 0.882s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:09 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-11358e92-18d9-42a1-ad1f-58c4a3019ade tempest-GroupSnapshotsTest-1791257526 None] Lock "cinder-quobyte-9dbfeb3b-e28e-496c-bf2e-834b1c1a4022" released by "delete_volume" :: held 2.094s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:36:10 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-11358e92-18d9-42a1-ad1f-58c4a3019ade tempest-GroupSnapshotsTest-1791257526 None] Created reservations ['5f7550f5-fab1-4246-8a1c-f04018daa0ee'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:36:10 devstack cinder-volume[93788]: WARNING cinder.quota [None req-11358e92-18d9-42a1-ad1f-58c4a3019ade tempest-GroupSnapshotsTest-1791257526 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-60648579 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-60648579, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:36:10 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-11358e92-18d9-42a1-ad1f-58c4a3019ade tempest-GroupSnapshotsTest-1791257526 None] Created reservations ['4abf0f89-231f-49f9-8e9c-f0060e593890', 'b34da928-955a-4dfd-a141-89850473325d', '908a5aca-4e04-41b7-b5b0-5027b08dd4aa', '571a5851-28e7-4342-9b91-011c36297fde'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:36:10 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-11358e92-18d9-42a1-ad1f-58c4a3019ade tempest-GroupSnapshotsTest-1791257526 None] Created reservations ['3bdea72d-2290-4d14-a8f9-50c6d4ced484', '77201963-5ef6-48d3-8af7-0b28a8d95c93', '79745ce4-aac8-45f0-9e30-5213147cf825', '52d091df-8005-420c-aa41-c8f3438c9af7'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:36:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-11358e92-18d9-42a1-ad1f-58c4a3019ade tempest-GroupSnapshotsTest-1791257526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:36:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-11358e92-18d9-42a1-ad1f-58c4a3019ade tempest-GroupSnapshotsTest-1791257526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:36:10 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-11358e92-18d9-42a1-ad1f-58c4a3019ade tempest-GroupSnapshotsTest-1791257526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:36:10 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-11358e92-18d9-42a1-ad1f-58c4a3019ade tempest-GroupSnapshotsTest-1791257526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:36:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-11358e92-18d9-42a1-ad1f-58c4a3019ade tempest-GroupSnapshotsTest-1791257526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:36:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-11358e92-18d9-42a1-ad1f-58c4a3019ade tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:10 devstack sudo[103794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:36:10 devstack sudo[103794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:11 devstack sudo[103794]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-11358e92-18d9-42a1-ad1f-58c4a3019ade tempest-GroupSnapshotsTest-1791257526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.055s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:11 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-11358e92-18d9-42a1-ad1f-58c4a3019ade tempest-GroupSnapshotsTest-1791257526 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:36:11 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-11358e92-18d9-42a1-ad1f-58c4a3019ade tempest-GroupSnapshotsTest-1791257526 None] Delete group completed successfully. Jun 23 16:36:11 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-2f737b94-8995-4550-8682-05d696f2ae8b tempest-GroupSnapshotsTest-1791257526 None] Group tempest-GroupSnapshotsTest-Group-1745068779: creating Jun 23 16:36:11 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-2f737b94-8995-4550-8682-05d696f2ae8b tempest-GroupSnapshotsTest-1791257526 None] Group tempest-GroupSnapshotsTest-Group-1745068779: created successfully Jun 23 16:36:11 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-2f737b94-8995-4550-8682-05d696f2ae8b tempest-GroupSnapshotsTest-1791257526 None] Create group completed successfully. Jun 23 16:36:13 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-8292765f-3c9d-4f18-b5a5-c1ee9f89096f tempest-GroupSnapshotsTest-1791257526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:36:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8292765f-3c9d-4f18-b5a5-c1ee9f89096f tempest-GroupSnapshotsTest-1791257526 None] Flow 'volume_create_manager' (407bf47e-f9c8-48cd-9a18-fb10580dc007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:36:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8292765f-3c9d-4f18-b5a5-c1ee9f89096f tempest-GroupSnapshotsTest-1791257526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b6925fe-c3ad-405e-ae5a-06191bdff417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:36:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8292765f-3c9d-4f18-b5a5-c1ee9f89096f tempest-GroupSnapshotsTest-1791257526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b6925fe-c3ad-405e-ae5a-06191bdff417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:36:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-446330293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=814bc7ad-3a79-46c3-97cc-a043a626f3d1,host='devstack@QuobyteHD#QuobyteHD',id=cb58d479-b798-47f4-84b4-76f549308912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dce840d5703b4e59846cde5d1d050426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:36:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:36:14Z,use_quota=True,user_id='d42dedebf56a4672abe200b243a6ceca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38fa8404-4bb0-4d91-9f2a-752c2e3874eb),volume_type_id=38fa8404-4bb0-4d91-9f2a-752c2e3874eb)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:36:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8292765f-3c9d-4f18-b5a5-c1ee9f89096f tempest-GroupSnapshotsTest-1791257526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a30cf00f-8634-419a-82a1-1a5d252f70c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:36:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8292765f-3c9d-4f18-b5a5-c1ee9f89096f tempest-GroupSnapshotsTest-1791257526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a30cf00f-8634-419a-82a1-1a5d252f70c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:36:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8292765f-3c9d-4f18-b5a5-c1ee9f89096f tempest-GroupSnapshotsTest-1791257526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b71382b0-60ac-4918-b7ae-da03f1b86813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:36:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8292765f-3c9d-4f18-b5a5-c1ee9f89096f tempest-GroupSnapshotsTest-1791257526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b71382b0-60ac-4918-b7ae-da03f1b86813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb58d479-b798-47f4-84b4-76f549308912', 'volume_name': 'volume-cb58d479-b798-47f4-84b4-76f549308912', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:36:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8292765f-3c9d-4f18-b5a5-c1ee9f89096f tempest-GroupSnapshotsTest-1791257526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48170660-bcff-41c1-9955-7f356896fe1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:36:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8292765f-3c9d-4f18-b5a5-c1ee9f89096f tempest-GroupSnapshotsTest-1791257526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48170660-bcff-41c1-9955-7f356896fe1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:36:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8292765f-3c9d-4f18-b5a5-c1ee9f89096f tempest-GroupSnapshotsTest-1791257526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7085c31b-7a63-4adb-9395-a8028f282ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:36:13 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-8292765f-3c9d-4f18-b5a5-c1ee9f89096f tempest-GroupSnapshotsTest-1791257526 None] Volume cb58d479-b798-47f4-84b4-76f549308912: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb58d479-b798-47f4-84b4-76f549308912', 'volume_size': 1} Jun 23 16:36:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8292765f-3c9d-4f18-b5a5-c1ee9f89096f tempest-GroupSnapshotsTest-1791257526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:36:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8292765f-3c9d-4f18-b5a5-c1ee9f89096f tempest-GroupSnapshotsTest-1791257526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:36:13 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-8292765f-3c9d-4f18-b5a5-c1ee9f89096f tempest-GroupSnapshotsTest-1791257526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=814bc7ad-3a79-46c3-97cc-a043a626f3d1,created_at=2026-06-23T14:36:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-446330293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=814bc7ad-3a79-46c3-97cc-a043a626f3d1,host='devstack@QuobyteHD#QuobyteHD',id=cb58d479-b798-47f4-84b4-76f549308912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dce840d5703b4e59846cde5d1d050426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:36:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:36:14Z,use_quota=True,user_id='d42dedebf56a4672abe200b243a6ceca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38fa8404-4bb0-4d91-9f2a-752c2e3874eb),volume_type_id=38fa8404-4bb0-4d91-9f2a-752c2e3874eb)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:36:13 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-8292765f-3c9d-4f18-b5a5-c1ee9f89096f tempest-GroupSnapshotsTest-1791257526 None] Creating volume cb58d479-b798-47f4-84b4-76f549308912 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:36:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8292765f-3c9d-4f18-b5a5-c1ee9f89096f tempest-GroupSnapshotsTest-1791257526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:36:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8292765f-3c9d-4f18-b5a5-c1ee9f89096f tempest-GroupSnapshotsTest-1791257526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:36:13 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-8292765f-3c9d-4f18-b5a5-c1ee9f89096f tempest-GroupSnapshotsTest-1791257526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:36:13 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-8292765f-3c9d-4f18-b5a5-c1ee9f89096f tempest-GroupSnapshotsTest-1791257526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:36:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8292765f-3c9d-4f18-b5a5-c1ee9f89096f tempest-GroupSnapshotsTest-1791257526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:36:13 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-8292765f-3c9d-4f18-b5a5-c1ee9f89096f tempest-GroupSnapshotsTest-1791257526 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:36:13 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-8292765f-3c9d-4f18-b5a5-c1ee9f89096f tempest-GroupSnapshotsTest-1791257526 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:36:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8292765f-3c9d-4f18-b5a5-c1ee9f89096f tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cb58d479-b798-47f4-84b4-76f549308912 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:13 devstack sudo[104137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cb58d479-b798-47f4-84b4-76f549308912 1073741824 Jun 23 16:36:13 devstack sudo[104137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:14 devstack sudo[104137]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8292765f-3c9d-4f18-b5a5-c1ee9f89096f tempest-GroupSnapshotsTest-1791257526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cb58d479-b798-47f4-84b4-76f549308912 1073741824" returned: 0 in 0.972s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8292765f-3c9d-4f18-b5a5-c1ee9f89096f tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cb58d479-b798-47f4-84b4-76f549308912 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:14 devstack sudo[104149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cb58d479-b798-47f4-84b4-76f549308912 Jun 23 16:36:14 devstack sudo[104149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:15 devstack sudo[104149]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8292765f-3c9d-4f18-b5a5-c1ee9f89096f tempest-GroupSnapshotsTest-1791257526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cb58d479-b798-47f4-84b4-76f549308912" returned: 0 in 0.817s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:15 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-8292765f-3c9d-4f18-b5a5-c1ee9f89096f tempest-GroupSnapshotsTest-1791257526 None] <== create_volume: return (1847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:36:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8292765f-3c9d-4f18-b5a5-c1ee9f89096f tempest-GroupSnapshotsTest-1791257526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.850s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:36:15 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8292765f-3c9d-4f18-b5a5-c1ee9f89096f tempest-GroupSnapshotsTest-1791257526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7085c31b-7a63-4adb-9395-a8028f282ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb58d479-b798-47f4-84b4-76f549308912', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:36:15 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8292765f-3c9d-4f18-b5a5-c1ee9f89096f tempest-GroupSnapshotsTest-1791257526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (642b3684-9eb6-4883-bfca-b3e8d2a50126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:36:15 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-8292765f-3c9d-4f18-b5a5-c1ee9f89096f tempest-GroupSnapshotsTest-1791257526 None] Volume volume-cb58d479-b798-47f4-84b4-76f549308912 (cb58d479-b798-47f4-84b4-76f549308912): created successfully Jun 23 16:36:15 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8292765f-3c9d-4f18-b5a5-c1ee9f89096f tempest-GroupSnapshotsTest-1791257526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (642b3684-9eb6-4883-bfca-b3e8d2a50126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:36:15 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8292765f-3c9d-4f18-b5a5-c1ee9f89096f tempest-GroupSnapshotsTest-1791257526 None] Flow 'volume_create_manager' (407bf47e-f9c8-48cd-9a18-fb10580dc007) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:36:15 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-8292765f-3c9d-4f18-b5a5-c1ee9f89096f tempest-GroupSnapshotsTest-1791257526 None] Created volume successfully. Jun 23 16:36:15 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ef3b71f-ba51-46ef-9fd6-2121655ddb71 tempest-AttachVolumeTestJSON-1111501152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:36:15 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6ef3b71f-ba51-46ef-9fd6-2121655ddb71 tempest-AttachVolumeTestJSON-1111501152 None] Flow 'volume_create_manager' (1d5a82dd-14c4-435a-8489-31b7f52756a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:36:15 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6ef3b71f-ba51-46ef-9fd6-2121655ddb71 tempest-AttachVolumeTestJSON-1111501152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7a7457f-b496-42f7-881d-d1217ae1bfaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:36:15 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6ef3b71f-ba51-46ef-9fd6-2121655ddb71 tempest-AttachVolumeTestJSON-1111501152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7a7457f-b496-42f7-881d-d1217ae1bfaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1554062388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e009b2b1-b84a-4c17-92a3-422269471536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e57d651cfd04e00826ec703018aca5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:36:16Z,use_quota=True,user_id='f831cea18f3c4738b5b0b0388ed86b3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:36:15 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6ef3b71f-ba51-46ef-9fd6-2121655ddb71 tempest-AttachVolumeTestJSON-1111501152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cefb8d0-3c4d-455a-b4c8-7e4c97590558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:36:15 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6ef3b71f-ba51-46ef-9fd6-2121655ddb71 tempest-AttachVolumeTestJSON-1111501152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cefb8d0-3c4d-455a-b4c8-7e4c97590558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:36:15 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6ef3b71f-ba51-46ef-9fd6-2121655ddb71 tempest-AttachVolumeTestJSON-1111501152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9721497e-ee0d-4889-a88c-bf86d085480c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:36:15 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6ef3b71f-ba51-46ef-9fd6-2121655ddb71 tempest-AttachVolumeTestJSON-1111501152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9721497e-ee0d-4889-a88c-bf86d085480c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e009b2b1-b84a-4c17-92a3-422269471536', 'volume_name': 'volume-e009b2b1-b84a-4c17-92a3-422269471536', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:36:15 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6ef3b71f-ba51-46ef-9fd6-2121655ddb71 tempest-AttachVolumeTestJSON-1111501152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1f70f13-91ac-4691-b253-3209e28aaf7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:36:15 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6ef3b71f-ba51-46ef-9fd6-2121655ddb71 tempest-AttachVolumeTestJSON-1111501152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1f70f13-91ac-4691-b253-3209e28aaf7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:36:15 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6ef3b71f-ba51-46ef-9fd6-2121655ddb71 tempest-AttachVolumeTestJSON-1111501152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e963cb6c-6cc2-4b85-a018-993c26bd0aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:36:15 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-6ef3b71f-ba51-46ef-9fd6-2121655ddb71 tempest-AttachVolumeTestJSON-1111501152 None] Volume e009b2b1-b84a-4c17-92a3-422269471536: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e009b2b1-b84a-4c17-92a3-422269471536', 'volume_size': 1} Jun 23 16:36:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-6ef3b71f-ba51-46ef-9fd6-2121655ddb71 tempest-AttachVolumeTestJSON-1111501152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:36:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-6ef3b71f-ba51-46ef-9fd6-2121655ddb71 tempest-AttachVolumeTestJSON-1111501152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:36:15 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-6ef3b71f-ba51-46ef-9fd6-2121655ddb71 tempest-AttachVolumeTestJSON-1111501152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1554062388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e009b2b1-b84a-4c17-92a3-422269471536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e57d651cfd04e00826ec703018aca5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:36:16Z,use_quota=True,user_id='f831cea18f3c4738b5b0b0388ed86b3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:36:15 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-6ef3b71f-ba51-46ef-9fd6-2121655ddb71 tempest-AttachVolumeTestJSON-1111501152 None] Creating volume e009b2b1-b84a-4c17-92a3-422269471536 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:36:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-6ef3b71f-ba51-46ef-9fd6-2121655ddb71 tempest-AttachVolumeTestJSON-1111501152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:36:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-6ef3b71f-ba51-46ef-9fd6-2121655ddb71 tempest-AttachVolumeTestJSON-1111501152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:36:15 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-6ef3b71f-ba51-46ef-9fd6-2121655ddb71 tempest-AttachVolumeTestJSON-1111501152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:36:15 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-6ef3b71f-ba51-46ef-9fd6-2121655ddb71 tempest-AttachVolumeTestJSON-1111501152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:36:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-6ef3b71f-ba51-46ef-9fd6-2121655ddb71 tempest-AttachVolumeTestJSON-1111501152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:36:15 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-6ef3b71f-ba51-46ef-9fd6-2121655ddb71 tempest-AttachVolumeTestJSON-1111501152 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:36:15 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-6ef3b71f-ba51-46ef-9fd6-2121655ddb71 tempest-AttachVolumeTestJSON-1111501152 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:36:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-6ef3b71f-ba51-46ef-9fd6-2121655ddb71 tempest-AttachVolumeTestJSON-1111501152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e009b2b1-b84a-4c17-92a3-422269471536 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:15 devstack sudo[104152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e009b2b1-b84a-4c17-92a3-422269471536 1073741824 Jun 23 16:36:15 devstack sudo[104152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:16 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-d235ab33-cdfa-4cad-9e96-78aa227ffd99 tempest-GroupSnapshotsTest-1791257526 None] GroupSnapshot b6f294a6-cdb0-49e7-9379-31b0e6fe372d: creating. Jun 23 16:36:16 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d235ab33-cdfa-4cad-9e96-78aa227ffd99 tempest-GroupSnapshotsTest-1791257526 None] Group snapshot b6f294a6-cdb0-49e7-9379-31b0e6fe372d: creating. {{(pid=93788) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 23 16:36:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d235ab33-cdfa-4cad-9e96-78aa227ffd99 tempest-GroupSnapshotsTest-1791257526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:36:17 devstack sudo[104152]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-6ef3b71f-ba51-46ef-9fd6-2121655ddb71 tempest-AttachVolumeTestJSON-1111501152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e009b2b1-b84a-4c17-92a3-422269471536 1073741824" returned: 0 in 1.206s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-6ef3b71f-ba51-46ef-9fd6-2121655ddb71 tempest-AttachVolumeTestJSON-1111501152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e009b2b1-b84a-4c17-92a3-422269471536 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:17 devstack sudo[104201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e009b2b1-b84a-4c17-92a3-422269471536 Jun 23 16:36:17 devstack sudo[104201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:18 devstack sudo[104201]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:18 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-6ef3b71f-ba51-46ef-9fd6-2121655ddb71 tempest-AttachVolumeTestJSON-1111501152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e009b2b1-b84a-4c17-92a3-422269471536" returned: 0 in 1.217s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:18 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-6ef3b71f-ba51-46ef-9fd6-2121655ddb71 tempest-AttachVolumeTestJSON-1111501152 None] <== create_volume: return (2478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:36:18 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-6ef3b71f-ba51-46ef-9fd6-2121655ddb71 tempest-AttachVolumeTestJSON-1111501152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.481s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:36:18 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d235ab33-cdfa-4cad-9e96-78aa227ffd99 tempest-GroupSnapshotsTest-1791257526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.605s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:36:18 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-d235ab33-cdfa-4cad-9e96-78aa227ffd99 tempest-GroupSnapshotsTest-1791257526 None] Creating offline snapshot 8de2c858-e9fa-4923-9e63-dbc27c1456f3 of volume cb58d479-b798-47f4-84b4-76f549308912 {{(pid=93788) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:36:18 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6ef3b71f-ba51-46ef-9fd6-2121655ddb71 tempest-AttachVolumeTestJSON-1111501152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e963cb6c-6cc2-4b85-a018-993c26bd0aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e009b2b1-b84a-4c17-92a3-422269471536', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:36:18 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6ef3b71f-ba51-46ef-9fd6-2121655ddb71 tempest-AttachVolumeTestJSON-1111501152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (562d04e3-167c-4130-aa0a-d89807b0a96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:36:18 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[9353079c-5090-4dfe-8234-c800db5d56d6]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:36:18 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d235ab33-cdfa-4cad-9e96-78aa227ffd99 tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cb58d479-b798-47f4-84b4-76f549308912 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:18 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-6ef3b71f-ba51-46ef-9fd6-2121655ddb71 tempest-AttachVolumeTestJSON-1111501152 None] Volume volume-e009b2b1-b84a-4c17-92a3-422269471536 (e009b2b1-b84a-4c17-92a3-422269471536): created successfully Jun 23 16:36:18 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6ef3b71f-ba51-46ef-9fd6-2121655ddb71 tempest-AttachVolumeTestJSON-1111501152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (562d04e3-167c-4130-aa0a-d89807b0a96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:36:18 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6ef3b71f-ba51-46ef-9fd6-2121655ddb71 tempest-AttachVolumeTestJSON-1111501152 None] Flow 'volume_create_manager' (1d5a82dd-14c4-435a-8489-31b7f52756a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:36:18 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-6ef3b71f-ba51-46ef-9fd6-2121655ddb71 tempest-AttachVolumeTestJSON-1111501152 None] Created volume successfully. Jun 23 16:36:18 devstack sudo[104282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cb58d479-b798-47f4-84b4-76f549308912 Jun 23 16:36:18 devstack sudo[104282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:20 devstack sudo[104282]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:20 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d235ab33-cdfa-4cad-9e96-78aa227ffd99 tempest-GroupSnapshotsTest-1791257526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cb58d479-b798-47f4-84b4-76f549308912" returned: 0 in 1.773s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:20 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d235ab33-cdfa-4cad-9e96-78aa227ffd99 tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cb58d479-b798-47f4-84b4-76f549308912,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cb58d479-b798-47f4-84b4-76f549308912.8de2c858-e9fa-4923-9e63-dbc27c1456f3 1G {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:20 devstack sudo[104345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cb58d479-b798-47f4-84b4-76f549308912,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cb58d479-b798-47f4-84b4-76f549308912.8de2c858-e9fa-4923-9e63-dbc27c1456f3 1G Jun 23 16:36:20 devstack sudo[104345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:21 devstack sudo[104345]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d235ab33-cdfa-4cad-9e96-78aa227ffd99 tempest-GroupSnapshotsTest-1791257526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cb58d479-b798-47f4-84b4-76f549308912,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cb58d479-b798-47f4-84b4-76f549308912.8de2c858-e9fa-4923-9e63-dbc27c1456f3 1G" returned: 0 in 1.475s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d235ab33-cdfa-4cad-9e96-78aa227ffd99 tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb58d479-b798-47f4-84b4-76f549308912 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cb58d479-b798-47f4-84b4-76f549308912.8de2c858-e9fa-4923-9e63-dbc27c1456f3 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:21 devstack sudo[104366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb58d479-b798-47f4-84b4-76f549308912 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cb58d479-b798-47f4-84b4-76f549308912.8de2c858-e9fa-4923-9e63-dbc27c1456f3 Jun 23 16:36:21 devstack sudo[104366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:23 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-adf98fbd-6c9a-4b7f-886f-26677994251e tempest-VolumesActionsTest-1113820978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:36:23 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-adf98fbd-6c9a-4b7f-886f-26677994251e tempest-VolumesActionsTest-1113820978 None] Flow 'volume_create_manager' (6e3a4d20-ab37-45fc-b919-4afdf0f881a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:36:23 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-adf98fbd-6c9a-4b7f-886f-26677994251e tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0018324-9469-47c3-8e8c-0ef9afcff1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:36:23 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-17191d0d-18c2-4d36-9d4b-a1f3b94dfd6a tempest-VolumesActionsTest-1224009287 None] Acquiring lock "cinder-e3434346-f7a9-4aaa-8210-6e8c244d1a95" by "attach_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:36:23 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-adf98fbd-6c9a-4b7f-886f-26677994251e tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0018324-9469-47c3-8e8c-0ef9afcff1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1455050670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8b8ab46-4128-43d6-bb57-2ff2ca8f30aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfc07113077b492c8ba668960a6f4dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:36:23Z,use_quota=True,user_id='8bf540cfe6304942beeb4e6870a7f49d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:36:23 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-adf98fbd-6c9a-4b7f-886f-26677994251e tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9784e226-9d85-4830-9de5-549864b33856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:36:23 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-adf98fbd-6c9a-4b7f-886f-26677994251e tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9784e226-9d85-4830-9de5-549864b33856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:36:23 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-adf98fbd-6c9a-4b7f-886f-26677994251e tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4db46267-198a-405c-83a8-76ad7acec768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:36:23 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-adf98fbd-6c9a-4b7f-886f-26677994251e tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4db46267-198a-405c-83a8-76ad7acec768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8b8ab46-4128-43d6-bb57-2ff2ca8f30aa', 'volume_name': 'volume-e8b8ab46-4128-43d6-bb57-2ff2ca8f30aa', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:36:23 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-adf98fbd-6c9a-4b7f-886f-26677994251e tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ac04ff3-cc84-4922-9f3d-7bd5121df5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:36:23 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-adf98fbd-6c9a-4b7f-886f-26677994251e tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ac04ff3-cc84-4922-9f3d-7bd5121df5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:36:23 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-adf98fbd-6c9a-4b7f-886f-26677994251e tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8490ff5b-be8a-4f62-80ff-33458dfcb067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:36:23 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-adf98fbd-6c9a-4b7f-886f-26677994251e tempest-VolumesActionsTest-1113820978 None] Volume e8b8ab46-4128-43d6-bb57-2ff2ca8f30aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8b8ab46-4128-43d6-bb57-2ff2ca8f30aa', 'volume_size': 1} Jun 23 16:36:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-adf98fbd-6c9a-4b7f-886f-26677994251e tempest-VolumesActionsTest-1113820978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:36:23 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-17191d0d-18c2-4d36-9d4b-a1f3b94dfd6a tempest-VolumesActionsTest-1224009287 None] Lock "cinder-e3434346-f7a9-4aaa-8210-6e8c244d1a95" acquired by "attach_volume" :: waited 0.098s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:36:23 devstack sudo[104366]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d235ab33-cdfa-4cad-9e96-78aa227ffd99 tempest-GroupSnapshotsTest-1791257526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb58d479-b798-47f4-84b4-76f549308912 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cb58d479-b798-47f4-84b4-76f549308912.8de2c858-e9fa-4923-9e63-dbc27c1456f3" returned: 0 in 1.524s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:23 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-d235ab33-cdfa-4cad-9e96-78aa227ffd99 tempest-GroupSnapshotsTest-1791257526 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cb58d479-b798-47f4-84b4-76f549308912.8de2c858-e9fa-4923-9e63-dbc27c1456f3 is being set with open permissions: ugo+rw: NotImplementedError Jun 23 16:36:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d235ab33-cdfa-4cad-9e96-78aa227ffd99 tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cb58d479-b798-47f4-84b4-76f549308912.8de2c858-e9fa-4923-9e63-dbc27c1456f3 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:23 devstack sudo[104371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cb58d479-b798-47f4-84b4-76f549308912.8de2c858-e9fa-4923-9e63-dbc27c1456f3 Jun 23 16:36:23 devstack sudo[104371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:23 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-17191d0d-18c2-4d36-9d4b-a1f3b94dfd6a tempest-VolumesActionsTest-1224009287 None] Attaching volume e3434346-f7a9-4aaa-8210-6e8c244d1a95 to instance 75f7127b-1a39-4fef-ae99-048e40a18e8a at mountpoint /dev/vdb on host None. Jun 23 16:36:23 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-17191d0d-18c2-4d36-9d4b-a1f3b94dfd6a tempest-VolumesActionsTest-1224009287 None] Attach volume completed successfully. Jun 23 16:36:23 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-17191d0d-18c2-4d36-9d4b-a1f3b94dfd6a tempest-VolumesActionsTest-1224009287 None] Lock "cinder-e3434346-f7a9-4aaa-8210-6e8c244d1a95" released by "attach_volume" :: held 0.171s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:36:23 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-6637cc14-2d91-4b38-9e07-609a733b2bce tempest-VolumesActionsTest-1224009287 None] Acquiring lock "cinder-e3434346-f7a9-4aaa-8210-6e8c244d1a95-detach_volume" by "detach_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:36:23 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-6637cc14-2d91-4b38-9e07-609a733b2bce tempest-VolumesActionsTest-1224009287 None] Lock "cinder-e3434346-f7a9-4aaa-8210-6e8c244d1a95-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:36:23 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-6637cc14-2d91-4b38-9e07-609a733b2bce tempest-VolumesActionsTest-1224009287 None] Detaching volume e3434346-f7a9-4aaa-8210-6e8c244d1a95 from instance 75f7127b-1a39-4fef-ae99-048e40a18e8a. Jun 23 16:36:23 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-6637cc14-2d91-4b38-9e07-609a733b2bce tempest-VolumesActionsTest-1224009287 None] Detach volume completed successfully. Jun 23 16:36:23 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-6637cc14-2d91-4b38-9e07-609a733b2bce tempest-VolumesActionsTest-1224009287 None] Lock "cinder-e3434346-f7a9-4aaa-8210-6e8c244d1a95-detach_volume" released by "detach_volume" :: held 0.112s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:36:24 devstack sudo[104371]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d235ab33-cdfa-4cad-9e96-78aa227ffd99 tempest-GroupSnapshotsTest-1791257526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cb58d479-b798-47f4-84b4-76f549308912.8de2c858-e9fa-4923-9e63-dbc27c1456f3" returned: 0 in 0.874s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d235ab33-cdfa-4cad-9e96-78aa227ffd99 tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cb58d479-b798-47f4-84b4-76f549308912.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-9759c27a-991b-4cc2-acd2-d1fddd4fbdbb req-019577c4-8878-4f52-9a02-549d8c1f8b08 tempest-AttachVolumeTestJSON-1111501152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:36:24 devstack sudo[104382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cb58d479-b798-47f4-84b4-76f549308912.info Jun 23 16:36:24 devstack sudo[104382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:25 devstack sudo[104382]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d235ab33-cdfa-4cad-9e96-78aa227ffd99 tempest-GroupSnapshotsTest-1791257526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cb58d479-b798-47f4-84b4-76f549308912.info" returned: 0 in 0.843s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:25 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-d235ab33-cdfa-4cad-9e96-78aa227ffd99 tempest-GroupSnapshotsTest-1791257526 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cb58d479-b798-47f4-84b4-76f549308912.info is being set with open permissions: ugo+rw: NotImplementedError Jun 23 16:36:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d235ab33-cdfa-4cad-9e96-78aa227ffd99 tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cb58d479-b798-47f4-84b4-76f549308912.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:25 devstack sudo[104385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cb58d479-b798-47f4-84b4-76f549308912.info Jun 23 16:36:25 devstack sudo[104385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:25 devstack sudo[104385]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d235ab33-cdfa-4cad-9e96-78aa227ffd99 tempest-GroupSnapshotsTest-1791257526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cb58d479-b798-47f4-84b4-76f549308912.info" returned: 0 in 0.928s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d235ab33-cdfa-4cad-9e96-78aa227ffd99 tempest-GroupSnapshotsTest-1791257526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.607s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:36:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-adf98fbd-6c9a-4b7f-886f-26677994251e tempest-VolumesActionsTest-1113820978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.836s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:36:26 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-adf98fbd-6c9a-4b7f-886f-26677994251e tempest-VolumesActionsTest-1113820978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1455050670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8b8ab46-4128-43d6-bb57-2ff2ca8f30aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfc07113077b492c8ba668960a6f4dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:36:23Z,use_quota=True,user_id='8bf540cfe6304942beeb4e6870a7f49d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:36:26 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-adf98fbd-6c9a-4b7f-886f-26677994251e tempest-VolumesActionsTest-1113820978 None] Creating volume e8b8ab46-4128-43d6-bb57-2ff2ca8f30aa {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:36:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-adf98fbd-6c9a-4b7f-886f-26677994251e tempest-VolumesActionsTest-1113820978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:36:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-adf98fbd-6c9a-4b7f-886f-26677994251e tempest-VolumesActionsTest-1113820978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:36:26 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-adf98fbd-6c9a-4b7f-886f-26677994251e tempest-VolumesActionsTest-1113820978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:36:26 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-adf98fbd-6c9a-4b7f-886f-26677994251e tempest-VolumesActionsTest-1113820978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:36:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-adf98fbd-6c9a-4b7f-886f-26677994251e tempest-VolumesActionsTest-1113820978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:36:26 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-adf98fbd-6c9a-4b7f-886f-26677994251e tempest-VolumesActionsTest-1113820978 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:36:26 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-adf98fbd-6c9a-4b7f-886f-26677994251e tempest-VolumesActionsTest-1113820978 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:36:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-adf98fbd-6c9a-4b7f-886f-26677994251e tempest-VolumesActionsTest-1113820978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8b8ab46-4128-43d6-bb57-2ff2ca8f30aa 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:26 devstack sudo[104410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8b8ab46-4128-43d6-bb57-2ff2ca8f30aa 1073741824 Jun 23 16:36:26 devstack sudo[104410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:26 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-d235ab33-cdfa-4cad-9e96-78aa227ffd99 tempest-GroupSnapshotsTest-1791257526 None] group_snapshot b6f294a6-cdb0-49e7-9379-31b0e6fe372d: created successfully Jun 23 16:36:27 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-350bbe8a-4a58-43a6-bb94-38522012a4ea tempest-GroupSnapshotsTest-1791257526 None] group_snapshot b6f294a6-cdb0-49e7-9379-31b0e6fe372d: deleting Jun 23 16:36:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-350bbe8a-4a58-43a6-bb94-38522012a4ea tempest-GroupSnapshotsTest-1791257526 None] group_snapshot b6f294a6-cdb0-49e7-9379-31b0e6fe372d: deleting {{(pid=93788) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 23 16:36:27 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-350bbe8a-4a58-43a6-bb94-38522012a4ea tempest-GroupSnapshotsTest-1791257526 None] Acquiring lock "cinder-quobyte-cb58d479-b798-47f4-84b4-76f549308912" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:36:27 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-350bbe8a-4a58-43a6-bb94-38522012a4ea tempest-GroupSnapshotsTest-1791257526 None] Lock "cinder-quobyte-cb58d479-b798-47f4-84b4-76f549308912" acquired by "delete_snapshot" :: waited 0.050s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:36:27 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-350bbe8a-4a58-43a6-bb94-38522012a4ea tempest-GroupSnapshotsTest-1791257526 None] Acquiring lock "cinder-quobyte-8de2c858-e9fa-4923-9e63-dbc27c1456f3" by "_delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:36:27 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-350bbe8a-4a58-43a6-bb94-38522012a4ea tempest-GroupSnapshotsTest-1791257526 None] Lock "cinder-quobyte-8de2c858-e9fa-4923-9e63-dbc27c1456f3" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:36:27 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-350bbe8a-4a58-43a6-bb94-38522012a4ea tempest-GroupSnapshotsTest-1791257526 None] Deleting offline snapshot 8de2c858-e9fa-4923-9e63-dbc27c1456f3 of volume cb58d479-b798-47f4-84b4-76f549308912 {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:36:27 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-350bbe8a-4a58-43a6-bb94-38522012a4ea tempest-GroupSnapshotsTest-1791257526 None] snapshot_file for this snap is: volume-cb58d479-b798-47f4-84b4-76f549308912.8de2c858-e9fa-4923-9e63-dbc27c1456f3 {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:36:27 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f578a96a-5b08-4a26-be10-cea390a7d6a9]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:36:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-350bbe8a-4a58-43a6-bb94-38522012a4ea tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cb58d479-b798-47f4-84b4-76f549308912.8de2c858-e9fa-4923-9e63-dbc27c1456f3 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:27 devstack sudo[104443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cb58d479-b798-47f4-84b4-76f549308912.8de2c858-e9fa-4923-9e63-dbc27c1456f3 Jun 23 16:36:27 devstack sudo[104443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:27 devstack sudo[104410]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-adf98fbd-6c9a-4b7f-886f-26677994251e tempest-VolumesActionsTest-1113820978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8b8ab46-4128-43d6-bb57-2ff2ca8f30aa 1073741824" returned: 0 in 1.665s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-adf98fbd-6c9a-4b7f-886f-26677994251e tempest-VolumesActionsTest-1113820978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8b8ab46-4128-43d6-bb57-2ff2ca8f30aa {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:27 devstack sudo[104452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8b8ab46-4128-43d6-bb57-2ff2ca8f30aa Jun 23 16:36:27 devstack sudo[104452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:28 devstack sudo[104443]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-350bbe8a-4a58-43a6-bb94-38522012a4ea tempest-GroupSnapshotsTest-1791257526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cb58d479-b798-47f4-84b4-76f549308912.8de2c858-e9fa-4923-9e63-dbc27c1456f3" returned: 0 in 1.372s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:28 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-350bbe8a-4a58-43a6-bb94-38522012a4ea tempest-GroupSnapshotsTest-1791257526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb58d479-b798-47f4-84b4-76f549308912(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:36:28 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1cd865-22dc-441e-bbe2-857ec66d985f]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:36:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-350bbe8a-4a58-43a6-bb94-38522012a4ea tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cb58d479-b798-47f4-84b4-76f549308912 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:28 devstack sudo[104463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cb58d479-b798-47f4-84b4-76f549308912 Jun 23 16:36:28 devstack sudo[104463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:28 devstack sudo[104452]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-adf98fbd-6c9a-4b7f-886f-26677994251e tempest-VolumesActionsTest-1113820978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8b8ab46-4128-43d6-bb57-2ff2ca8f30aa" returned: 0 in 1.148s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:28 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-adf98fbd-6c9a-4b7f-886f-26677994251e tempest-VolumesActionsTest-1113820978 None] <== create_volume: return (2934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:36:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-adf98fbd-6c9a-4b7f-886f-26677994251e tempest-VolumesActionsTest-1113820978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.937s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:36:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-9759c27a-991b-4cc2-acd2-d1fddd4fbdbb req-019577c4-8878-4f52-9a02-549d8c1f8b08 tempest-AttachVolumeTestJSON-1111501152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.773s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:36:28 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-adf98fbd-6c9a-4b7f-886f-26677994251e tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8490ff5b-be8a-4f62-80ff-33458dfcb067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8b8ab46-4128-43d6-bb57-2ff2ca8f30aa', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:36:28 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-adf98fbd-6c9a-4b7f-886f-26677994251e tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce654aee-8a82-4d83-8cd0-dd828966a9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:36:29 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa7025d-43a0-4caf-b266-88ead5615a4d]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:36:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-9759c27a-991b-4cc2-acd2-d1fddd4fbdbb req-019577c4-8878-4f52-9a02-549d8c1f8b08 tempest-AttachVolumeTestJSON-1111501152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e009b2b1-b84a-4c17-92a3-422269471536 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:29 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-adf98fbd-6c9a-4b7f-886f-26677994251e tempest-VolumesActionsTest-1113820978 None] Volume volume-e8b8ab46-4128-43d6-bb57-2ff2ca8f30aa (e8b8ab46-4128-43d6-bb57-2ff2ca8f30aa): created successfully Jun 23 16:36:29 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-adf98fbd-6c9a-4b7f-886f-26677994251e tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce654aee-8a82-4d83-8cd0-dd828966a9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:36:29 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-adf98fbd-6c9a-4b7f-886f-26677994251e tempest-VolumesActionsTest-1113820978 None] Flow 'volume_create_manager' (6e3a4d20-ab37-45fc-b919-4afdf0f881a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:36:29 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-adf98fbd-6c9a-4b7f-886f-26677994251e tempest-VolumesActionsTest-1113820978 None] Created volume successfully. Jun 23 16:36:29 devstack sudo[104466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e009b2b1-b84a-4c17-92a3-422269471536 Jun 23 16:36:29 devstack sudo[104466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:29 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-89b16769-27e8-4ee6-8327-905e0ffea6ca tempest-VolumesActionsTest-1113820978 None] Acquiring lock "cinder-e8b8ab46-4128-43d6-bb57-2ff2ca8f30aa" by "attach_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:36:29 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-89b16769-27e8-4ee6-8327-905e0ffea6ca tempest-VolumesActionsTest-1113820978 None] Lock "cinder-e8b8ab46-4128-43d6-bb57-2ff2ca8f30aa" acquired by "attach_volume" :: waited 0.049s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:36:29 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-89b16769-27e8-4ee6-8327-905e0ffea6ca tempest-VolumesActionsTest-1113820978 None] Attaching volume e8b8ab46-4128-43d6-bb57-2ff2ca8f30aa to instance 1c3e6d6c-f8a8-4da6-b75d-df31befe2fa4 at mountpoint /dev/vdb on host None. Jun 23 16:36:29 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-89b16769-27e8-4ee6-8327-905e0ffea6ca tempest-VolumesActionsTest-1113820978 None] Attach volume completed successfully. Jun 23 16:36:29 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-89b16769-27e8-4ee6-8327-905e0ffea6ca tempest-VolumesActionsTest-1113820978 None] Lock "cinder-e8b8ab46-4128-43d6-bb57-2ff2ca8f30aa" released by "attach_volume" :: held 0.144s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:36:29 devstack sudo[104463]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-350bbe8a-4a58-43a6-bb94-38522012a4ea tempest-GroupSnapshotsTest-1791257526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cb58d479-b798-47f4-84b4-76f549308912" returned: 0 in 1.180s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-350bbe8a-4a58-43a6-bb94-38522012a4ea tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cb58d479-b798-47f4-84b4-76f549308912.8de2c858-e9fa-4923-9e63-dbc27c1456f3 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:29 devstack sudo[104471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cb58d479-b798-47f4-84b4-76f549308912.8de2c858-e9fa-4923-9e63-dbc27c1456f3 Jun 23 16:36:29 devstack sudo[104471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:30 devstack sudo[104466]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-9759c27a-991b-4cc2-acd2-d1fddd4fbdbb req-019577c4-8878-4f52-9a02-549d8c1f8b08 tempest-AttachVolumeTestJSON-1111501152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e009b2b1-b84a-4c17-92a3-422269471536" returned: 0 in 1.316s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-9759c27a-991b-4cc2-acd2-d1fddd4fbdbb req-019577c4-8878-4f52-9a02-549d8c1f8b08 tempest-AttachVolumeTestJSON-1111501152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.360s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:36:30 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-9759c27a-991b-4cc2-acd2-d1fddd4fbdbb req-019577c4-8878-4f52-9a02-549d8c1f8b08 tempest-AttachVolumeTestJSON-1111501152 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e', 'name': 'volume-e009b2b1-b84a-4c17-92a3-422269471536', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '434ccfae-b3b6-46a3-be67-16ff0e30d09b', 'enforce_multipath': True} {{(pid=93788) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 16:36:30 devstack cinder-volume[93788]: INFO cinder.volume.manager [req-9759c27a-991b-4cc2-acd2-d1fddd4fbdbb req-019577c4-8878-4f52-9a02-549d8c1f8b08 tempest-AttachVolumeTestJSON-1111501152 None] attachment_update completed successfully. Jun 23 16:36:30 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-5ffee0f2-1ae2-439a-b19f-a16fccb2a88e tempest-VolumesActionsTest-799589769 None] Terminate volume connection completed successfully. Jun 23 16:36:30 devstack sudo[104471]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-350bbe8a-4a58-43a6-bb94-38522012a4ea tempest-GroupSnapshotsTest-1791257526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cb58d479-b798-47f4-84b4-76f549308912.8de2c858-e9fa-4923-9e63-dbc27c1456f3" returned: 0 in 1.063s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-350bbe8a-4a58-43a6-bb94-38522012a4ea tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cb58d479-b798-47f4-84b4-76f549308912.8de2c858-e9fa-4923-9e63-dbc27c1456f3 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:30 devstack sudo[104504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cb58d479-b798-47f4-84b4-76f549308912.8de2c858-e9fa-4923-9e63-dbc27c1456f3 Jun 23 16:36:30 devstack sudo[104504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:31 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5ffee0f2-1ae2-439a-b19f-a16fccb2a88e tempest-VolumesActionsTest-799589769 None] Acquiring lock "cinder-e8b8ab46-4128-43d6-bb57-2ff2ca8f30aa-detach_volume" by "detach_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:36:31 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5ffee0f2-1ae2-439a-b19f-a16fccb2a88e tempest-VolumesActionsTest-799589769 None] Lock "cinder-e8b8ab46-4128-43d6-bb57-2ff2ca8f30aa-detach_volume" acquired by "detach_volume" :: waited 0.040s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:36:31 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-5ffee0f2-1ae2-439a-b19f-a16fccb2a88e tempest-VolumesActionsTest-799589769 None] Detaching volume e8b8ab46-4128-43d6-bb57-2ff2ca8f30aa from instance 1c3e6d6c-f8a8-4da6-b75d-df31befe2fa4. Jun 23 16:36:31 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-5ffee0f2-1ae2-439a-b19f-a16fccb2a88e tempest-VolumesActionsTest-799589769 None] Detach volume completed successfully. Jun 23 16:36:31 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5ffee0f2-1ae2-439a-b19f-a16fccb2a88e tempest-VolumesActionsTest-799589769 None] Lock "cinder-e8b8ab46-4128-43d6-bb57-2ff2ca8f30aa-detach_volume" released by "detach_volume" :: held 0.096s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:36:31 devstack sudo[104504]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:31 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-350bbe8a-4a58-43a6-bb94-38522012a4ea tempest-GroupSnapshotsTest-1791257526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cb58d479-b798-47f4-84b4-76f549308912.8de2c858-e9fa-4923-9e63-dbc27c1456f3" returned: 0 in 0.696s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:31 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-350bbe8a-4a58-43a6-bb94-38522012a4ea tempest-GroupSnapshotsTest-1791257526 None] Lock "cinder-quobyte-8de2c858-e9fa-4923-9e63-dbc27c1456f3" released by "_delete_snapshot" :: held 4.456s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:36:31 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-350bbe8a-4a58-43a6-bb94-38522012a4ea tempest-GroupSnapshotsTest-1791257526 None] Lock "cinder-quobyte-cb58d479-b798-47f4-84b4-76f549308912" released by "delete_snapshot" :: held 4.499s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:36:31 devstack cinder-volume[93788]: WARNING cinder.quota [None req-350bbe8a-4a58-43a6-bb94-38522012a4ea tempest-GroupSnapshotsTest-1791257526 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1286204995 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1286204995, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:36:31 devstack cinder-volume[93788]: WARNING cinder.quota [None req-350bbe8a-4a58-43a6-bb94-38522012a4ea tempest-GroupSnapshotsTest-1791257526 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1286204995 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1286204995, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:36:31 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-350bbe8a-4a58-43a6-bb94-38522012a4ea tempest-GroupSnapshotsTest-1791257526 None] Created reservations ['567fd63a-f820-47a2-ab29-70a060ef8be1', 'b53699d8-f4b9-449e-9f50-f12040e12cb5', '266d4cd2-ad3f-49f0-be35-76a79cf9357f', '767ca97c-46bb-4c57-a615-cfce09d1565d'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:36:31 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e24e9f9c-7590-496e-bf76-df175fdcec5b tempest-VolumesActionsTest-1113820978 None] Acquiring lock "cinder-e8b8ab46-4128-43d6-bb57-2ff2ca8f30aa-detach_volume" by "detach_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:36:32 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e24e9f9c-7590-496e-bf76-df175fdcec5b tempest-VolumesActionsTest-1113820978 None] Lock "cinder-e8b8ab46-4128-43d6-bb57-2ff2ca8f30aa-detach_volume" acquired by "detach_volume" :: waited 0.045s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:36:32 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-e24e9f9c-7590-496e-bf76-df175fdcec5b tempest-VolumesActionsTest-1113820978 None] Volume detach called, but volume not attached. Jun 23 16:36:32 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e24e9f9c-7590-496e-bf76-df175fdcec5b tempest-VolumesActionsTest-1113820978 None] Lock "cinder-e8b8ab46-4128-43d6-bb57-2ff2ca8f30aa-detach_volume" released by "detach_volume" :: held 0.044s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:36:32 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-350bbe8a-4a58-43a6-bb94-38522012a4ea tempest-GroupSnapshotsTest-1791257526 None] group_snapshot b6f294a6-cdb0-49e7-9379-31b0e6fe372d: deleted successfully Jun 23 16:36:32 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-677c74f0-7424-430f-95ad-3061d9cf4c80 tempest-GroupSnapshotsTest-1791257526 None] Acquiring lock "cinder-quobyte-cb58d479-b798-47f4-84b4-76f549308912" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:36:32 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-677c74f0-7424-430f-95ad-3061d9cf4c80 tempest-GroupSnapshotsTest-1791257526 None] Lock "cinder-quobyte-cb58d479-b798-47f4-84b4-76f549308912" acquired by "delete_volume" :: waited 0.021s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:36:32 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8cfacb-e444-4845-a181-5e70d35bae5e]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:36:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-677c74f0-7424-430f-95ad-3061d9cf4c80 tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cb58d479-b798-47f4-84b4-76f549308912 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:32 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e8edb032-e93b-4019-a402-9dc81e52f41d tempest-VolumesActionsTest-1113820978 None] Acquiring lock "cinder-e8b8ab46-4128-43d6-bb57-2ff2ca8f30aa-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:36:32 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e8edb032-e93b-4019-a402-9dc81e52f41d tempest-VolumesActionsTest-1113820978 None] Lock "cinder-e8b8ab46-4128-43d6-bb57-2ff2ca8f30aa-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:36:32 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e8edb032-e93b-4019-a402-9dc81e52f41d tempest-VolumesActionsTest-1113820978 None] Acquiring lock "cinder-quobyte-e8b8ab46-4128-43d6-bb57-2ff2ca8f30aa" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:36:32 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e8edb032-e93b-4019-a402-9dc81e52f41d tempest-VolumesActionsTest-1113820978 None] Lock "cinder-quobyte-e8b8ab46-4128-43d6-bb57-2ff2ca8f30aa" acquired by "delete_volume" :: waited 0.018s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:36:32 devstack sudo[104569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cb58d479-b798-47f4-84b4-76f549308912 Jun 23 16:36:32 devstack sudo[104569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:32 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ff7e01-7a62-42f2-b136-4b01ab586b4f]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:36:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e8edb032-e93b-4019-a402-9dc81e52f41d tempest-VolumesActionsTest-1113820978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8b8ab46-4128-43d6-bb57-2ff2ca8f30aa {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:33 devstack sudo[104571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8b8ab46-4128-43d6-bb57-2ff2ca8f30aa Jun 23 16:36:33 devstack sudo[104571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:33 devstack sudo[104569]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:33 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-677c74f0-7424-430f-95ad-3061d9cf4c80 tempest-GroupSnapshotsTest-1791257526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cb58d479-b798-47f4-84b4-76f549308912" returned: 0 in 0.983s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:33 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-677c74f0-7424-430f-95ad-3061d9cf4c80 tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cb58d479-b798-47f4-84b4-76f549308912 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:33 devstack sudo[104580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cb58d479-b798-47f4-84b4-76f549308912 Jun 23 16:36:33 devstack sudo[104580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:33 devstack sudo[104571]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:33 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e8edb032-e93b-4019-a402-9dc81e52f41d tempest-VolumesActionsTest-1113820978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8b8ab46-4128-43d6-bb57-2ff2ca8f30aa" returned: 0 in 0.882s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:33 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e8edb032-e93b-4019-a402-9dc81e52f41d tempest-VolumesActionsTest-1113820978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8b8ab46-4128-43d6-bb57-2ff2ca8f30aa {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:33 devstack sudo[104582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8b8ab46-4128-43d6-bb57-2ff2ca8f30aa Jun 23 16:36:33 devstack sudo[104582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:34 devstack sudo[104580]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-677c74f0-7424-430f-95ad-3061d9cf4c80 tempest-GroupSnapshotsTest-1791257526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cb58d479-b798-47f4-84b4-76f549308912" returned: 0 in 0.724s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:34 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-677c74f0-7424-430f-95ad-3061d9cf4c80 tempest-GroupSnapshotsTest-1791257526 None] Lock "cinder-quobyte-cb58d479-b798-47f4-84b4-76f549308912" released by "delete_volume" :: held 1.805s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:36:34 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-677c74f0-7424-430f-95ad-3061d9cf4c80 tempest-GroupSnapshotsTest-1791257526 None] Created reservations ['60747300-8165-4a46-bd95-afdb77eec6d6'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:36:34 devstack cinder-volume[93788]: WARNING cinder.quota [None req-677c74f0-7424-430f-95ad-3061d9cf4c80 tempest-GroupSnapshotsTest-1791257526 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1286204995 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1286204995, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:36:34 devstack sudo[104582]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e8edb032-e93b-4019-a402-9dc81e52f41d tempest-VolumesActionsTest-1113820978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8b8ab46-4128-43d6-bb57-2ff2ca8f30aa" returned: 0 in 0.760s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:34 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e8edb032-e93b-4019-a402-9dc81e52f41d tempest-VolumesActionsTest-1113820978 None] Lock "cinder-quobyte-e8b8ab46-4128-43d6-bb57-2ff2ca8f30aa" released by "delete_volume" :: held 1.696s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:36:34 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-677c74f0-7424-430f-95ad-3061d9cf4c80 tempest-GroupSnapshotsTest-1791257526 None] Created reservations ['3c2a4e09-c6c0-4210-b355-4386edc87900', '7fdd150c-303b-4e66-8c50-58f05dc828b1', 'aa5b839c-8791-4bd4-8e15-7741f8f3f0eb', 'd3da4a48-7673-4300-b989-d866bd8cfce8'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:36:34 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-e8edb032-e93b-4019-a402-9dc81e52f41d tempest-VolumesActionsTest-1113820978 None] Created reservations ['345648a5-a2b1-4378-8796-cd1cb6579bed', '39021d72-4caf-4a28-887e-fa2b0588e463', '0cd88765-ebd4-4e35-8f65-28727d146dec', 'fc81897a-1f7a-4d68-a51d-4945887a9ff6'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:36:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-677c74f0-7424-430f-95ad-3061d9cf4c80 tempest-GroupSnapshotsTest-1791257526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:36:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-677c74f0-7424-430f-95ad-3061d9cf4c80 tempest-GroupSnapshotsTest-1791257526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:36:34 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-677c74f0-7424-430f-95ad-3061d9cf4c80 tempest-GroupSnapshotsTest-1791257526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:36:34 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-677c74f0-7424-430f-95ad-3061d9cf4c80 tempest-GroupSnapshotsTest-1791257526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:36:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-677c74f0-7424-430f-95ad-3061d9cf4c80 tempest-GroupSnapshotsTest-1791257526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:36:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-677c74f0-7424-430f-95ad-3061d9cf4c80 tempest-GroupSnapshotsTest-1791257526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e8edb032-e93b-4019-a402-9dc81e52f41d tempest-VolumesActionsTest-1113820978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:36:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e8edb032-e93b-4019-a402-9dc81e52f41d tempest-VolumesActionsTest-1113820978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:36:34 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e8edb032-e93b-4019-a402-9dc81e52f41d tempest-VolumesActionsTest-1113820978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:36:34 devstack sudo[104589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:36:34 devstack sudo[104589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:34 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e8edb032-e93b-4019-a402-9dc81e52f41d tempest-VolumesActionsTest-1113820978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:36:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e8edb032-e93b-4019-a402-9dc81e52f41d tempest-VolumesActionsTest-1113820978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:36:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e8edb032-e93b-4019-a402-9dc81e52f41d tempest-VolumesActionsTest-1113820978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:34 devstack sudo[104591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:36:34 devstack sudo[104591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:35 devstack sudo[104591]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e8edb032-e93b-4019-a402-9dc81e52f41d tempest-VolumesActionsTest-1113820978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.015s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:35 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-e8edb032-e93b-4019-a402-9dc81e52f41d tempest-VolumesActionsTest-1113820978 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:36:35 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-e8edb032-e93b-4019-a402-9dc81e52f41d tempest-VolumesActionsTest-1113820978 None] Deleted volume successfully. Jun 23 16:36:35 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e8edb032-e93b-4019-a402-9dc81e52f41d tempest-VolumesActionsTest-1113820978 None] Lock "cinder-e8b8ab46-4128-43d6-bb57-2ff2ca8f30aa-delete_volume" released by "delete_volume" :: held 3.059s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:36:35 devstack sudo[104589]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-677c74f0-7424-430f-95ad-3061d9cf4c80 tempest-GroupSnapshotsTest-1791257526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.111s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:35 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-677c74f0-7424-430f-95ad-3061d9cf4c80 tempest-GroupSnapshotsTest-1791257526 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:36:35 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-677c74f0-7424-430f-95ad-3061d9cf4c80 tempest-GroupSnapshotsTest-1791257526 None] Delete group completed successfully. Jun 23 16:36:37 devstack cinder-volume[93788]: INFO cinder.volume.manager [req-9abd49c1-1cb6-4042-95a1-8bbbe9116c69 req-a5c0cf49-c83c-467a-8b1c-82992353c680 tempest-AttachVolumeTestJSON-1111501152 None] Terminate volume connection completed successfully. Jun 23 16:36:37 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-9abd49c1-1cb6-4042-95a1-8bbbe9116c69 req-a5c0cf49-c83c-467a-8b1c-82992353c680 tempest-AttachVolumeTestJSON-1111501152 None] Deleting attachment 751f4357-931f-4434-976e-aea8e1ec581d. {{(pid=93788) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 16:36:41 devstack cinder-volume[93788]: INFO cinder.volume.manager [req-21a7332a-eb08-4440-8749-d49fe68ad0f0 req-11f956e5-0574-4d7c-9398-dac1d7f800c2 tempest-AttachVolumeTestJSON-1111501152 None] Terminate volume connection completed successfully. Jun 23 16:36:41 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-21a7332a-eb08-4440-8749-d49fe68ad0f0 req-11f956e5-0574-4d7c-9398-dac1d7f800c2 tempest-AttachVolumeTestJSON-1111501152 None] Deleting attachment 434ccfae-b3b6-46a3-be67-16ff0e30d09b. {{(pid=93788) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 16:36:43 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-74873ca2-a10d-4c0d-a93e-b55d96aad93a tempest-VolumesActionsTest-1113820978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:36:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-74873ca2-a10d-4c0d-a93e-b55d96aad93a tempest-VolumesActionsTest-1113820978 None] Flow 'volume_create_manager' (65cc4457-8ac1-4cf0-aae7-ab374a354752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:36:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-74873ca2-a10d-4c0d-a93e-b55d96aad93a tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7822f8b8-2217-47ca-8f4d-f93e12aed0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:36:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-74873ca2-a10d-4c0d-a93e-b55d96aad93a tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7822f8b8-2217-47ca-8f4d-f93e12aed0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-536080198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32616a3b-a403-4709-84ae-0f95f5f79567,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfc07113077b492c8ba668960a6f4dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:36:43Z,use_quota=True,user_id='8bf540cfe6304942beeb4e6870a7f49d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:36:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-74873ca2-a10d-4c0d-a93e-b55d96aad93a tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6d350eb-60cd-41b2-8423-83cff2949620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:36:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-74873ca2-a10d-4c0d-a93e-b55d96aad93a tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6d350eb-60cd-41b2-8423-83cff2949620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:36:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-74873ca2-a10d-4c0d-a93e-b55d96aad93a tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d204f57-f0d6-449b-8a8b-9dea1eeb38b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:36:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-74873ca2-a10d-4c0d-a93e-b55d96aad93a tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d204f57-f0d6-449b-8a8b-9dea1eeb38b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32616a3b-a403-4709-84ae-0f95f5f79567', 'volume_name': 'volume-32616a3b-a403-4709-84ae-0f95f5f79567', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:36:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-74873ca2-a10d-4c0d-a93e-b55d96aad93a tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (664cbeef-c665-41a4-abf6-f5407f7b1aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:36:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-74873ca2-a10d-4c0d-a93e-b55d96aad93a tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (664cbeef-c665-41a4-abf6-f5407f7b1aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:36:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-74873ca2-a10d-4c0d-a93e-b55d96aad93a tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21b6369b-36f3-4d4e-bf54-55f735b3fadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:36:43 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-74873ca2-a10d-4c0d-a93e-b55d96aad93a tempest-VolumesActionsTest-1113820978 None] Volume 32616a3b-a403-4709-84ae-0f95f5f79567: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32616a3b-a403-4709-84ae-0f95f5f79567', 'volume_size': 1} Jun 23 16:36:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-74873ca2-a10d-4c0d-a93e-b55d96aad93a tempest-VolumesActionsTest-1113820978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:36:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-74873ca2-a10d-4c0d-a93e-b55d96aad93a tempest-VolumesActionsTest-1113820978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:36:43 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-74873ca2-a10d-4c0d-a93e-b55d96aad93a tempest-VolumesActionsTest-1113820978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-536080198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32616a3b-a403-4709-84ae-0f95f5f79567,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfc07113077b492c8ba668960a6f4dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:36:43Z,use_quota=True,user_id='8bf540cfe6304942beeb4e6870a7f49d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:36:43 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-74873ca2-a10d-4c0d-a93e-b55d96aad93a tempest-VolumesActionsTest-1113820978 None] Creating volume 32616a3b-a403-4709-84ae-0f95f5f79567 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:36:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-74873ca2-a10d-4c0d-a93e-b55d96aad93a tempest-VolumesActionsTest-1113820978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:36:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-74873ca2-a10d-4c0d-a93e-b55d96aad93a tempest-VolumesActionsTest-1113820978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:36:43 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-74873ca2-a10d-4c0d-a93e-b55d96aad93a tempest-VolumesActionsTest-1113820978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:36:43 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-74873ca2-a10d-4c0d-a93e-b55d96aad93a tempest-VolumesActionsTest-1113820978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:36:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-74873ca2-a10d-4c0d-a93e-b55d96aad93a tempest-VolumesActionsTest-1113820978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:36:43 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-74873ca2-a10d-4c0d-a93e-b55d96aad93a tempest-VolumesActionsTest-1113820978 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:36:43 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-74873ca2-a10d-4c0d-a93e-b55d96aad93a tempest-VolumesActionsTest-1113820978 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:36:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-74873ca2-a10d-4c0d-a93e-b55d96aad93a tempest-VolumesActionsTest-1113820978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-32616a3b-a403-4709-84ae-0f95f5f79567 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:43 devstack sudo[104723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-32616a3b-a403-4709-84ae-0f95f5f79567 1073741824 Jun 23 16:36:43 devstack sudo[104723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:44 devstack sudo[104723]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-74873ca2-a10d-4c0d-a93e-b55d96aad93a tempest-VolumesActionsTest-1113820978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-32616a3b-a403-4709-84ae-0f95f5f79567 1073741824" returned: 0 in 1.113s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-74873ca2-a10d-4c0d-a93e-b55d96aad93a tempest-VolumesActionsTest-1113820978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-32616a3b-a403-4709-84ae-0f95f5f79567 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:44 devstack sudo[104729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-32616a3b-a403-4709-84ae-0f95f5f79567 Jun 23 16:36:44 devstack sudo[104729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:45 devstack sudo[104729]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:45 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-74873ca2-a10d-4c0d-a93e-b55d96aad93a tempest-VolumesActionsTest-1113820978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-32616a3b-a403-4709-84ae-0f95f5f79567" returned: 0 in 1.008s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:45 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-74873ca2-a10d-4c0d-a93e-b55d96aad93a tempest-VolumesActionsTest-1113820978 None] <== create_volume: return (2176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:36:45 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-74873ca2-a10d-4c0d-a93e-b55d96aad93a tempest-VolumesActionsTest-1113820978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.182s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:36:45 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:SELECT=93,cinder:INSERT=25,cinder:UPDATE=94,cinder:DELETE=3 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:36:45 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-74873ca2-a10d-4c0d-a93e-b55d96aad93a tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21b6369b-36f3-4d4e-bf54-55f735b3fadd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32616a3b-a403-4709-84ae-0f95f5f79567', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:36:45 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-74873ca2-a10d-4c0d-a93e-b55d96aad93a tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8add7c37-bd7f-47fb-b80e-edfea340457e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:36:45 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:SELECT=102,cinder:UPDATE=85,cinder:INSERT=18,cinder:DELETE=3 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:36:45 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-74873ca2-a10d-4c0d-a93e-b55d96aad93a tempest-VolumesActionsTest-1113820978 None] Volume volume-32616a3b-a403-4709-84ae-0f95f5f79567 (32616a3b-a403-4709-84ae-0f95f5f79567): created successfully Jun 23 16:36:45 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-74873ca2-a10d-4c0d-a93e-b55d96aad93a tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8add7c37-bd7f-47fb-b80e-edfea340457e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:36:45 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-74873ca2-a10d-4c0d-a93e-b55d96aad93a tempest-VolumesActionsTest-1113820978 None] Flow 'volume_create_manager' (65cc4457-8ac1-4cf0-aae7-ab374a354752) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:36:45 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-74873ca2-a10d-4c0d-a93e-b55d96aad93a tempest-VolumesActionsTest-1113820978 None] Created volume successfully. Jun 23 16:36:46 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-cbc1777f-f3c0-41e7-a484-bd82aba7a916 tempest-VolumesActionsTest-799589769 None] Acquiring lock "cinder-32616a3b-a403-4709-84ae-0f95f5f79567-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:36:46 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-cbc1777f-f3c0-41e7-a484-bd82aba7a916 tempest-VolumesActionsTest-799589769 None] Lock "cinder-32616a3b-a403-4709-84ae-0f95f5f79567-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:36:46 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-cbc1777f-f3c0-41e7-a484-bd82aba7a916 tempest-VolumesActionsTest-799589769 None] Acquiring lock "cinder-quobyte-32616a3b-a403-4709-84ae-0f95f5f79567" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:36:46 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-cbc1777f-f3c0-41e7-a484-bd82aba7a916 tempest-VolumesActionsTest-799589769 None] Lock "cinder-quobyte-32616a3b-a403-4709-84ae-0f95f5f79567" acquired by "delete_volume" :: waited 0.027s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:36:46 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4bb96b-1256-4549-b96b-63f38ab2cc5b]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:36:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-cbc1777f-f3c0-41e7-a484-bd82aba7a916 tempest-VolumesActionsTest-799589769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-32616a3b-a403-4709-84ae-0f95f5f79567 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:47 devstack sudo[104792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-32616a3b-a403-4709-84ae-0f95f5f79567 Jun 23 16:36:47 devstack sudo[104792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:48 devstack sudo[104792]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-cbc1777f-f3c0-41e7-a484-bd82aba7a916 tempest-VolumesActionsTest-799589769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-32616a3b-a403-4709-84ae-0f95f5f79567" returned: 0 in 1.372s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-cbc1777f-f3c0-41e7-a484-bd82aba7a916 tempest-VolumesActionsTest-799589769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-32616a3b-a403-4709-84ae-0f95f5f79567 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:48 devstack sudo[104852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-32616a3b-a403-4709-84ae-0f95f5f79567 Jun 23 16:36:48 devstack sudo[104852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:49 devstack sudo[104852]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-cbc1777f-f3c0-41e7-a484-bd82aba7a916 tempest-VolumesActionsTest-799589769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-32616a3b-a403-4709-84ae-0f95f5f79567" returned: 0 in 1.221s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:49 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-cbc1777f-f3c0-41e7-a484-bd82aba7a916 tempest-VolumesActionsTest-799589769 None] Lock "cinder-quobyte-32616a3b-a403-4709-84ae-0f95f5f79567" released by "delete_volume" :: held 2.674s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:36:49 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-cbc1777f-f3c0-41e7-a484-bd82aba7a916 tempest-VolumesActionsTest-799589769 None] Created reservations ['8405d3ea-5921-4039-bbd2-940166c34089', '787e3922-1386-455f-8452-8a77b8b64fa3', 'c392991e-5257-49af-9a27-51c7cee5954b', 'be7d388e-74f8-4109-989b-e5df4ff1c71d'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:36:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-cbc1777f-f3c0-41e7-a484-bd82aba7a916 tempest-VolumesActionsTest-799589769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:36:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-cbc1777f-f3c0-41e7-a484-bd82aba7a916 tempest-VolumesActionsTest-799589769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:36:49 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-cbc1777f-f3c0-41e7-a484-bd82aba7a916 tempest-VolumesActionsTest-799589769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:36:49 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-cbc1777f-f3c0-41e7-a484-bd82aba7a916 tempest-VolumesActionsTest-799589769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:36:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-cbc1777f-f3c0-41e7-a484-bd82aba7a916 tempest-VolumesActionsTest-799589769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:36:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-cbc1777f-f3c0-41e7-a484-bd82aba7a916 tempest-VolumesActionsTest-799589769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:49 devstack sudo[104882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:36:49 devstack sudo[104882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:50 devstack sudo[104882]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-cbc1777f-f3c0-41e7-a484-bd82aba7a916 tempest-VolumesActionsTest-799589769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.060s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:50 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-cbc1777f-f3c0-41e7-a484-bd82aba7a916 tempest-VolumesActionsTest-799589769 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:36:50 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-cbc1777f-f3c0-41e7-a484-bd82aba7a916 tempest-VolumesActionsTest-799589769 None] Deleted volume successfully. Jun 23 16:36:50 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-cbc1777f-f3c0-41e7-a484-bd82aba7a916 tempest-VolumesActionsTest-799589769 None] Lock "cinder-32616a3b-a403-4709-84ae-0f95f5f79567-delete_volume" released by "delete_volume" :: held 4.064s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:36:51 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-85095d55-ffde-4876-a7aa-a2cba08b43cf tempest-VolumesActionsTest-1113820978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:36:51 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-85095d55-ffde-4876-a7aa-a2cba08b43cf tempest-VolumesActionsTest-1113820978 None] Flow 'volume_create_manager' (d2e93180-ea90-4d5a-911f-77c1fac1138b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:36:51 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-85095d55-ffde-4876-a7aa-a2cba08b43cf tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c14ec005-6d7d-4889-8e74-02dc2e295f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:36:51 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-85095d55-ffde-4876-a7aa-a2cba08b43cf tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c14ec005-6d7d-4889-8e74-02dc2e295f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1413382205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23829dc9-be18-4a7e-823e-cc1610a937f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfc07113077b492c8ba668960a6f4dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:36:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:36:51Z,use_quota=True,user_id='8bf540cfe6304942beeb4e6870a7f49d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:36:51 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-85095d55-ffde-4876-a7aa-a2cba08b43cf tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cf047cd-3cca-405e-8364-763ef2f34c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:36:51 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-85095d55-ffde-4876-a7aa-a2cba08b43cf tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cf047cd-3cca-405e-8364-763ef2f34c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:36:51 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-85095d55-ffde-4876-a7aa-a2cba08b43cf tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7529fb2d-3c63-4c1e-8c4b-b82989d39b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:36:51 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-85095d55-ffde-4876-a7aa-a2cba08b43cf tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7529fb2d-3c63-4c1e-8c4b-b82989d39b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23829dc9-be18-4a7e-823e-cc1610a937f0', 'volume_name': 'volume-23829dc9-be18-4a7e-823e-cc1610a937f0', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:36:51 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-85095d55-ffde-4876-a7aa-a2cba08b43cf tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d767b1b-8997-4840-b5c7-7cf32c8eddfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:36:51 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-85095d55-ffde-4876-a7aa-a2cba08b43cf tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d767b1b-8997-4840-b5c7-7cf32c8eddfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:36:51 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-85095d55-ffde-4876-a7aa-a2cba08b43cf tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5356d5f5-bd0e-44b7-905f-20debef7f5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:36:51 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-85095d55-ffde-4876-a7aa-a2cba08b43cf tempest-VolumesActionsTest-1113820978 None] Volume 23829dc9-be18-4a7e-823e-cc1610a937f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23829dc9-be18-4a7e-823e-cc1610a937f0', 'volume_size': 1} Jun 23 16:36:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-85095d55-ffde-4876-a7aa-a2cba08b43cf tempest-VolumesActionsTest-1113820978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:36:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-85095d55-ffde-4876-a7aa-a2cba08b43cf tempest-VolumesActionsTest-1113820978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:36:51 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-85095d55-ffde-4876-a7aa-a2cba08b43cf tempest-VolumesActionsTest-1113820978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1413382205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23829dc9-be18-4a7e-823e-cc1610a937f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfc07113077b492c8ba668960a6f4dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:36:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:36:51Z,use_quota=True,user_id='8bf540cfe6304942beeb4e6870a7f49d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:36:51 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-85095d55-ffde-4876-a7aa-a2cba08b43cf tempest-VolumesActionsTest-1113820978 None] Creating volume 23829dc9-be18-4a7e-823e-cc1610a937f0 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:36:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-85095d55-ffde-4876-a7aa-a2cba08b43cf tempest-VolumesActionsTest-1113820978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:36:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-85095d55-ffde-4876-a7aa-a2cba08b43cf tempest-VolumesActionsTest-1113820978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:36:51 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-85095d55-ffde-4876-a7aa-a2cba08b43cf tempest-VolumesActionsTest-1113820978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:36:51 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-85095d55-ffde-4876-a7aa-a2cba08b43cf tempest-VolumesActionsTest-1113820978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:36:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-85095d55-ffde-4876-a7aa-a2cba08b43cf tempest-VolumesActionsTest-1113820978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:36:51 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-85095d55-ffde-4876-a7aa-a2cba08b43cf tempest-VolumesActionsTest-1113820978 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:36:51 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-85095d55-ffde-4876-a7aa-a2cba08b43cf tempest-VolumesActionsTest-1113820978 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:36:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-85095d55-ffde-4876-a7aa-a2cba08b43cf tempest-VolumesActionsTest-1113820978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-23829dc9-be18-4a7e-823e-cc1610a937f0 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:51 devstack sudo[104887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-23829dc9-be18-4a7e-823e-cc1610a937f0 1073741824 Jun 23 16:36:51 devstack sudo[104887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:52 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-8964d634-2d6b-416c-8f41-04c75156aced tempest-VolumesActionsTest-1224009287 None] Acquiring lock "cinder-e3434346-f7a9-4aaa-8210-6e8c244d1a95" by "attach_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:36:52 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-8964d634-2d6b-416c-8f41-04c75156aced tempest-VolumesActionsTest-1224009287 None] Lock "cinder-e3434346-f7a9-4aaa-8210-6e8c244d1a95" acquired by "attach_volume" :: waited 0.048s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:36:52 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-89bf13bc-9fe2-4c02-9b63-dcb71e9a3acf tempest-GroupsV314Test-863839659 None] Group tempest-GroupsV314Test-Group-1796941958: creating Jun 23 16:36:52 devstack sudo[104887]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-85095d55-ffde-4876-a7aa-a2cba08b43cf tempest-VolumesActionsTest-1113820978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-23829dc9-be18-4a7e-823e-cc1610a937f0 1073741824" returned: 0 in 1.397s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:52 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-89bf13bc-9fe2-4c02-9b63-dcb71e9a3acf tempest-GroupsV314Test-863839659 None] Group tempest-GroupsV314Test-Group-1796941958: created successfully Jun 23 16:36:52 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-89bf13bc-9fe2-4c02-9b63-dcb71e9a3acf tempest-GroupsV314Test-863839659 None] Create group completed successfully. Jun 23 16:36:52 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-8964d634-2d6b-416c-8f41-04c75156aced tempest-VolumesActionsTest-1224009287 None] Attaching volume e3434346-f7a9-4aaa-8210-6e8c244d1a95 to instance 85bdc9f6-96ec-4590-add3-d4890c8c0e70 at mountpoint /dev/vdb on host None. Jun 23 16:36:52 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-8964d634-2d6b-416c-8f41-04c75156aced tempest-VolumesActionsTest-1224009287 None] Attach volume completed successfully. Jun 23 16:36:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-85095d55-ffde-4876-a7aa-a2cba08b43cf tempest-VolumesActionsTest-1113820978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-23829dc9-be18-4a7e-823e-cc1610a937f0 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:52 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-8964d634-2d6b-416c-8f41-04c75156aced tempest-VolumesActionsTest-1224009287 None] Lock "cinder-e3434346-f7a9-4aaa-8210-6e8c244d1a95" released by "attach_volume" :: held 0.313s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:36:52 devstack sudo[104893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-23829dc9-be18-4a7e-823e-cc1610a937f0 Jun 23 16:36:52 devstack sudo[104893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:53 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-fe2d6f6d-f175-4eef-8358-e431ba45fd05 tempest-VolumesActionsTest-1224009287 None] Acquiring lock "cinder-e3434346-f7a9-4aaa-8210-6e8c244d1a95-detach_volume" by "detach_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:36:53 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-da56b423-d41f-4f90-a923-576c45883f62 tempest-AttachVolumeTestJSON-1111501152 None] Acquiring lock "cinder-e009b2b1-b84a-4c17-92a3-422269471536-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:36:53 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-fe2d6f6d-f175-4eef-8358-e431ba45fd05 tempest-VolumesActionsTest-1224009287 None] Lock "cinder-e3434346-f7a9-4aaa-8210-6e8c244d1a95-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:36:53 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-fe2d6f6d-f175-4eef-8358-e431ba45fd05 tempest-VolumesActionsTest-1224009287 None] Detaching volume e3434346-f7a9-4aaa-8210-6e8c244d1a95 from instance 85bdc9f6-96ec-4590-add3-d4890c8c0e70. Jun 23 16:36:53 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-da56b423-d41f-4f90-a923-576c45883f62 tempest-AttachVolumeTestJSON-1111501152 None] Lock "cinder-e009b2b1-b84a-4c17-92a3-422269471536-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:36:53 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-da56b423-d41f-4f90-a923-576c45883f62 tempest-AttachVolumeTestJSON-1111501152 None] Acquiring lock "cinder-quobyte-e009b2b1-b84a-4c17-92a3-422269471536" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:36:53 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-fe2d6f6d-f175-4eef-8358-e431ba45fd05 tempest-VolumesActionsTest-1224009287 None] Detach volume completed successfully. Jun 23 16:36:53 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-fe2d6f6d-f175-4eef-8358-e431ba45fd05 tempest-VolumesActionsTest-1224009287 None] Lock "cinder-e3434346-f7a9-4aaa-8210-6e8c244d1a95-detach_volume" released by "detach_volume" :: held 0.105s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:36:53 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-da56b423-d41f-4f90-a923-576c45883f62 tempest-AttachVolumeTestJSON-1111501152 None] Lock "cinder-quobyte-e009b2b1-b84a-4c17-92a3-422269471536" acquired by "delete_volume" :: waited 0.028s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:36:53 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a86796d-c9f9-4b88-91a0-7464e8a285c6]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:36:53 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-da56b423-d41f-4f90-a923-576c45883f62 tempest-AttachVolumeTestJSON-1111501152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e009b2b1-b84a-4c17-92a3-422269471536 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:53 devstack sudo[104895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e009b2b1-b84a-4c17-92a3-422269471536 Jun 23 16:36:53 devstack sudo[104895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:53 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-85095d55-ffde-4876-a7aa-a2cba08b43cf tempest-VolumesActionsTest-1113820978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-23829dc9-be18-4a7e-823e-cc1610a937f0" returned: 0 in 0.858s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:53 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-85095d55-ffde-4876-a7aa-a2cba08b43cf tempest-VolumesActionsTest-1113820978 None] <== create_volume: return (2421ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:36:53 devstack sudo[104893]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:53 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-85095d55-ffde-4876-a7aa-a2cba08b43cf tempest-VolumesActionsTest-1113820978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.424s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:36:53 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-85095d55-ffde-4876-a7aa-a2cba08b43cf tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5356d5f5-bd0e-44b7-905f-20debef7f5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23829dc9-be18-4a7e-823e-cc1610a937f0', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:36:53 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-85095d55-ffde-4876-a7aa-a2cba08b43cf tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3499b57-8346-43f1-bfd0-e0ef0dadb399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:36:53 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-85095d55-ffde-4876-a7aa-a2cba08b43cf tempest-VolumesActionsTest-1113820978 None] Volume volume-23829dc9-be18-4a7e-823e-cc1610a937f0 (23829dc9-be18-4a7e-823e-cc1610a937f0): created successfully Jun 23 16:36:53 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-85095d55-ffde-4876-a7aa-a2cba08b43cf tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3499b57-8346-43f1-bfd0-e0ef0dadb399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:36:53 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-85095d55-ffde-4876-a7aa-a2cba08b43cf tempest-VolumesActionsTest-1113820978 None] Flow 'volume_create_manager' (d2e93180-ea90-4d5a-911f-77c1fac1138b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:36:53 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-85095d55-ffde-4876-a7aa-a2cba08b43cf tempest-VolumesActionsTest-1113820978 None] Created volume successfully. Jun 23 16:36:54 devstack sudo[104895]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-da56b423-d41f-4f90-a923-576c45883f62 tempest-AttachVolumeTestJSON-1111501152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e009b2b1-b84a-4c17-92a3-422269471536" returned: 0 in 1.073s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-da56b423-d41f-4f90-a923-576c45883f62 tempest-AttachVolumeTestJSON-1111501152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e009b2b1-b84a-4c17-92a3-422269471536 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:54 devstack sudo[104901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e009b2b1-b84a-4c17-92a3-422269471536 Jun 23 16:36:54 devstack sudo[104901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:54 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a3614b9-2c72-4827-82e9-35923a031051 tempest-GroupsV314Test-863839659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:36:54 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a3614b9-2c72-4827-82e9-35923a031051 tempest-GroupsV314Test-863839659 None] Flow 'volume_create_manager' (4037a168-700b-4eb2-8737-a08000cff84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:36:54 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a3614b9-2c72-4827-82e9-35923a031051 tempest-GroupsV314Test-863839659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5321a4dd-f4b2-42c5-bffd-8dbf4daee0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:36:54 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a3614b9-2c72-4827-82e9-35923a031051 tempest-GroupsV314Test-863839659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5321a4dd-f4b2-42c5-bffd-8dbf4daee0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:36:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-164158026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=872ea573-3705-4e86-a85d-bea6303959b5,host='devstack@QuobyteHD#QuobyteHD',id=e3458e37-6a31-4755-a68e-8b181dcbe59d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d617626d6a734eca84c5558eeeac1b87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:36:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:36:55Z,use_quota=True,user_id='3bc0ea4bfe934ceeb4377fc31e5138c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723f8e44-6ea5-4368-9fcb-122e33ababac),volume_type_id=723f8e44-6ea5-4368-9fcb-122e33ababac)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:36:54 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a3614b9-2c72-4827-82e9-35923a031051 tempest-GroupsV314Test-863839659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (924f5222-2464-4e00-ae42-830432e23e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:36:54 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a3614b9-2c72-4827-82e9-35923a031051 tempest-GroupsV314Test-863839659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (924f5222-2464-4e00-ae42-830432e23e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:36:54 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a3614b9-2c72-4827-82e9-35923a031051 tempest-GroupsV314Test-863839659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8917ba00-5fe9-40f3-98c9-3d3f1d882c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:36:54 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a3614b9-2c72-4827-82e9-35923a031051 tempest-GroupsV314Test-863839659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8917ba00-5fe9-40f3-98c9-3d3f1d882c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3458e37-6a31-4755-a68e-8b181dcbe59d', 'volume_name': 'volume-e3458e37-6a31-4755-a68e-8b181dcbe59d', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:36:54 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a3614b9-2c72-4827-82e9-35923a031051 tempest-GroupsV314Test-863839659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (797fe550-9476-4749-9be2-39f0c22a3587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:36:54 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a3614b9-2c72-4827-82e9-35923a031051 tempest-GroupsV314Test-863839659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (797fe550-9476-4749-9be2-39f0c22a3587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:36:54 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a3614b9-2c72-4827-82e9-35923a031051 tempest-GroupsV314Test-863839659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daecc7ff-7093-419b-8da4-a05c77c6f9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:36:54 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-0a3614b9-2c72-4827-82e9-35923a031051 tempest-GroupsV314Test-863839659 None] Volume e3458e37-6a31-4755-a68e-8b181dcbe59d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3458e37-6a31-4755-a68e-8b181dcbe59d', 'volume_size': 1} Jun 23 16:36:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-0a3614b9-2c72-4827-82e9-35923a031051 tempest-GroupsV314Test-863839659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:36:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-0a3614b9-2c72-4827-82e9-35923a031051 tempest-GroupsV314Test-863839659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:36:54 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-0a3614b9-2c72-4827-82e9-35923a031051 tempest-GroupsV314Test-863839659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=872ea573-3705-4e86-a85d-bea6303959b5,created_at=2026-06-23T14:36:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-164158026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=872ea573-3705-4e86-a85d-bea6303959b5,host='devstack@QuobyteHD#QuobyteHD',id=e3458e37-6a31-4755-a68e-8b181dcbe59d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d617626d6a734eca84c5558eeeac1b87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:36:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:36:55Z,use_quota=True,user_id='3bc0ea4bfe934ceeb4377fc31e5138c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723f8e44-6ea5-4368-9fcb-122e33ababac),volume_type_id=723f8e44-6ea5-4368-9fcb-122e33ababac)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:36:54 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-0a3614b9-2c72-4827-82e9-35923a031051 tempest-GroupsV314Test-863839659 None] Creating volume e3458e37-6a31-4755-a68e-8b181dcbe59d {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:36:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-0a3614b9-2c72-4827-82e9-35923a031051 tempest-GroupsV314Test-863839659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:36:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-0a3614b9-2c72-4827-82e9-35923a031051 tempest-GroupsV314Test-863839659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:36:54 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-0a3614b9-2c72-4827-82e9-35923a031051 tempest-GroupsV314Test-863839659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:36:54 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-0a3614b9-2c72-4827-82e9-35923a031051 tempest-GroupsV314Test-863839659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:36:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-0a3614b9-2c72-4827-82e9-35923a031051 tempest-GroupsV314Test-863839659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:36:54 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-0a3614b9-2c72-4827-82e9-35923a031051 tempest-GroupsV314Test-863839659 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:36:54 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-0a3614b9-2c72-4827-82e9-35923a031051 tempest-GroupsV314Test-863839659 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:36:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0a3614b9-2c72-4827-82e9-35923a031051 tempest-GroupsV314Test-863839659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:54 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-916320e3-2b97-4d1f-9c17-fa1091b0844d tempest-VolumesActionsTest-799589769 None] Acquiring lock "cinder-23829dc9-be18-4a7e-823e-cc1610a937f0-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:36:54 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-916320e3-2b97-4d1f-9c17-fa1091b0844d tempest-VolumesActionsTest-799589769 None] Lock "cinder-23829dc9-be18-4a7e-823e-cc1610a937f0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:36:54 devstack sudo[104903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d 1073741824 Jun 23 16:36:54 devstack sudo[104903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:54 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-916320e3-2b97-4d1f-9c17-fa1091b0844d tempest-VolumesActionsTest-799589769 None] Acquiring lock "cinder-quobyte-23829dc9-be18-4a7e-823e-cc1610a937f0" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:36:54 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-916320e3-2b97-4d1f-9c17-fa1091b0844d tempest-VolumesActionsTest-799589769 None] Lock "cinder-quobyte-23829dc9-be18-4a7e-823e-cc1610a937f0" acquired by "delete_volume" :: waited 0.026s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:36:55 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[43512918-63b6-4176-b932-43db13b1de2e]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:36:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-916320e3-2b97-4d1f-9c17-fa1091b0844d tempest-VolumesActionsTest-799589769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-23829dc9-be18-4a7e-823e-cc1610a937f0 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:55 devstack sudo[104905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-23829dc9-be18-4a7e-823e-cc1610a937f0 Jun 23 16:36:55 devstack sudo[104905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:55 devstack sudo[104901]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-da56b423-d41f-4f90-a923-576c45883f62 tempest-AttachVolumeTestJSON-1111501152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e009b2b1-b84a-4c17-92a3-422269471536" returned: 0 in 1.081s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:55 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-da56b423-d41f-4f90-a923-576c45883f62 tempest-AttachVolumeTestJSON-1111501152 None] Lock "cinder-quobyte-e009b2b1-b84a-4c17-92a3-422269471536" released by "delete_volume" :: held 2.228s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:36:55 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-da56b423-d41f-4f90-a923-576c45883f62 tempest-AttachVolumeTestJSON-1111501152 None] Created reservations ['cdaef39f-1cb8-4b4c-bae0-cffdb821275f', '1d2d99d4-8b24-4bf5-98e5-4dea9a61b248', 'a4a83081-bd6d-480e-ab1a-265ddd1f201d', 'f2b3a4ec-90b3-4788-ac90-d856c5c8eff0'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:36:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-da56b423-d41f-4f90-a923-576c45883f62 tempest-AttachVolumeTestJSON-1111501152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:36:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-da56b423-d41f-4f90-a923-576c45883f62 tempest-AttachVolumeTestJSON-1111501152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:36:55 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-da56b423-d41f-4f90-a923-576c45883f62 tempest-AttachVolumeTestJSON-1111501152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:36:56 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-da56b423-d41f-4f90-a923-576c45883f62 tempest-AttachVolumeTestJSON-1111501152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:36:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-da56b423-d41f-4f90-a923-576c45883f62 tempest-AttachVolumeTestJSON-1111501152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:36:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-da56b423-d41f-4f90-a923-576c45883f62 tempest-AttachVolumeTestJSON-1111501152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:56 devstack sudo[104955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:36:56 devstack sudo[104955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:56 devstack sudo[104905]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-916320e3-2b97-4d1f-9c17-fa1091b0844d tempest-VolumesActionsTest-799589769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-23829dc9-be18-4a7e-823e-cc1610a937f0" returned: 0 in 1.213s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-916320e3-2b97-4d1f-9c17-fa1091b0844d tempest-VolumesActionsTest-799589769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-23829dc9-be18-4a7e-823e-cc1610a937f0 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:56 devstack sudo[104959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-23829dc9-be18-4a7e-823e-cc1610a937f0 Jun 23 16:36:56 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:56 devstack sudo[104903]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0a3614b9-2c72-4827-82e9-35923a031051 tempest-GroupsV314Test-863839659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d 1073741824" returned: 0 in 1.548s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0a3614b9-2c72-4827-82e9-35923a031051 tempest-GroupsV314Test-863839659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:56 devstack sudo[104962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d Jun 23 16:36:56 devstack sudo[104962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:56 devstack sudo[104955]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-da56b423-d41f-4f90-a923-576c45883f62 tempest-AttachVolumeTestJSON-1111501152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.834s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:56 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-da56b423-d41f-4f90-a923-576c45883f62 tempest-AttachVolumeTestJSON-1111501152 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:36:56 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-da56b423-d41f-4f90-a923-576c45883f62 tempest-AttachVolumeTestJSON-1111501152 None] Deleted volume successfully. Jun 23 16:36:56 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-91091cbe-43c2-4d38-b295-a887924a15fe tempest-AttachVolumeTestJSON-1111501152 None] Acquiring lock "cinder-57d7e545-00fc-40df-a244-1c6bc8a1e607-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:36:56 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-91091cbe-43c2-4d38-b295-a887924a15fe tempest-AttachVolumeTestJSON-1111501152 None] Lock "cinder-57d7e545-00fc-40df-a244-1c6bc8a1e607-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:36:56 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-da56b423-d41f-4f90-a923-576c45883f62 tempest-AttachVolumeTestJSON-1111501152 None] Lock "cinder-e009b2b1-b84a-4c17-92a3-422269471536-delete_volume" released by "delete_volume" :: held 3.558s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:36:56 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-91091cbe-43c2-4d38-b295-a887924a15fe tempest-AttachVolumeTestJSON-1111501152 None] Acquiring lock "cinder-quobyte-57d7e545-00fc-40df-a244-1c6bc8a1e607" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:36:57 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-91091cbe-43c2-4d38-b295-a887924a15fe tempest-AttachVolumeTestJSON-1111501152 None] Lock "cinder-quobyte-57d7e545-00fc-40df-a244-1c6bc8a1e607" acquired by "delete_volume" :: waited 0.018s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:36:57 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2906a91-6fb3-4f58-a52a-1148c14e7169]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:36:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-91091cbe-43c2-4d38-b295-a887924a15fe tempest-AttachVolumeTestJSON-1111501152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-57d7e545-00fc-40df-a244-1c6bc8a1e607 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:57 devstack sudo[104967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-57d7e545-00fc-40df-a244-1c6bc8a1e607 Jun 23 16:36:57 devstack sudo[104967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:57 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-916320e3-2b97-4d1f-9c17-fa1091b0844d tempest-VolumesActionsTest-799589769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-23829dc9-be18-4a7e-823e-cc1610a937f0" returned: 0 in 0.980s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:57 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-916320e3-2b97-4d1f-9c17-fa1091b0844d tempest-VolumesActionsTest-799589769 None] Lock "cinder-quobyte-23829dc9-be18-4a7e-823e-cc1610a937f0" released by "delete_volume" :: held 2.251s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:36:57 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-916320e3-2b97-4d1f-9c17-fa1091b0844d tempest-VolumesActionsTest-799589769 None] Created reservations ['8a4c753d-f57c-4bc5-bd97-7322c56fd153', '1bdd7385-1da7-469c-bdf9-476e4667fa3b', 'cd927e64-943f-4050-ab76-438260602bbf', '1b62e5a1-5192-4554-b9a8-6f210e17e961'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:36:57 devstack sudo[104962]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0a3614b9-2c72-4827-82e9-35923a031051 tempest-GroupsV314Test-863839659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d" returned: 0 in 0.916s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:57 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-0a3614b9-2c72-4827-82e9-35923a031051 tempest-GroupsV314Test-863839659 None] <== create_volume: return (2527ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:36:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-0a3614b9-2c72-4827-82e9-35923a031051 tempest-GroupsV314Test-863839659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.530s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:36:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a3614b9-2c72-4827-82e9-35923a031051 tempest-GroupsV314Test-863839659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daecc7ff-7093-419b-8da4-a05c77c6f9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3458e37-6a31-4755-a68e-8b181dcbe59d', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:36:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a3614b9-2c72-4827-82e9-35923a031051 tempest-GroupsV314Test-863839659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (843964e3-f89d-4032-80fd-4a3177619fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:36:57 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-0a3614b9-2c72-4827-82e9-35923a031051 tempest-GroupsV314Test-863839659 None] Volume volume-e3458e37-6a31-4755-a68e-8b181dcbe59d (e3458e37-6a31-4755-a68e-8b181dcbe59d): created successfully Jun 23 16:36:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a3614b9-2c72-4827-82e9-35923a031051 tempest-GroupsV314Test-863839659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (843964e3-f89d-4032-80fd-4a3177619fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:36:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a3614b9-2c72-4827-82e9-35923a031051 tempest-GroupsV314Test-863839659 None] Flow 'volume_create_manager' (4037a168-700b-4eb2-8737-a08000cff84b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:36:57 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-0a3614b9-2c72-4827-82e9-35923a031051 tempest-GroupsV314Test-863839659 None] Created volume successfully. Jun 23 16:36:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-916320e3-2b97-4d1f-9c17-fa1091b0844d tempest-VolumesActionsTest-799589769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:36:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-916320e3-2b97-4d1f-9c17-fa1091b0844d tempest-VolumesActionsTest-799589769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:36:57 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-916320e3-2b97-4d1f-9c17-fa1091b0844d tempest-VolumesActionsTest-799589769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:36:57 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-916320e3-2b97-4d1f-9c17-fa1091b0844d tempest-VolumesActionsTest-799589769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:36:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-916320e3-2b97-4d1f-9c17-fa1091b0844d tempest-VolumesActionsTest-799589769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:36:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-916320e3-2b97-4d1f-9c17-fa1091b0844d tempest-VolumesActionsTest-799589769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:57 devstack sudo[104970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:36:57 devstack sudo[104970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:57 devstack sudo[104967]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-91091cbe-43c2-4d38-b295-a887924a15fe tempest-AttachVolumeTestJSON-1111501152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-57d7e545-00fc-40df-a244-1c6bc8a1e607" returned: 0 in 0.922s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-91091cbe-43c2-4d38-b295-a887924a15fe tempest-AttachVolumeTestJSON-1111501152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-57d7e545-00fc-40df-a244-1c6bc8a1e607 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:58 devstack sudo[104976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-57d7e545-00fc-40df-a244-1c6bc8a1e607 Jun 23 16:36:58 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:58 devstack sudo[104970]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-916320e3-2b97-4d1f-9c17-fa1091b0844d tempest-VolumesActionsTest-799589769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.794s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:58 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-916320e3-2b97-4d1f-9c17-fa1091b0844d tempest-VolumesActionsTest-799589769 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:36:58 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-916320e3-2b97-4d1f-9c17-fa1091b0844d tempest-VolumesActionsTest-799589769 None] Deleted volume successfully. Jun 23 16:36:58 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-916320e3-2b97-4d1f-9c17-fa1091b0844d tempest-VolumesActionsTest-799589769 None] Lock "cinder-23829dc9-be18-4a7e-823e-cc1610a937f0-delete_volume" released by "delete_volume" :: held 3.466s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:36:58 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-91091cbe-43c2-4d38-b295-a887924a15fe tempest-AttachVolumeTestJSON-1111501152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-57d7e545-00fc-40df-a244-1c6bc8a1e607" returned: 0 in 0.729s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:58 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-91091cbe-43c2-4d38-b295-a887924a15fe tempest-AttachVolumeTestJSON-1111501152 None] Lock "cinder-quobyte-57d7e545-00fc-40df-a244-1c6bc8a1e607" released by "delete_volume" :: held 1.707s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:36:58 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-91091cbe-43c2-4d38-b295-a887924a15fe tempest-AttachVolumeTestJSON-1111501152 None] Created reservations ['6884309b-7255-4f83-ad04-db6d212ff046', '12cc70b0-102f-4f81-b149-a9494c857327', '4255b29b-0c17-4cd1-8f03-dde7a1753060', '2722fde1-5ca6-4dd9-b9fa-f5330918677a'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:36:58 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a81b479-8df5-4332-9c0a-c8332c48ffa0 tempest-VolumesActionsTest-1113820978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:36:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5a81b479-8df5-4332-9c0a-c8332c48ffa0 tempest-VolumesActionsTest-1113820978 None] Flow 'volume_create_manager' (ae9bafe4-9ae7-4539-a235-fe87c0662778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:36:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5a81b479-8df5-4332-9c0a-c8332c48ffa0 tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aac4034-3ae3-4949-a8c5-dc8fde383379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:36:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5a81b479-8df5-4332-9c0a-c8332c48ffa0 tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aac4034-3ae3-4949-a8c5-dc8fde383379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-415063215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffa1695e-c6cc-42d6-bdd2-2ae013e4195d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfc07113077b492c8ba668960a6f4dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:36:59Z,use_quota=True,user_id='8bf540cfe6304942beeb4e6870a7f49d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:36:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5a81b479-8df5-4332-9c0a-c8332c48ffa0 tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b260759-f3da-4b91-9b5e-504c7ab4dc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:36:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5a81b479-8df5-4332-9c0a-c8332c48ffa0 tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b260759-f3da-4b91-9b5e-504c7ab4dc4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:36:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5a81b479-8df5-4332-9c0a-c8332c48ffa0 tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90d8eca3-472b-4209-86ae-038ea73565ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:36:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5a81b479-8df5-4332-9c0a-c8332c48ffa0 tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90d8eca3-472b-4209-86ae-038ea73565ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffa1695e-c6cc-42d6-bdd2-2ae013e4195d', 'volume_name': 'volume-ffa1695e-c6cc-42d6-bdd2-2ae013e4195d', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:36:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5a81b479-8df5-4332-9c0a-c8332c48ffa0 tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a182d12-c7b1-40a7-9d84-883e68df7d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:36:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5a81b479-8df5-4332-9c0a-c8332c48ffa0 tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a182d12-c7b1-40a7-9d84-883e68df7d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:36:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5a81b479-8df5-4332-9c0a-c8332c48ffa0 tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (683a8cbf-3c04-4462-807f-507e34b963c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:36:58 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-5a81b479-8df5-4332-9c0a-c8332c48ffa0 tempest-VolumesActionsTest-1113820978 None] Volume ffa1695e-c6cc-42d6-bdd2-2ae013e4195d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffa1695e-c6cc-42d6-bdd2-2ae013e4195d', 'volume_size': 1} Jun 23 16:36:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5a81b479-8df5-4332-9c0a-c8332c48ffa0 tempest-VolumesActionsTest-1113820978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:36:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5a81b479-8df5-4332-9c0a-c8332c48ffa0 tempest-VolumesActionsTest-1113820978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:36:58 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-5a81b479-8df5-4332-9c0a-c8332c48ffa0 tempest-VolumesActionsTest-1113820978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-415063215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffa1695e-c6cc-42d6-bdd2-2ae013e4195d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfc07113077b492c8ba668960a6f4dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:36:59Z,use_quota=True,user_id='8bf540cfe6304942beeb4e6870a7f49d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:36:58 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-5a81b479-8df5-4332-9c0a-c8332c48ffa0 tempest-VolumesActionsTest-1113820978 None] Creating volume ffa1695e-c6cc-42d6-bdd2-2ae013e4195d {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:36:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5a81b479-8df5-4332-9c0a-c8332c48ffa0 tempest-VolumesActionsTest-1113820978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:36:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5a81b479-8df5-4332-9c0a-c8332c48ffa0 tempest-VolumesActionsTest-1113820978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:36:58 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-5a81b479-8df5-4332-9c0a-c8332c48ffa0 tempest-VolumesActionsTest-1113820978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:36:58 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-5a81b479-8df5-4332-9c0a-c8332c48ffa0 tempest-VolumesActionsTest-1113820978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:36:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5a81b479-8df5-4332-9c0a-c8332c48ffa0 tempest-VolumesActionsTest-1113820978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:36:58 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-5a81b479-8df5-4332-9c0a-c8332c48ffa0 tempest-VolumesActionsTest-1113820978 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:36:58 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-5a81b479-8df5-4332-9c0a-c8332c48ffa0 tempest-VolumesActionsTest-1113820978 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:36:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5a81b479-8df5-4332-9c0a-c8332c48ffa0 tempest-VolumesActionsTest-1113820978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-ffa1695e-c6cc-42d6-bdd2-2ae013e4195d 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-91091cbe-43c2-4d38-b295-a887924a15fe tempest-AttachVolumeTestJSON-1111501152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:36:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-91091cbe-43c2-4d38-b295-a887924a15fe tempest-AttachVolumeTestJSON-1111501152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:36:58 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-91091cbe-43c2-4d38-b295-a887924a15fe tempest-AttachVolumeTestJSON-1111501152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:36:58 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-91091cbe-43c2-4d38-b295-a887924a15fe tempest-AttachVolumeTestJSON-1111501152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:36:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-91091cbe-43c2-4d38-b295-a887924a15fe tempest-AttachVolumeTestJSON-1111501152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:36:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-91091cbe-43c2-4d38-b295-a887924a15fe tempest-AttachVolumeTestJSON-1111501152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:58 devstack sudo[104981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-ffa1695e-c6cc-42d6-bdd2-2ae013e4195d 1073741824 Jun 23 16:36:58 devstack sudo[104981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:58 devstack sudo[104982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:36:58 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:59 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-83a6aec8-df2d-47ba-bcc6-fd00e3228ce7 tempest-AttachVolumeTestJSON-1111501152 None] Acquiring lock "cinder-15b3b4e5-2b5e-4084-b713-0851e5ed4541-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:36:59 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-83a6aec8-df2d-47ba-bcc6-fd00e3228ce7 tempest-AttachVolumeTestJSON-1111501152 None] Lock "cinder-15b3b4e5-2b5e-4084-b713-0851e5ed4541-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:36:59 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-83a6aec8-df2d-47ba-bcc6-fd00e3228ce7 tempest-AttachVolumeTestJSON-1111501152 None] Acquiring lock "cinder-quobyte-15b3b4e5-2b5e-4084-b713-0851e5ed4541" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:36:59 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-83a6aec8-df2d-47ba-bcc6-fd00e3228ce7 tempest-AttachVolumeTestJSON-1111501152 None] Lock "cinder-quobyte-15b3b4e5-2b5e-4084-b713-0851e5ed4541" acquired by "delete_volume" :: waited 0.034s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:36:59 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6cf36fb-8487-4641-bf06-7cb2774e1c47]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:36:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-83a6aec8-df2d-47ba-bcc6-fd00e3228ce7 tempest-AttachVolumeTestJSON-1111501152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-15b3b4e5-2b5e-4084-b713-0851e5ed4541 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:36:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:36:59 devstack sudo[104985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-15b3b4e5-2b5e-4084-b713-0851e5ed4541 Jun 23 16:36:59 devstack sudo[104985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:36:59 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root Jun 23 16:36:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-91091cbe-43c2-4d38-b295-a887924a15fe tempest-AttachVolumeTestJSON-1111501152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.832s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:36:59 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-91091cbe-43c2-4d38-b295-a887924a15fe tempest-AttachVolumeTestJSON-1111501152 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:36:59 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-91091cbe-43c2-4d38-b295-a887924a15fe tempest-AttachVolumeTestJSON-1111501152 None] Deleted volume successfully. Jun 23 16:36:59 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-91091cbe-43c2-4d38-b295-a887924a15fe tempest-AttachVolumeTestJSON-1111501152 None] Lock "cinder-57d7e545-00fc-40df-a244-1c6bc8a1e607-delete_volume" released by "delete_volume" :: held 2.910s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:37:00 devstack sudo[104981]: pam_unix(sudo:session): session closed for user root Jun 23 16:37:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5a81b479-8df5-4332-9c0a-c8332c48ffa0 tempest-VolumesActionsTest-1113820978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-ffa1695e-c6cc-42d6-bdd2-2ae013e4195d 1073741824" returned: 0 in 1.244s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:37:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5a81b479-8df5-4332-9c0a-c8332c48ffa0 tempest-VolumesActionsTest-1113820978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-ffa1695e-c6cc-42d6-bdd2-2ae013e4195d {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:37:00 devstack sudo[104992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-ffa1695e-c6cc-42d6-bdd2-2ae013e4195d Jun 23 16:37:00 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:37:00 devstack sudo[104985]: pam_unix(sudo:session): session closed for user root Jun 23 16:37:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-83a6aec8-df2d-47ba-bcc6-fd00e3228ce7 tempest-AttachVolumeTestJSON-1111501152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-15b3b4e5-2b5e-4084-b713-0851e5ed4541" returned: 0 in 0.949s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:37:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-83a6aec8-df2d-47ba-bcc6-fd00e3228ce7 tempest-AttachVolumeTestJSON-1111501152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-15b3b4e5-2b5e-4084-b713-0851e5ed4541 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:37:00 devstack sudo[104997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-15b3b4e5-2b5e-4084-b713-0851e5ed4541 Jun 23 16:37:00 devstack sudo[104997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:37:00 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root Jun 23 16:37:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5a81b479-8df5-4332-9c0a-c8332c48ffa0 tempest-VolumesActionsTest-1113820978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-ffa1695e-c6cc-42d6-bdd2-2ae013e4195d" returned: 0 in 0.730s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:37:00 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-5a81b479-8df5-4332-9c0a-c8332c48ffa0 tempest-VolumesActionsTest-1113820978 None] <== create_volume: return (2020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:37:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5a81b479-8df5-4332-9c0a-c8332c48ffa0 tempest-VolumesActionsTest-1113820978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.023s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:37:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.321s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:37:00 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] Cloning volume e3458e37-6a31-4755-a68e-8b181dcbe59d to volume 9c9d4aa2-c8b5-40ea-861a-c8980ce77e41 Jun 23 16:37:00 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5a81b479-8df5-4332-9c0a-c8332c48ffa0 tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (683a8cbf-3c04-4462-807f-507e34b963c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffa1695e-c6cc-42d6-bdd2-2ae013e4195d', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:37:00 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5a81b479-8df5-4332-9c0a-c8332c48ffa0 tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b47331ff-79ad-457b-9dd2-3457af5dd254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:37:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] Creating offline snapshot 8e28087e-7e26-4e18-94ae-064d3d4aeaa7 of volume e3458e37-6a31-4755-a68e-8b181dcbe59d {{(pid=93788) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:37:01 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-5a81b479-8df5-4332-9c0a-c8332c48ffa0 tempest-VolumesActionsTest-1113820978 None] Volume volume-ffa1695e-c6cc-42d6-bdd2-2ae013e4195d (ffa1695e-c6cc-42d6-bdd2-2ae013e4195d): created successfully Jun 23 16:37:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5a81b479-8df5-4332-9c0a-c8332c48ffa0 tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b47331ff-79ad-457b-9dd2-3457af5dd254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:37:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5a81b479-8df5-4332-9c0a-c8332c48ffa0 tempest-VolumesActionsTest-1113820978 None] Flow 'volume_create_manager' (ae9bafe4-9ae7-4539-a235-fe87c0662778) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:37:01 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2b26a7-6c1e-4df7-ba89-e92217a81dae]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:37:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:37:01 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-5a81b479-8df5-4332-9c0a-c8332c48ffa0 tempest-VolumesActionsTest-1113820978 None] Created volume successfully. Jun 23 16:37:01 devstack sudo[105000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d Jun 23 16:37:01 devstack sudo[105000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:37:01 devstack sudo[104997]: pam_unix(sudo:session): session closed for user root Jun 23 16:37:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-83a6aec8-df2d-47ba-bcc6-fd00e3228ce7 tempest-AttachVolumeTestJSON-1111501152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-15b3b4e5-2b5e-4084-b713-0851e5ed4541" returned: 0 in 0.745s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:37:01 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-83a6aec8-df2d-47ba-bcc6-fd00e3228ce7 tempest-AttachVolumeTestJSON-1111501152 None] Lock "cinder-quobyte-15b3b4e5-2b5e-4084-b713-0851e5ed4541" released by "delete_volume" :: held 1.776s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:37:01 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-83a6aec8-df2d-47ba-bcc6-fd00e3228ce7 tempest-AttachVolumeTestJSON-1111501152 None] Created reservations ['10b5958c-c305-450c-a00b-e0a2635bff58', '95ad9a4a-fc1a-4b20-a2b2-627f5c4c6fc1', 'c52787af-b07c-4a92-8033-67f49ffe935e', '3c539c2d-6d5d-4013-9723-23307b07f740'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:37:01 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:37:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:37:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:37:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:37:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:37:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:37:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:37:01 devstack sudo[105003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:37:01 devstack sudo[105003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:37:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-83a6aec8-df2d-47ba-bcc6-fd00e3228ce7 tempest-AttachVolumeTestJSON-1111501152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:37:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-83a6aec8-df2d-47ba-bcc6-fd00e3228ce7 tempest-AttachVolumeTestJSON-1111501152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:37:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-83a6aec8-df2d-47ba-bcc6-fd00e3228ce7 tempest-AttachVolumeTestJSON-1111501152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:37:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-83a6aec8-df2d-47ba-bcc6-fd00e3228ce7 tempest-AttachVolumeTestJSON-1111501152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:37:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-83a6aec8-df2d-47ba-bcc6-fd00e3228ce7 tempest-AttachVolumeTestJSON-1111501152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:37:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-83a6aec8-df2d-47ba-bcc6-fd00e3228ce7 tempest-AttachVolumeTestJSON-1111501152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:37:01 devstack sudo[105005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:37:01 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:37:02 devstack sudo[105000]: pam_unix(sudo:session): session closed for user root Jun 23 16:37:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d" returned: 0 in 1.028s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:37:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d.8e28087e-7e26-4e18-94ae-064d3d4aeaa7 1G {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:37:02 devstack sudo[105011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d.8e28087e-7e26-4e18-94ae-064d3d4aeaa7 1G Jun 23 16:37:02 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:37:02 devstack sudo[105003]: pam_unix(sudo:session): session closed for user root Jun 23 16:37:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.931s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:37:02 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:37:02 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager._thread_info {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:37:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread count: 8 {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 16:37:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread info: [<_MainThread(MainThread, started 126303828988032)>, , , , , , , ] {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 16:37:02 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-21543398-59eb-41aa-a61b-953e059aacc1 tempest-VolumesActionsTest-799589769 None] Acquiring lock "cinder-ffa1695e-c6cc-42d6-bdd2-2ae013e4195d-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:37:02 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-21543398-59eb-41aa-a61b-953e059aacc1 tempest-VolumesActionsTest-799589769 None] Lock "cinder-ffa1695e-c6cc-42d6-bdd2-2ae013e4195d-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:37:02 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root Jun 23 16:37:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-83a6aec8-df2d-47ba-bcc6-fd00e3228ce7 tempest-AttachVolumeTestJSON-1111501152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.962s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:37:02 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-83a6aec8-df2d-47ba-bcc6-fd00e3228ce7 tempest-AttachVolumeTestJSON-1111501152 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:37:02 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-83a6aec8-df2d-47ba-bcc6-fd00e3228ce7 tempest-AttachVolumeTestJSON-1111501152 None] Deleted volume successfully. Jun 23 16:37:02 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-83a6aec8-df2d-47ba-bcc6-fd00e3228ce7 tempest-AttachVolumeTestJSON-1111501152 None] Lock "cinder-15b3b4e5-2b5e-4084-b713-0851e5ed4541-delete_volume" released by "delete_volume" :: held 3.113s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:37:02 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-21543398-59eb-41aa-a61b-953e059aacc1 tempest-VolumesActionsTest-799589769 None] Acquiring lock "cinder-quobyte-ffa1695e-c6cc-42d6-bdd2-2ae013e4195d" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:37:02 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-21543398-59eb-41aa-a61b-953e059aacc1 tempest-VolumesActionsTest-799589769 None] Lock "cinder-quobyte-ffa1695e-c6cc-42d6-bdd2-2ae013e4195d" acquired by "delete_volume" :: waited 0.020s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:37:02 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad0f124-d432-450f-8823-e1cb39b46f67]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:37:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-21543398-59eb-41aa-a61b-953e059aacc1 tempest-VolumesActionsTest-799589769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-ffa1695e-c6cc-42d6-bdd2-2ae013e4195d {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:37:02 devstack sudo[105014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-ffa1695e-c6cc-42d6-bdd2-2ae013e4195d Jun 23 16:37:02 devstack sudo[105014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:37:03 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root Jun 23 16:37:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d.8e28087e-7e26-4e18-94ae-064d3d4aeaa7 1G" returned: 0 in 1.380s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:37:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3458e37-6a31-4755-a68e-8b181dcbe59d -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d.8e28087e-7e26-4e18-94ae-064d3d4aeaa7 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:37:03 devstack sudo[105023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3458e37-6a31-4755-a68e-8b181dcbe59d -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d.8e28087e-7e26-4e18-94ae-064d3d4aeaa7 Jun 23 16:37:03 devstack sudo[105023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:37:03 devstack sudo[105014]: pam_unix(sudo:session): session closed for user root Jun 23 16:37:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-21543398-59eb-41aa-a61b-953e059aacc1 tempest-VolumesActionsTest-799589769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-ffa1695e-c6cc-42d6-bdd2-2ae013e4195d" returned: 0 in 1.050s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:37:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-21543398-59eb-41aa-a61b-953e059aacc1 tempest-VolumesActionsTest-799589769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-ffa1695e-c6cc-42d6-bdd2-2ae013e4195d {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:37:03 devstack sudo[105025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-ffa1695e-c6cc-42d6-bdd2-2ae013e4195d Jun 23 16:37:03 devstack sudo[105025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:37:04 devstack sudo[105023]: pam_unix(sudo:session): session closed for user root Jun 23 16:37:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3458e37-6a31-4755-a68e-8b181dcbe59d -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d.8e28087e-7e26-4e18-94ae-064d3d4aeaa7" returned: 0 in 0.929s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:37:04 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d.8e28087e-7e26-4e18-94ae-064d3d4aeaa7 is being set with open permissions: ugo+rw: NotImplementedError Jun 23 16:37:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d.8e28087e-7e26-4e18-94ae-064d3d4aeaa7 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:37:04 devstack sudo[105032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d.8e28087e-7e26-4e18-94ae-064d3d4aeaa7 Jun 23 16:37:04 devstack sudo[105032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:37:04 devstack sudo[105025]: pam_unix(sudo:session): session closed for user root Jun 23 16:37:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-21543398-59eb-41aa-a61b-953e059aacc1 tempest-VolumesActionsTest-799589769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-ffa1695e-c6cc-42d6-bdd2-2ae013e4195d" returned: 0 in 0.861s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:37:04 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-21543398-59eb-41aa-a61b-953e059aacc1 tempest-VolumesActionsTest-799589769 None] Lock "cinder-quobyte-ffa1695e-c6cc-42d6-bdd2-2ae013e4195d" released by "delete_volume" :: held 2.006s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:37:04 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-21543398-59eb-41aa-a61b-953e059aacc1 tempest-VolumesActionsTest-799589769 None] Created reservations ['1a772700-060c-46f7-ba64-21ef1d121365', '60b17795-96a1-4533-8a91-82fbe5714c2b', '2c8a84f5-62dc-42ca-bc9e-9a5c2433e72d', '2d25c553-2a8c-46e7-b0f0-5889ea6f3edf'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:37:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-21543398-59eb-41aa-a61b-953e059aacc1 tempest-VolumesActionsTest-799589769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:37:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-21543398-59eb-41aa-a61b-953e059aacc1 tempest-VolumesActionsTest-799589769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:37:04 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-21543398-59eb-41aa-a61b-953e059aacc1 tempest-VolumesActionsTest-799589769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:37:04 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-21543398-59eb-41aa-a61b-953e059aacc1 tempest-VolumesActionsTest-799589769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:37:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-21543398-59eb-41aa-a61b-953e059aacc1 tempest-VolumesActionsTest-799589769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:37:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-21543398-59eb-41aa-a61b-953e059aacc1 tempest-VolumesActionsTest-799589769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:37:04 devstack sudo[105034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:37:04 devstack sudo[105034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:37:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-dec08557-067c-4c8f-8827-dfe1af26ed3f tempest-VolumesActionsTest-1224009287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:37:05 devstack sudo[105032]: pam_unix(sudo:session): session closed for user root Jun 23 16:37:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d.8e28087e-7e26-4e18-94ae-064d3d4aeaa7" returned: 0 in 0.882s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:37:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:37:05 devstack sudo[105037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d.info Jun 23 16:37:05 devstack sudo[105037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:37:05 devstack sudo[105034]: pam_unix(sudo:session): session closed for user root Jun 23 16:37:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-21543398-59eb-41aa-a61b-953e059aacc1 tempest-VolumesActionsTest-799589769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.890s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:37:05 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-21543398-59eb-41aa-a61b-953e059aacc1 tempest-VolumesActionsTest-799589769 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:37:05 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-21543398-59eb-41aa-a61b-953e059aacc1 tempest-VolumesActionsTest-799589769 None] Deleted volume successfully. Jun 23 16:37:05 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-21543398-59eb-41aa-a61b-953e059aacc1 tempest-VolumesActionsTest-799589769 None] Lock "cinder-ffa1695e-c6cc-42d6-bdd2-2ae013e4195d-delete_volume" released by "delete_volume" :: held 3.275s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:37:06 devstack sudo[105037]: pam_unix(sudo:session): session closed for user root Jun 23 16:37:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d.info" returned: 0 in 0.889s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:37:06 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d.info is being set with open permissions: ugo+rw: NotImplementedError Jun 23 16:37:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:37:06 devstack sudo[105041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d.info Jun 23 16:37:06 devstack sudo[105041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:37:06 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8d262bf-044d-412b-a1a1-4a74d61cb938 tempest-VolumesActionsTest-1113820978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:37:06 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b8d262bf-044d-412b-a1a1-4a74d61cb938 tempest-VolumesActionsTest-1113820978 None] Flow 'volume_create_manager' (d1f1eebf-a674-4637-9887-cffe2c976808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:37:06 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b8d262bf-044d-412b-a1a1-4a74d61cb938 tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ded7750-ac5d-4e89-ab34-9bee21d479b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:37:06 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b8d262bf-044d-412b-a1a1-4a74d61cb938 tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ded7750-ac5d-4e89-ab34-9bee21d479b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1533423097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=254dff89-a893-4f49-a025-643ef51dde0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfc07113077b492c8ba668960a6f4dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:37:06Z,use_quota=True,user_id='8bf540cfe6304942beeb4e6870a7f49d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:37:06 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b8d262bf-044d-412b-a1a1-4a74d61cb938 tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07b48e84-da75-473c-acfb-f0dc6f0fb04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:37:06 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b8d262bf-044d-412b-a1a1-4a74d61cb938 tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07b48e84-da75-473c-acfb-f0dc6f0fb04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:37:06 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b8d262bf-044d-412b-a1a1-4a74d61cb938 tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57cdac04-57c0-4a2b-8f7b-57165feb6d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:37:06 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b8d262bf-044d-412b-a1a1-4a74d61cb938 tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57cdac04-57c0-4a2b-8f7b-57165feb6d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '254dff89-a893-4f49-a025-643ef51dde0b', 'volume_name': 'volume-254dff89-a893-4f49-a025-643ef51dde0b', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:37:06 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b8d262bf-044d-412b-a1a1-4a74d61cb938 tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ba97ced-9e3c-4637-b31b-2772c5b933f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:37:06 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b8d262bf-044d-412b-a1a1-4a74d61cb938 tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ba97ced-9e3c-4637-b31b-2772c5b933f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:37:06 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b8d262bf-044d-412b-a1a1-4a74d61cb938 tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0f7fdfa-54f0-491c-a2bf-6cb68935d4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:37:06 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-b8d262bf-044d-412b-a1a1-4a74d61cb938 tempest-VolumesActionsTest-1113820978 None] Volume 254dff89-a893-4f49-a025-643ef51dde0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-254dff89-a893-4f49-a025-643ef51dde0b', 'volume_size': 1} Jun 23 16:37:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b8d262bf-044d-412b-a1a1-4a74d61cb938 tempest-VolumesActionsTest-1113820978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:37:06 devstack sudo[105041]: pam_unix(sudo:session): session closed for user root Jun 23 16:37:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d.info" returned: 0 in 0.759s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:37:06 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] Acquiring lock "cinder-quobyte-9c9d4aa2-c8b5-40ea-861a-c8980ce77e41" by "_copy_volume_from_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:37:06 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] Lock "cinder-quobyte-9c9d4aa2-c8b5-40ea-861a-c8980ce77e41" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:37:06 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] snapshot: 8e28087e-7e26-4e18-94ae-064d3d4aeaa7, volume: 9c9d4aa2-c8b5-40ea-861a-c8980ce77e41, {{(pid=93788) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 16:37:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:37:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:37:07 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:37:07 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:37:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:37:07 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[7961b02f-5cf3-477e-ad6d-b0eb3eeebe5f]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:37:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d.8e28087e-7e26-4e18-94ae-064d3d4aeaa7 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:37:07 devstack sudo[105045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d.8e28087e-7e26-4e18-94ae-064d3d4aeaa7 Jun 23 16:37:07 devstack sudo[105045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:37:07 devstack sudo[105045]: pam_unix(sudo:session): session closed for user root Jun 23 16:37:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d.8e28087e-7e26-4e18-94ae-064d3d4aeaa7" returned: 0 in 0.812s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:37:07 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3458e37-6a31-4755-a68e-8b181dcbe59d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:37:07 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d {{(pid=93788) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 16:37:07 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] Creating direct copy from snapshot {{(pid=93788) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 16:37:07 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a61aba1-ca90-42e0-8f5b-bbd893829717]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:37:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:37:07 devstack sudo[105050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d Jun 23 16:37:07 devstack sudo[105050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:37:08 devstack sudo[105050]: pam_unix(sudo:session): session closed for user root Jun 23 16:37:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d" returned: 0 in 0.794s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:37:08 devstack cinder-volume[93788]: DEBUG cinder.utils [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] Path /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c9d4aa2-c8b5-40ea-861a-c8980ce77e41 not found in is_blk_device check {{(pid=93788) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 16:37:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c9d4aa2-c8b5-40ea-861a-c8980ce77e41 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:37:08 devstack sudo[105056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c9d4aa2-c8b5-40ea-861a-c8980ce77e41 Jun 23 16:37:08 devstack sudo[105056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:37:10 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [req-5d7fbadc-cec9-4058-9945-c7508841b7b6 req-4e9ddd52-336f-4f19-8034-5ed73d3327c0 tempest-VolumesSnapshotsTestJSON-1321212680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:37:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-5d7fbadc-cec9-4058-9945-c7508841b7b6 req-4e9ddd52-336f-4f19-8034-5ed73d3327c0 tempest-VolumesSnapshotsTestJSON-1321212680 None] Flow 'volume_create_manager' (93244510-4a11-4a38-abc0-f893fe0f274b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:37:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-5d7fbadc-cec9-4058-9945-c7508841b7b6 req-4e9ddd52-336f-4f19-8034-5ed73d3327c0 tempest-VolumesSnapshotsTestJSON-1321212680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bed925c-55e8-4414-bd34-b4864b1922c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:37:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-5d7fbadc-cec9-4058-9945-c7508841b7b6 req-4e9ddd52-336f-4f19-8034-5ed73d3327c0 tempest-VolumesSnapshotsTestJSON-1321212680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bed925c-55e8-4414-bd34-b4864b1922c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:37:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1774416479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bcf134c-8fd7-40cf-b79f-6eb167ca09cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='808da28f47ba4fd993c144dead9603ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:37:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:37:11Z,use_quota=True,user_id='6a2a0421e3d2463594eb77b82bb67703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:37:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-5d7fbadc-cec9-4058-9945-c7508841b7b6 req-4e9ddd52-336f-4f19-8034-5ed73d3327c0 tempest-VolumesSnapshotsTestJSON-1321212680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6695f113-4589-4055-9527-ce11153a8ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:37:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-5d7fbadc-cec9-4058-9945-c7508841b7b6 req-4e9ddd52-336f-4f19-8034-5ed73d3327c0 tempest-VolumesSnapshotsTestJSON-1321212680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6695f113-4589-4055-9527-ce11153a8ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:37:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-5d7fbadc-cec9-4058-9945-c7508841b7b6 req-4e9ddd52-336f-4f19-8034-5ed73d3327c0 tempest-VolumesSnapshotsTestJSON-1321212680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c77306e5-27c0-4155-97a9-a786a04726fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:37:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-5d7fbadc-cec9-4058-9945-c7508841b7b6 req-4e9ddd52-336f-4f19-8034-5ed73d3327c0 tempest-VolumesSnapshotsTestJSON-1321212680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c77306e5-27c0-4155-97a9-a786a04726fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bcf134c-8fd7-40cf-b79f-6eb167ca09cf', 'volume_name': 'volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:37:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-5d7fbadc-cec9-4058-9945-c7508841b7b6 req-4e9ddd52-336f-4f19-8034-5ed73d3327c0 tempest-VolumesSnapshotsTestJSON-1321212680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (665e57db-ce5c-4faf-bfad-23daa25c119b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:37:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-5d7fbadc-cec9-4058-9945-c7508841b7b6 req-4e9ddd52-336f-4f19-8034-5ed73d3327c0 tempest-VolumesSnapshotsTestJSON-1321212680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (665e57db-ce5c-4faf-bfad-23daa25c119b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:37:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-5d7fbadc-cec9-4058-9945-c7508841b7b6 req-4e9ddd52-336f-4f19-8034-5ed73d3327c0 tempest-VolumesSnapshotsTestJSON-1321212680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (513190f8-b762-48be-aaaf-47e3c0bab5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:37:10 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [req-5d7fbadc-cec9-4058-9945-c7508841b7b6 req-4e9ddd52-336f-4f19-8034-5ed73d3327c0 tempest-VolumesSnapshotsTestJSON-1321212680 None] Volume 9bcf134c-8fd7-40cf-b79f-6eb167ca09cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf', 'volume_size': 1} Jun 23 16:37:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-5d7fbadc-cec9-4058-9945-c7508841b7b6 req-4e9ddd52-336f-4f19-8034-5ed73d3327c0 tempest-VolumesSnapshotsTestJSON-1321212680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:37:13 devstack sudo[105056]: pam_unix(sudo:session): session closed for user root Jun 23 16:37:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c9d4aa2-c8b5-40ea-861a-c8980ce77e41" returned: 0 in 5.271s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:37:13 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[799f121a-2dbc-4f2a-92bb-dc24294b7942]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:37:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:37:14 devstack sudo[105069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d Jun 23 16:37:14 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:37:14 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root Jun 23 16:37:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d" returned: 0 in 0.891s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:37:14 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] Image conversion details: src /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d, size 1024.00 MB, duration 5.27 sec, destination /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c9d4aa2-c8b5-40ea-861a-c8980ce77e41 {{(pid=93788) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 16:37:14 devstack cinder-volume[93788]: INFO cinder.image.image_utils [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] Converted 1024.00 MB image at 194.19 MB/s Jun 23 16:37:14 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c9d4aa2-c8b5-40ea-861a-c8980ce77e41 is being set with open permissions: ugo+rw: NotImplementedError Jun 23 16:37:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c9d4aa2-c8b5-40ea-861a-c8980ce77e41 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:37:14 devstack sudo[105076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c9d4aa2-c8b5-40ea-861a-c8980ce77e41 Jun 23 16:37:14 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:37:15 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root Jun 23 16:37:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c9d4aa2-c8b5-40ea-861a-c8980ce77e41" returned: 0 in 0.627s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:37:15 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] Lock "cinder-quobyte-9c9d4aa2-c8b5-40ea-861a-c8980ce77e41" released by "_copy_volume_from_snapshot" :: held 8.481s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:37:15 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] Acquiring lock "cinder-quobyte-8e28087e-7e26-4e18-94ae-064d3d4aeaa7" by "_delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:37:15 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] Lock "cinder-quobyte-8e28087e-7e26-4e18-94ae-064d3d4aeaa7" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:37:15 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] Deleting offline snapshot 8e28087e-7e26-4e18-94ae-064d3d4aeaa7 of volume e3458e37-6a31-4755-a68e-8b181dcbe59d {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:37:15 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] snapshot_file for this snap is: volume-e3458e37-6a31-4755-a68e-8b181dcbe59d.8e28087e-7e26-4e18-94ae-064d3d4aeaa7 {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:37:15 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4302c7-c23f-455f-9364-326d82948696]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:37:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d.8e28087e-7e26-4e18-94ae-064d3d4aeaa7 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:37:15 devstack sudo[105079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d.8e28087e-7e26-4e18-94ae-064d3d4aeaa7 Jun 23 16:37:15 devstack sudo[105079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:37:16 devstack sudo[105079]: pam_unix(sudo:session): session closed for user root Jun 23 16:37:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d.8e28087e-7e26-4e18-94ae-064d3d4aeaa7" returned: 0 in 0.760s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:37:16 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3458e37-6a31-4755-a68e-8b181dcbe59d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:37:16 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59078df-7b43-46f3-b58b-0573c3392f1c]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:37:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:37:16 devstack sudo[105084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d Jun 23 16:37:16 devstack sudo[105084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:37:17 devstack sudo[105084]: pam_unix(sudo:session): session closed for user root Jun 23 16:37:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d" returned: 0 in 0.738s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:37:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d.8e28087e-7e26-4e18-94ae-064d3d4aeaa7 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:37:17 devstack sudo[105089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d.8e28087e-7e26-4e18-94ae-064d3d4aeaa7 Jun 23 16:37:17 devstack sudo[105089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:37:17 devstack sudo[105089]: pam_unix(sudo:session): session closed for user root Jun 23 16:37:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d.8e28087e-7e26-4e18-94ae-064d3d4aeaa7" returned: 0 in 0.729s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:37:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d.8e28087e-7e26-4e18-94ae-064d3d4aeaa7 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:37:17 devstack sudo[105094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d.8e28087e-7e26-4e18-94ae-064d3d4aeaa7 Jun 23 16:37:17 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:37:18 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root Jun 23 16:37:18 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d.8e28087e-7e26-4e18-94ae-064d3d4aeaa7" returned: 0 in 0.639s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:37:18 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] Lock "cinder-quobyte-8e28087e-7e26-4e18-94ae-064d3d4aeaa7" released by "_delete_snapshot" :: held 2.958s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:37:18 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.527s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:37:18 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-dec08557-067c-4c8f-8827-dfe1af26ed3f tempest-VolumesActionsTest-1224009287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 13.260s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:37:18 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[558ce4e3-4b1c-40d1-9c91-097ec15c44b3]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:37:18 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-dec08557-067c-4c8f-8827-dfe1af26ed3f tempest-VolumesActionsTest-1224009287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3434346-f7a9-4aaa-8210-6e8c244d1a95 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:37:18 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-86230086-43ad-4d7a-b98a-6e8b6f0d35a7 tempest-GroupsV314Test-863839659 None] Create group from source-group-872ea573-3705-4e86-a85d-bea6303959b5 completed successfully. Jun 23 16:37:18 devstack sudo[105097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3434346-f7a9-4aaa-8210-6e8c244d1a95 Jun 23 16:37:18 devstack sudo[105097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:37:19 devstack sudo[105097]: pam_unix(sudo:session): session closed for user root Jun 23 16:37:19 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-dec08557-067c-4c8f-8827-dfe1af26ed3f tempest-VolumesActionsTest-1224009287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3434346-f7a9-4aaa-8210-6e8c244d1a95" returned: 0 in 0.787s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:37:19 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[502bd396-67b3-4c96-8ea3-55403f482564]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:37:19 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-dec08557-067c-4c8f-8827-dfe1af26ed3f tempest-VolumesActionsTest-1224009287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3434346-f7a9-4aaa-8210-6e8c244d1a95 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:37:19 devstack sudo[105103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3434346-f7a9-4aaa-8210-6e8c244d1a95 Jun 23 16:37:19 devstack sudo[105103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:37:19 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-32a94f01-a3c8-45f2-bcf6-6a57a269b1fe tempest-GroupsV314Test-863839659 None] Acquiring lock "cinder-quobyte-9c9d4aa2-c8b5-40ea-861a-c8980ce77e41" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:37:19 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-32a94f01-a3c8-45f2-bcf6-6a57a269b1fe tempest-GroupsV314Test-863839659 None] Lock "cinder-quobyte-9c9d4aa2-c8b5-40ea-861a-c8980ce77e41" acquired by "delete_volume" :: waited 0.023s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:37:19 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5b382a-3e4a-441f-80b8-f1b7160b260e]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:37:19 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-32a94f01-a3c8-45f2-bcf6-6a57a269b1fe tempest-GroupsV314Test-863839659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c9d4aa2-c8b5-40ea-861a-c8980ce77e41 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:37:19 devstack sudo[105105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c9d4aa2-c8b5-40ea-861a-c8980ce77e41 Jun 23 16:37:19 devstack sudo[105105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:37:20 devstack sudo[105103]: pam_unix(sudo:session): session closed for user root Jun 23 16:37:20 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-dec08557-067c-4c8f-8827-dfe1af26ed3f tempest-VolumesActionsTest-1224009287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3434346-f7a9-4aaa-8210-6e8c244d1a95" returned: 0 in 0.818s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:37:20 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-dec08557-067c-4c8f-8827-dfe1af26ed3f tempest-VolumesActionsTest-1224009287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3434346-f7a9-4aaa-8210-6e8c244d1a95 /opt/stack/data/cinder/conversion/e3434346-f7a9-4aaa-8210-6e8c244d1a95.temp_image.b240c224-5152-49b4-83fd-f406916405159_ol6ee9.img {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:37:20 devstack sudo[105110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3434346-f7a9-4aaa-8210-6e8c244d1a95 /opt/stack/data/cinder/conversion/e3434346-f7a9-4aaa-8210-6e8c244d1a95.temp_image.b240c224-5152-49b4-83fd-f406916405159_ol6ee9.img Jun 23 16:37:20 devstack sudo[105110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:37:20 devstack sudo[105105]: pam_unix(sudo:session): session closed for user root Jun 23 16:37:20 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-32a94f01-a3c8-45f2-bcf6-6a57a269b1fe tempest-GroupsV314Test-863839659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c9d4aa2-c8b5-40ea-861a-c8980ce77e41" returned: 0 in 0.794s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:37:20 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-32a94f01-a3c8-45f2-bcf6-6a57a269b1fe tempest-GroupsV314Test-863839659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c9d4aa2-c8b5-40ea-861a-c8980ce77e41 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:37:20 devstack sudo[105115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c9d4aa2-c8b5-40ea-861a-c8980ce77e41 Jun 23 16:37:20 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:37:21 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root Jun 23 16:37:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-32a94f01-a3c8-45f2-bcf6-6a57a269b1fe tempest-GroupsV314Test-863839659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c9d4aa2-c8b5-40ea-861a-c8980ce77e41" returned: 0 in 1.161s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:37:21 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-32a94f01-a3c8-45f2-bcf6-6a57a269b1fe tempest-GroupsV314Test-863839659 None] Lock "cinder-quobyte-9c9d4aa2-c8b5-40ea-861a-c8980ce77e41" released by "delete_volume" :: held 2.035s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:37:21 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-32a94f01-a3c8-45f2-bcf6-6a57a269b1fe tempest-GroupsV314Test-863839659 None] Created reservations ['bf832e4b-ab00-47cb-9617-50c0e0e53ae7'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:37:21 devstack cinder-volume[93788]: WARNING cinder.quota [None req-32a94f01-a3c8-45f2-bcf6-6a57a269b1fe tempest-GroupsV314Test-863839659 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-481588514 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-481588514, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:37:21 devstack cinder-volume[93788]: WARNING cinder.quota [None req-32a94f01-a3c8-45f2-bcf6-6a57a269b1fe tempest-GroupsV314Test-863839659 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-481588514 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-481588514, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:37:21 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-32a94f01-a3c8-45f2-bcf6-6a57a269b1fe tempest-GroupsV314Test-863839659 None] Created reservations ['bad32fa2-6b4c-4ed1-a21b-ee83ef4ae76c', '52db0ef4-bd58-41c2-a205-08b9e632acef', 'cc78e61e-2c49-41ae-904e-56ed69ee3f07', 'cfe151d7-f1b7-4b04-97e8-49061f1f634c'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:37:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-32a94f01-a3c8-45f2-bcf6-6a57a269b1fe tempest-GroupsV314Test-863839659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:37:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-32a94f01-a3c8-45f2-bcf6-6a57a269b1fe tempest-GroupsV314Test-863839659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:37:22 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-32a94f01-a3c8-45f2-bcf6-6a57a269b1fe tempest-GroupsV314Test-863839659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:37:22 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-32a94f01-a3c8-45f2-bcf6-6a57a269b1fe tempest-GroupsV314Test-863839659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:37:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-32a94f01-a3c8-45f2-bcf6-6a57a269b1fe tempest-GroupsV314Test-863839659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:37:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-32a94f01-a3c8-45f2-bcf6-6a57a269b1fe tempest-GroupsV314Test-863839659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:37:22 devstack sudo[105128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:37:22 devstack sudo[105128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:37:23 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5c549370-d9c3-46fb-b1e9-1556a1988321 tempest-GroupsV314Test-863839659 None] Acquiring lock "cinder-quobyte-e3458e37-6a31-4755-a68e-8b181dcbe59d" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:37:23 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5c549370-d9c3-46fb-b1e9-1556a1988321 tempest-GroupsV314Test-863839659 None] Lock "cinder-quobyte-e3458e37-6a31-4755-a68e-8b181dcbe59d" acquired by "delete_volume" :: waited 0.050s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:37:23 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ea9ca5-4337-4bf0-a252-cbb9af265d3f]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:37:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5c549370-d9c3-46fb-b1e9-1556a1988321 tempest-GroupsV314Test-863839659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:37:23 devstack sudo[105128]: pam_unix(sudo:session): session closed for user root Jun 23 16:37:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-32a94f01-a3c8-45f2-bcf6-6a57a269b1fe tempest-GroupsV314Test-863839659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.604s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:37:23 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-32a94f01-a3c8-45f2-bcf6-6a57a269b1fe tempest-GroupsV314Test-863839659 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:37:23 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-32a94f01-a3c8-45f2-bcf6-6a57a269b1fe tempest-GroupsV314Test-863839659 None] Delete group completed successfully. Jun 23 16:37:23 devstack sudo[105131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d Jun 23 16:37:23 devstack sudo[105131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:37:25 devstack sudo[105131]: pam_unix(sudo:session): session closed for user root Jun 23 16:37:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5c549370-d9c3-46fb-b1e9-1556a1988321 tempest-GroupsV314Test-863839659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d" returned: 0 in 1.726s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:37:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5c549370-d9c3-46fb-b1e9-1556a1988321 tempest-GroupsV314Test-863839659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:37:25 devstack sudo[105139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d Jun 23 16:37:25 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:37:25 devstack sudo[105110]: pam_unix(sudo:session): session closed for user root Jun 23 16:37:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-dec08557-067c-4c8f-8827-dfe1af26ed3f tempest-VolumesActionsTest-1224009287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3434346-f7a9-4aaa-8210-6e8c244d1a95 /opt/stack/data/cinder/conversion/e3434346-f7a9-4aaa-8210-6e8c244d1a95.temp_image.b240c224-5152-49b4-83fd-f406916405159_ol6ee9.img" returned: 0 in 5.419s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:37:25 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a042e23-ca3c-47e0-b2f1-4bd748c88c3e]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:37:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-dec08557-067c-4c8f-8827-dfe1af26ed3f tempest-VolumesActionsTest-1224009287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3434346-f7a9-4aaa-8210-6e8c244d1a95 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:37:25 devstack sudo[105141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3434346-f7a9-4aaa-8210-6e8c244d1a95 Jun 23 16:37:25 devstack sudo[105141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:37:25 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root Jun 23 16:37:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5c549370-d9c3-46fb-b1e9-1556a1988321 tempest-GroupsV314Test-863839659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3458e37-6a31-4755-a68e-8b181dcbe59d" returned: 0 in 0.818s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:37:26 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5c549370-d9c3-46fb-b1e9-1556a1988321 tempest-GroupsV314Test-863839659 None] Lock "cinder-quobyte-e3458e37-6a31-4755-a68e-8b181dcbe59d" released by "delete_volume" :: held 2.687s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:37:26 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-5c549370-d9c3-46fb-b1e9-1556a1988321 tempest-GroupsV314Test-863839659 None] Created reservations ['7ed027e9-37d4-4b42-be9f-b784320c7c3a'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:37:26 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-5c549370-d9c3-46fb-b1e9-1556a1988321 tempest-GroupsV314Test-863839659 None] Created reservations ['fa85ba78-f56f-49bc-80bb-53540944af08', 'e20b1c8f-6689-44f2-9b13-6a7d35089f39', 'aabc11ac-5b72-4296-be3b-a6c63a609cb8', '244d4b45-0576-4e61-a0ef-3b84a0f2c239'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:37:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5c549370-d9c3-46fb-b1e9-1556a1988321 tempest-GroupsV314Test-863839659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:37:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5c549370-d9c3-46fb-b1e9-1556a1988321 tempest-GroupsV314Test-863839659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:37:26 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-5c549370-d9c3-46fb-b1e9-1556a1988321 tempest-GroupsV314Test-863839659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:37:26 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-5c549370-d9c3-46fb-b1e9-1556a1988321 tempest-GroupsV314Test-863839659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:37:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5c549370-d9c3-46fb-b1e9-1556a1988321 tempest-GroupsV314Test-863839659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:37:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5c549370-d9c3-46fb-b1e9-1556a1988321 tempest-GroupsV314Test-863839659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:37:26 devstack sudo[105146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:37:26 devstack sudo[105146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:37:26 devstack sudo[105141]: pam_unix(sudo:session): session closed for user root Jun 23 16:37:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-dec08557-067c-4c8f-8827-dfe1af26ed3f tempest-VolumesActionsTest-1224009287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3434346-f7a9-4aaa-8210-6e8c244d1a95" returned: 0 in 0.968s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:37:26 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-dec08557-067c-4c8f-8827-dfe1af26ed3f tempest-VolumesActionsTest-1224009287 None] Image conversion details: src /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3434346-f7a9-4aaa-8210-6e8c244d1a95, size 1024.00 MB, duration 5.42 sec, destination /opt/stack/data/cinder/conversion/e3434346-f7a9-4aaa-8210-6e8c244d1a95.temp_image.b240c224-5152-49b4-83fd-f406916405159_ol6ee9.img {{(pid=93788) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 16:37:26 devstack cinder-volume[93788]: INFO cinder.image.image_utils [None req-dec08557-067c-4c8f-8827-dfe1af26ed3f tempest-VolumesActionsTest-1224009287 None] Converted 1024.00 MB image at 188.90 MB/s Jun 23 16:37:26 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-dec08557-067c-4c8f-8827-dfe1af26ed3f tempest-VolumesActionsTest-1224009287 None] b240c224-5152-49b4-83fd-f40691640515 was raw, no need to convert to raw {{(pid=93788) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jun 23 16:37:27 devstack sudo[105146]: pam_unix(sudo:session): session closed for user root Jun 23 16:37:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5c549370-d9c3-46fb-b1e9-1556a1988321 tempest-GroupsV314Test-863839659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.738s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:37:27 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-5c549370-d9c3-46fb-b1e9-1556a1988321 tempest-GroupsV314Test-863839659 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:37:27 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-5c549370-d9c3-46fb-b1e9-1556a1988321 tempest-GroupsV314Test-863839659 None] Delete group completed successfully. Jun 23 16:37:36 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:UPDATE=77,cinder:DELETE=4,cinder:SELECT=78,cinder:INSERT=20 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:37:36 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:SELECT=64,cinder:INSERT=21,cinder:UPDATE=98,cinder:DELETE=6 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:37:43 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1c1dff6-b9e2-4dbb-9aca-e0779e56b497 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:37:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d1c1dff6-b9e2-4dbb-9aca-e0779e56b497 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Flow 'volume_create_manager' (66c4257c-a6d6-45ce-a24b-442f274b397e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:37:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d1c1dff6-b9e2-4dbb-9aca-e0779e56b497 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e138566a-3f58-4b9b-a64b-b74a0ba8ad17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:37:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d1c1dff6-b9e2-4dbb-9aca-e0779e56b497 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e138566a-3f58-4b9b-a64b-b74a0ba8ad17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1853263230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=600252b0-7ee5-40b6-8d97-7305f062ade3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a459011b8004593b300ebb1ef6c06e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:37:43Z,use_quota=True,user_id='0285a72506514a0bb7c6d10e5fd62235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:37:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d1c1dff6-b9e2-4dbb-9aca-e0779e56b497 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (247a1cf2-12eb-4873-982a-702b03103662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:37:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d1c1dff6-b9e2-4dbb-9aca-e0779e56b497 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (247a1cf2-12eb-4873-982a-702b03103662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:37:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d1c1dff6-b9e2-4dbb-9aca-e0779e56b497 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0a896d5-3f9f-4211-860d-85754363b7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:37:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d1c1dff6-b9e2-4dbb-9aca-e0779e56b497 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0a896d5-3f9f-4211-860d-85754363b7ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '600252b0-7ee5-40b6-8d97-7305f062ade3', 'volume_name': 'volume-600252b0-7ee5-40b6-8d97-7305f062ade3', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:37:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d1c1dff6-b9e2-4dbb-9aca-e0779e56b497 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54d6b9c9-9c26-4b27-a212-c82b25c6bbb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:37:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d1c1dff6-b9e2-4dbb-9aca-e0779e56b497 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54d6b9c9-9c26-4b27-a212-c82b25c6bbb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:37:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d1c1dff6-b9e2-4dbb-9aca-e0779e56b497 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3930ef55-53fd-4a45-bf2f-6af494e75307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:37:43 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-d1c1dff6-b9e2-4dbb-9aca-e0779e56b497 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Volume 600252b0-7ee5-40b6-8d97-7305f062ade3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-600252b0-7ee5-40b6-8d97-7305f062ade3', 'volume_size': 1} Jun 23 16:37:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d1c1dff6-b9e2-4dbb-9aca-e0779e56b497 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:37:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-dec08557-067c-4c8f-8827-dfe1af26ed3f tempest-VolumesActionsTest-1224009287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.800s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:37:47 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-dec08557-067c-4c8f-8827-dfe1af26ed3f tempest-VolumesActionsTest-1224009287 None] Uploaded volume to glance image-id: b240c224-5152-49b4-83fd-f40691640515. {{(pid=93788) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 23 16:37:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b8d262bf-044d-412b-a1a1-4a74d61cb938 tempest-VolumesActionsTest-1113820978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 40.828s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:37:47 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b8d262bf-044d-412b-a1a1-4a74d61cb938 tempest-VolumesActionsTest-1113820978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1533423097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=254dff89-a893-4f49-a025-643ef51dde0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfc07113077b492c8ba668960a6f4dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:37:06Z,use_quota=True,user_id='8bf540cfe6304942beeb4e6870a7f49d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:37:47 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-b8d262bf-044d-412b-a1a1-4a74d61cb938 tempest-VolumesActionsTest-1113820978 None] Creating volume 254dff89-a893-4f49-a025-643ef51dde0b {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:37:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b8d262bf-044d-412b-a1a1-4a74d61cb938 tempest-VolumesActionsTest-1113820978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:37:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b8d262bf-044d-412b-a1a1-4a74d61cb938 tempest-VolumesActionsTest-1113820978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:37:47 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b8d262bf-044d-412b-a1a1-4a74d61cb938 tempest-VolumesActionsTest-1113820978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:37:47 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b8d262bf-044d-412b-a1a1-4a74d61cb938 tempest-VolumesActionsTest-1113820978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:37:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b8d262bf-044d-412b-a1a1-4a74d61cb938 tempest-VolumesActionsTest-1113820978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:37:47 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b8d262bf-044d-412b-a1a1-4a74d61cb938 tempest-VolumesActionsTest-1113820978 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:37:47 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-b8d262bf-044d-412b-a1a1-4a74d61cb938 tempest-VolumesActionsTest-1113820978 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:37:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b8d262bf-044d-412b-a1a1-4a74d61cb938 tempest-VolumesActionsTest-1113820978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-254dff89-a893-4f49-a025-643ef51dde0b 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:37:47 devstack sudo[105217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-254dff89-a893-4f49-a025-643ef51dde0b 1073741824 Jun 23 16:37:47 devstack sudo[105217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:37:47 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-dec08557-067c-4c8f-8827-dfe1af26ed3f tempest-VolumesActionsTest-1224009287 None] Copy volume to image completed successfully. Jun 23 16:37:48 devstack sudo[105217]: pam_unix(sudo:session): session closed for user root Jun 23 16:37:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b8d262bf-044d-412b-a1a1-4a74d61cb938 tempest-VolumesActionsTest-1113820978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-254dff89-a893-4f49-a025-643ef51dde0b 1073741824" returned: 0 in 0.842s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:37:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b8d262bf-044d-412b-a1a1-4a74d61cb938 tempest-VolumesActionsTest-1113820978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-254dff89-a893-4f49-a025-643ef51dde0b {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:37:48 devstack sudo[105223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-254dff89-a893-4f49-a025-643ef51dde0b Jun 23 16:37:48 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:37:48 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root Jun 23 16:37:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b8d262bf-044d-412b-a1a1-4a74d61cb938 tempest-VolumesActionsTest-1113820978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-254dff89-a893-4f49-a025-643ef51dde0b" returned: 0 in 0.650s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:37:48 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b8d262bf-044d-412b-a1a1-4a74d61cb938 tempest-VolumesActionsTest-1113820978 None] <== create_volume: return (1536ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:37:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b8d262bf-044d-412b-a1a1-4a74d61cb938 tempest-VolumesActionsTest-1113820978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.540s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:37:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-5d7fbadc-cec9-4058-9945-c7508841b7b6 req-4e9ddd52-336f-4f19-8034-5ed73d3327c0 tempest-VolumesSnapshotsTestJSON-1321212680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 37.872s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:37:48 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [req-5d7fbadc-cec9-4058-9945-c7508841b7b6 req-4e9ddd52-336f-4f19-8034-5ed73d3327c0 tempest-VolumesSnapshotsTestJSON-1321212680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:37:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1774416479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bcf134c-8fd7-40cf-b79f-6eb167ca09cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='808da28f47ba4fd993c144dead9603ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:37:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:37:11Z,use_quota=True,user_id='6a2a0421e3d2463594eb77b82bb67703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:37:48 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [req-5d7fbadc-cec9-4058-9945-c7508841b7b6 req-4e9ddd52-336f-4f19-8034-5ed73d3327c0 tempest-VolumesSnapshotsTestJSON-1321212680 None] Creating volume 9bcf134c-8fd7-40cf-b79f-6eb167ca09cf {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:37:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-5d7fbadc-cec9-4058-9945-c7508841b7b6 req-4e9ddd52-336f-4f19-8034-5ed73d3327c0 tempest-VolumesSnapshotsTestJSON-1321212680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:37:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-5d7fbadc-cec9-4058-9945-c7508841b7b6 req-4e9ddd52-336f-4f19-8034-5ed73d3327c0 tempest-VolumesSnapshotsTestJSON-1321212680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:37:48 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [req-5d7fbadc-cec9-4058-9945-c7508841b7b6 req-4e9ddd52-336f-4f19-8034-5ed73d3327c0 tempest-VolumesSnapshotsTestJSON-1321212680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:37:48 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [req-5d7fbadc-cec9-4058-9945-c7508841b7b6 req-4e9ddd52-336f-4f19-8034-5ed73d3327c0 tempest-VolumesSnapshotsTestJSON-1321212680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:37:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-5d7fbadc-cec9-4058-9945-c7508841b7b6 req-4e9ddd52-336f-4f19-8034-5ed73d3327c0 tempest-VolumesSnapshotsTestJSON-1321212680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:37:48 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [req-5d7fbadc-cec9-4058-9945-c7508841b7b6 req-4e9ddd52-336f-4f19-8034-5ed73d3327c0 tempest-VolumesSnapshotsTestJSON-1321212680 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:37:48 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [req-5d7fbadc-cec9-4058-9945-c7508841b7b6 req-4e9ddd52-336f-4f19-8034-5ed73d3327c0 tempest-VolumesSnapshotsTestJSON-1321212680 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:37:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-5d7fbadc-cec9-4058-9945-c7508841b7b6 req-4e9ddd52-336f-4f19-8034-5ed73d3327c0 tempest-VolumesSnapshotsTestJSON-1321212680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:37:48 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b8d262bf-044d-412b-a1a1-4a74d61cb938 tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0f7fdfa-54f0-491c-a2bf-6cb68935d4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-254dff89-a893-4f49-a025-643ef51dde0b', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:37:48 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf 1073741824 Jun 23 16:37:48 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:37:48 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b8d262bf-044d-412b-a1a1-4a74d61cb938 tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4d8d27a-6868-4221-b3e1-21102fdc6b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:37:48 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-b8d262bf-044d-412b-a1a1-4a74d61cb938 tempest-VolumesActionsTest-1113820978 None] Volume volume-254dff89-a893-4f49-a025-643ef51dde0b (254dff89-a893-4f49-a025-643ef51dde0b): created successfully Jun 23 16:37:48 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b8d262bf-044d-412b-a1a1-4a74d61cb938 tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4d8d27a-6868-4221-b3e1-21102fdc6b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:37:48 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b8d262bf-044d-412b-a1a1-4a74d61cb938 tempest-VolumesActionsTest-1113820978 None] Flow 'volume_create_manager' (d1f1eebf-a674-4637-9887-cffe2c976808) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:37:48 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-b8d262bf-044d-412b-a1a1-4a74d61cb938 tempest-VolumesActionsTest-1113820978 None] Created volume successfully. Jun 23 16:37:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-902e8168-fa96-42f4-bb82-28c87f633e5a tempest-VolumesActionsTest-1224009287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:37:49 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-cc625ffe-d756-4041-a882-d07b6f30b94b tempest-VolumesActionsTest-799589769 None] Acquiring lock "cinder-254dff89-a893-4f49-a025-643ef51dde0b-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:37:49 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-cc625ffe-d756-4041-a882-d07b6f30b94b tempest-VolumesActionsTest-799589769 None] Lock "cinder-254dff89-a893-4f49-a025-643ef51dde0b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:37:49 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-cc625ffe-d756-4041-a882-d07b6f30b94b tempest-VolumesActionsTest-799589769 None] Acquiring lock "cinder-quobyte-254dff89-a893-4f49-a025-643ef51dde0b" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:37:49 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-cc625ffe-d756-4041-a882-d07b6f30b94b tempest-VolumesActionsTest-799589769 None] Lock "cinder-quobyte-254dff89-a893-4f49-a025-643ef51dde0b" acquired by "delete_volume" :: waited 0.017s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:37:49 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a4b39f-8bcd-4d01-89a0-07657c8db2d8]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:37:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-cc625ffe-d756-4041-a882-d07b6f30b94b tempest-VolumesActionsTest-799589769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-254dff89-a893-4f49-a025-643ef51dde0b {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:37:49 devstack sudo[105231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-254dff89-a893-4f49-a025-643ef51dde0b Jun 23 16:37:49 devstack sudo[105231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:37:49 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Jun 23 16:37:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-5d7fbadc-cec9-4058-9945-c7508841b7b6 req-4e9ddd52-336f-4f19-8034-5ed73d3327c0 tempest-VolumesSnapshotsTestJSON-1321212680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf 1073741824" returned: 0 in 0.884s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:37:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-5d7fbadc-cec9-4058-9945-c7508841b7b6 req-4e9ddd52-336f-4f19-8034-5ed73d3327c0 tempest-VolumesSnapshotsTestJSON-1321212680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:37:49 devstack sudo[105235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf Jun 23 16:37:49 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:37:50 devstack sudo[105231]: pam_unix(sudo:session): session closed for user root Jun 23 16:37:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-cc625ffe-d756-4041-a882-d07b6f30b94b tempest-VolumesActionsTest-799589769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-254dff89-a893-4f49-a025-643ef51dde0b" returned: 0 in 0.783s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:37:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-cc625ffe-d756-4041-a882-d07b6f30b94b tempest-VolumesActionsTest-799589769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-254dff89-a893-4f49-a025-643ef51dde0b {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:37:50 devstack sudo[105240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-254dff89-a893-4f49-a025-643ef51dde0b Jun 23 16:37:50 devstack sudo[105240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:37:50 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root Jun 23 16:37:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-5d7fbadc-cec9-4058-9945-c7508841b7b6 req-4e9ddd52-336f-4f19-8034-5ed73d3327c0 tempest-VolumesSnapshotsTestJSON-1321212680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf" returned: 0 in 0.638s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:37:50 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [req-5d7fbadc-cec9-4058-9945-c7508841b7b6 req-4e9ddd52-336f-4f19-8034-5ed73d3327c0 tempest-VolumesSnapshotsTestJSON-1321212680 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:37:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-5d7fbadc-cec9-4058-9945-c7508841b7b6 req-4e9ddd52-336f-4f19-8034-5ed73d3327c0 tempest-VolumesSnapshotsTestJSON-1321212680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:37:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d1c1dff6-b9e2-4dbb-9aca-e0779e56b497 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.909s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:37:50 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-d1c1dff6-b9e2-4dbb-9aca-e0779e56b497 tempest-VolumeQuotasAdminTestJSON-1348781368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1853263230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=600252b0-7ee5-40b6-8d97-7305f062ade3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a459011b8004593b300ebb1ef6c06e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:37:43Z,use_quota=True,user_id='0285a72506514a0bb7c6d10e5fd62235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:37:50 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-d1c1dff6-b9e2-4dbb-9aca-e0779e56b497 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Creating volume 600252b0-7ee5-40b6-8d97-7305f062ade3 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:37:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d1c1dff6-b9e2-4dbb-9aca-e0779e56b497 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:37:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d1c1dff6-b9e2-4dbb-9aca-e0779e56b497 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:37:50 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-d1c1dff6-b9e2-4dbb-9aca-e0779e56b497 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:37:50 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-d1c1dff6-b9e2-4dbb-9aca-e0779e56b497 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:37:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d1c1dff6-b9e2-4dbb-9aca-e0779e56b497 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:37:50 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-d1c1dff6-b9e2-4dbb-9aca-e0779e56b497 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:37:50 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-d1c1dff6-b9e2-4dbb-9aca-e0779e56b497 tempest-VolumeQuotasAdminTestJSON-1348781368 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:37:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d1c1dff6-b9e2-4dbb-9aca-e0779e56b497 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-600252b0-7ee5-40b6-8d97-7305f062ade3 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:37:50 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-5d7fbadc-cec9-4058-9945-c7508841b7b6 req-4e9ddd52-336f-4f19-8034-5ed73d3327c0 tempest-VolumesSnapshotsTestJSON-1321212680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (513190f8-b762-48be-aaaf-47e3c0bab5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:37:50 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-5d7fbadc-cec9-4058-9945-c7508841b7b6 req-4e9ddd52-336f-4f19-8034-5ed73d3327c0 tempest-VolumesSnapshotsTestJSON-1321212680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (562830aa-792b-424f-b53a-336e63d5c763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:37:50 devstack sudo[105243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-600252b0-7ee5-40b6-8d97-7305f062ade3 1073741824 Jun 23 16:37:50 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [req-5d7fbadc-cec9-4058-9945-c7508841b7b6 req-4e9ddd52-336f-4f19-8034-5ed73d3327c0 tempest-VolumesSnapshotsTestJSON-1321212680 None] Volume volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf (9bcf134c-8fd7-40cf-b79f-6eb167ca09cf): created successfully Jun 23 16:37:50 devstack sudo[105243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:37:50 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-5d7fbadc-cec9-4058-9945-c7508841b7b6 req-4e9ddd52-336f-4f19-8034-5ed73d3327c0 tempest-VolumesSnapshotsTestJSON-1321212680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (562830aa-792b-424f-b53a-336e63d5c763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:37:50 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-5d7fbadc-cec9-4058-9945-c7508841b7b6 req-4e9ddd52-336f-4f19-8034-5ed73d3327c0 tempest-VolumesSnapshotsTestJSON-1321212680 None] Flow 'volume_create_manager' (93244510-4a11-4a38-abc0-f893fe0f274b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:37:50 devstack cinder-volume[93788]: INFO cinder.volume.manager [req-5d7fbadc-cec9-4058-9945-c7508841b7b6 req-4e9ddd52-336f-4f19-8034-5ed73d3327c0 tempest-VolumesSnapshotsTestJSON-1321212680 None] Created volume successfully. Jun 23 16:37:50 devstack sudo[105240]: pam_unix(sudo:session): session closed for user root Jun 23 16:37:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-cc625ffe-d756-4041-a882-d07b6f30b94b tempest-VolumesActionsTest-799589769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-254dff89-a893-4f49-a025-643ef51dde0b" returned: 0 in 0.678s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:37:50 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-cc625ffe-d756-4041-a882-d07b6f30b94b tempest-VolumesActionsTest-799589769 None] Lock "cinder-quobyte-254dff89-a893-4f49-a025-643ef51dde0b" released by "delete_volume" :: held 1.511s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:37:50 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-cc625ffe-d756-4041-a882-d07b6f30b94b tempest-VolumesActionsTest-799589769 None] Created reservations ['e30d7cb4-a7f5-449a-a821-36c27ea27bea', 'd75110af-ba6f-4f43-8e79-0ae09cd6bde8', 'e2bc5fcb-d1cf-4f57-9626-3ddc486ca595', 'd02bf071-90bb-4bc2-884a-a0419d22f008'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:37:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-cc625ffe-d756-4041-a882-d07b6f30b94b tempest-VolumesActionsTest-799589769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:37:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-cc625ffe-d756-4041-a882-d07b6f30b94b tempest-VolumesActionsTest-799589769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:37:51 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-cc625ffe-d756-4041-a882-d07b6f30b94b tempest-VolumesActionsTest-799589769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:37:51 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-cc625ffe-d756-4041-a882-d07b6f30b94b tempest-VolumesActionsTest-799589769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:37:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-cc625ffe-d756-4041-a882-d07b6f30b94b tempest-VolumesActionsTest-799589769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:37:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-cc625ffe-d756-4041-a882-d07b6f30b94b tempest-VolumesActionsTest-799589769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:37:51 devstack sudo[105249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:37:51 devstack sudo[105249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:37:51 devstack sudo[105243]: pam_unix(sudo:session): session closed for user root Jun 23 16:37:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d1c1dff6-b9e2-4dbb-9aca-e0779e56b497 tempest-VolumeQuotasAdminTestJSON-1348781368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-600252b0-7ee5-40b6-8d97-7305f062ade3 1073741824" returned: 0 in 0.855s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:37:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d1c1dff6-b9e2-4dbb-9aca-e0779e56b497 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-600252b0-7ee5-40b6-8d97-7305f062ade3 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:37:51 devstack sudo[105252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-600252b0-7ee5-40b6-8d97-7305f062ade3 Jun 23 16:37:51 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:37:51 devstack sudo[105249]: pam_unix(sudo:session): session closed for user root Jun 23 16:37:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-cc625ffe-d756-4041-a882-d07b6f30b94b tempest-VolumesActionsTest-799589769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.694s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:37:51 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-cc625ffe-d756-4041-a882-d07b6f30b94b tempest-VolumesActionsTest-799589769 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:37:51 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-cc625ffe-d756-4041-a882-d07b6f30b94b tempest-VolumesActionsTest-799589769 None] Deleted volume successfully. Jun 23 16:37:51 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-cc625ffe-d756-4041-a882-d07b6f30b94b tempest-VolumesActionsTest-799589769 None] Lock "cinder-254dff89-a893-4f49-a025-643ef51dde0b-delete_volume" released by "delete_volume" :: held 2.437s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:37:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-c4682818-4305-4a48-9d06-4ad45569438b req-38ced16e-8ef5-4067-95da-6af4b1532ee9 tempest-VolumesSnapshotsTestJSON-1321212680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:37:52 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root Jun 23 16:37:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d1c1dff6-b9e2-4dbb-9aca-e0779e56b497 tempest-VolumeQuotasAdminTestJSON-1348781368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-600252b0-7ee5-40b6-8d97-7305f062ade3" returned: 0 in 0.774s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:37:52 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-d1c1dff6-b9e2-4dbb-9aca-e0779e56b497 tempest-VolumeQuotasAdminTestJSON-1348781368 None] <== create_volume: return (1674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:37:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d1c1dff6-b9e2-4dbb-9aca-e0779e56b497 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.677s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:37:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-902e8168-fa96-42f4-bb82-28c87f633e5a tempest-VolumesActionsTest-1224009287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.906s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:37:52 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e9fac7-3a9b-479e-9eaf-c106385b8d3d]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:37:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-902e8168-fa96-42f4-bb82-28c87f633e5a tempest-VolumesActionsTest-1224009287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3434346-f7a9-4aaa-8210-6e8c244d1a95 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:37:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d1c1dff6-b9e2-4dbb-9aca-e0779e56b497 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3930ef55-53fd-4a45-bf2f-6af494e75307) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-600252b0-7ee5-40b6-8d97-7305f062ade3', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:37:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d1c1dff6-b9e2-4dbb-9aca-e0779e56b497 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19f1530e-7152-4eb2-bd87-0dad9a7e0da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:37:52 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-d1c1dff6-b9e2-4dbb-9aca-e0779e56b497 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Volume volume-600252b0-7ee5-40b6-8d97-7305f062ade3 (600252b0-7ee5-40b6-8d97-7305f062ade3): created successfully Jun 23 16:37:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d1c1dff6-b9e2-4dbb-9aca-e0779e56b497 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19f1530e-7152-4eb2-bd87-0dad9a7e0da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:37:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d1c1dff6-b9e2-4dbb-9aca-e0779e56b497 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Flow 'volume_create_manager' (66c4257c-a6d6-45ce-a24b-442f274b397e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:37:52 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-d1c1dff6-b9e2-4dbb-9aca-e0779e56b497 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Created volume successfully. Jun 23 16:37:52 devstack sudo[105256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3434346-f7a9-4aaa-8210-6e8c244d1a95 Jun 23 16:37:52 devstack sudo[105256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:37:52 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-b598e4fb-4093-4115-8eb5-8b7541aeb57d tempest-VolumesActionsTest-1113820978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:37:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b598e4fb-4093-4115-8eb5-8b7541aeb57d tempest-VolumesActionsTest-1113820978 None] Flow 'volume_create_manager' (5ab87eb2-772a-418b-a3db-06785e6f8187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:37:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b598e4fb-4093-4115-8eb5-8b7541aeb57d tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d914ad28-1ce4-4aac-b43a-dc37b9a1ea02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:37:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b598e4fb-4093-4115-8eb5-8b7541aeb57d tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d914ad28-1ce4-4aac-b43a-dc37b9a1ea02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-14676500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69e8216c-c375-48d0-a5a2-29e1a94ff302,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfc07113077b492c8ba668960a6f4dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:37:52Z,use_quota=True,user_id='8bf540cfe6304942beeb4e6870a7f49d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:37:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b598e4fb-4093-4115-8eb5-8b7541aeb57d tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (785c3937-c608-40ce-bef6-7e278600004d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:37:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b598e4fb-4093-4115-8eb5-8b7541aeb57d tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (785c3937-c608-40ce-bef6-7e278600004d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:37:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b598e4fb-4093-4115-8eb5-8b7541aeb57d tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c793aed1-3e62-468e-84ac-913c06f34f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:37:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b598e4fb-4093-4115-8eb5-8b7541aeb57d tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c793aed1-3e62-468e-84ac-913c06f34f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69e8216c-c375-48d0-a5a2-29e1a94ff302', 'volume_name': 'volume-69e8216c-c375-48d0-a5a2-29e1a94ff302', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:37:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b598e4fb-4093-4115-8eb5-8b7541aeb57d tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (209f5232-ffef-4590-845c-324c355ed13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:37:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b598e4fb-4093-4115-8eb5-8b7541aeb57d tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (209f5232-ffef-4590-845c-324c355ed13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:37:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b598e4fb-4093-4115-8eb5-8b7541aeb57d tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20744104-f3bb-4f7a-9ae4-a8e59139458d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:37:52 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-b598e4fb-4093-4115-8eb5-8b7541aeb57d tempest-VolumesActionsTest-1113820978 None] Volume 69e8216c-c375-48d0-a5a2-29e1a94ff302: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69e8216c-c375-48d0-a5a2-29e1a94ff302', 'volume_size': 1} Jun 23 16:37:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b598e4fb-4093-4115-8eb5-8b7541aeb57d tempest-VolumesActionsTest-1113820978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:37:52 devstack sudo[105256]: pam_unix(sudo:session): session closed for user root Jun 23 16:37:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-902e8168-fa96-42f4-bb82-28c87f633e5a tempest-VolumesActionsTest-1224009287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3434346-f7a9-4aaa-8210-6e8c244d1a95" returned: 0 in 0.800s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:37:52 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ba34c9-a375-4a5f-ab43-db3f5e6ab6ab]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:37:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-902e8168-fa96-42f4-bb82-28c87f633e5a tempest-VolumesActionsTest-1224009287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3434346-f7a9-4aaa-8210-6e8c244d1a95 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:37:53 devstack sudo[105261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3434346-f7a9-4aaa-8210-6e8c244d1a95 Jun 23 16:37:53 devstack sudo[105261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:37:53 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-2af29645-6f63-4ba8-b896-872eb72c5728 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Acquiring lock "cinder-600252b0-7ee5-40b6-8d97-7305f062ade3-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:37:53 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-2af29645-6f63-4ba8-b896-872eb72c5728 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Lock "cinder-600252b0-7ee5-40b6-8d97-7305f062ade3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:37:53 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-2af29645-6f63-4ba8-b896-872eb72c5728 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Acquiring lock "cinder-quobyte-600252b0-7ee5-40b6-8d97-7305f062ade3" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:37:53 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-2af29645-6f63-4ba8-b896-872eb72c5728 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Lock "cinder-quobyte-600252b0-7ee5-40b6-8d97-7305f062ade3" acquired by "delete_volume" :: waited 0.019s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:37:53 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba184acb-412a-4490-b708-c020f70ba545]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:37:53 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2af29645-6f63-4ba8-b896-872eb72c5728 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-600252b0-7ee5-40b6-8d97-7305f062ade3 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:37:53 devstack sudo[105263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-600252b0-7ee5-40b6-8d97-7305f062ade3 Jun 23 16:37:53 devstack sudo[105263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:37:53 devstack sudo[105261]: pam_unix(sudo:session): session closed for user root Jun 23 16:37:53 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-902e8168-fa96-42f4-bb82-28c87f633e5a tempest-VolumesActionsTest-1224009287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3434346-f7a9-4aaa-8210-6e8c244d1a95" returned: 0 in 0.846s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:37:53 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-902e8168-fa96-42f4-bb82-28c87f633e5a tempest-VolumesActionsTest-1224009287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3434346-f7a9-4aaa-8210-6e8c244d1a95 /opt/stack/data/cinder/conversion/e3434346-f7a9-4aaa-8210-6e8c244d1a95.temp_image.83d2c40c-5893-4935-b839-bef28f327b10ji87wm6o.img {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:37:53 devstack sudo[105268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3434346-f7a9-4aaa-8210-6e8c244d1a95 /opt/stack/data/cinder/conversion/e3434346-f7a9-4aaa-8210-6e8c244d1a95.temp_image.83d2c40c-5893-4935-b839-bef28f327b10ji87wm6o.img Jun 23 16:37:53 devstack sudo[105268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:37:53 devstack sudo[105263]: pam_unix(sudo:session): session closed for user root Jun 23 16:37:53 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2af29645-6f63-4ba8-b896-872eb72c5728 tempest-VolumeQuotasAdminTestJSON-1348781368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-600252b0-7ee5-40b6-8d97-7305f062ade3" returned: 0 in 0.792s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:37:53 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2af29645-6f63-4ba8-b896-872eb72c5728 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-600252b0-7ee5-40b6-8d97-7305f062ade3 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:37:53 devstack sudo[105273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-600252b0-7ee5-40b6-8d97-7305f062ade3 Jun 23 16:37:53 devstack sudo[105273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:37:54 devstack sudo[105273]: pam_unix(sudo:session): session closed for user root Jun 23 16:37:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2af29645-6f63-4ba8-b896-872eb72c5728 tempest-VolumeQuotasAdminTestJSON-1348781368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-600252b0-7ee5-40b6-8d97-7305f062ade3" returned: 0 in 0.995s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:37:54 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-2af29645-6f63-4ba8-b896-872eb72c5728 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Lock "cinder-quobyte-600252b0-7ee5-40b6-8d97-7305f062ade3" released by "delete_volume" :: held 1.866s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:37:55 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-2af29645-6f63-4ba8-b896-872eb72c5728 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Created reservations ['31951729-fc63-4725-a5ee-cd1f3bae8af3', 'cb56fd8c-6825-406a-b424-00709f9977ff', 'f99decb7-3603-47fd-b896-0e225a97fe51', '81e89fd0-816e-48a9-b972-090b3004af2b'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:37:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-2af29645-6f63-4ba8-b896-872eb72c5728 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:37:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-2af29645-6f63-4ba8-b896-872eb72c5728 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:37:55 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-2af29645-6f63-4ba8-b896-872eb72c5728 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:37:55 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-2af29645-6f63-4ba8-b896-872eb72c5728 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:37:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-2af29645-6f63-4ba8-b896-872eb72c5728 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:37:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2af29645-6f63-4ba8-b896-872eb72c5728 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:37:55 devstack sudo[105286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:37:55 devstack sudo[105286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:37:56 devstack sudo[105286]: pam_unix(sudo:session): session closed for user root Jun 23 16:37:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2af29645-6f63-4ba8-b896-872eb72c5728 tempest-VolumeQuotasAdminTestJSON-1348781368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.273s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:37:56 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-2af29645-6f63-4ba8-b896-872eb72c5728 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:37:56 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-2af29645-6f63-4ba8-b896-872eb72c5728 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Deleted volume successfully. Jun 23 16:37:56 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-2af29645-6f63-4ba8-b896-872eb72c5728 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Lock "cinder-600252b0-7ee5-40b6-8d97-7305f062ade3-delete_volume" released by "delete_volume" :: held 3.671s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:37:56 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-5472c3c8-e4fa-43d1-87dd-0b800e3b1223 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:37:56 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5472c3c8-e4fa-43d1-87dd-0b800e3b1223 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Flow 'volume_create_manager' (5c99253c-abc5-4892-85b7-35b2a906b8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:37:56 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5472c3c8-e4fa-43d1-87dd-0b800e3b1223 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (114a7b40-cc70-47ef-9feb-739ca8044693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:37:56 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5472c3c8-e4fa-43d1-87dd-0b800e3b1223 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (114a7b40-cc70-47ef-9feb-739ca8044693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:37:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-74137062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=572519db-cffe-4171-a60f-4f2855bac12f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a459011b8004593b300ebb1ef6c06e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:37:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:37:57Z,use_quota=True,user_id='0285a72506514a0bb7c6d10e5fd62235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:37:56 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5472c3c8-e4fa-43d1-87dd-0b800e3b1223 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0a795d3-db8d-4d75-9b7f-02e9a0283bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:37:56 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5472c3c8-e4fa-43d1-87dd-0b800e3b1223 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0a795d3-db8d-4d75-9b7f-02e9a0283bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:37:56 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5472c3c8-e4fa-43d1-87dd-0b800e3b1223 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15767f54-8340-4301-8e07-b6cc20b9a0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:37:56 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5472c3c8-e4fa-43d1-87dd-0b800e3b1223 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15767f54-8340-4301-8e07-b6cc20b9a0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '572519db-cffe-4171-a60f-4f2855bac12f', 'volume_name': 'volume-572519db-cffe-4171-a60f-4f2855bac12f', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:37:56 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5472c3c8-e4fa-43d1-87dd-0b800e3b1223 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b76f083-2828-46cb-ba9d-f58217067516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:37:56 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5472c3c8-e4fa-43d1-87dd-0b800e3b1223 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b76f083-2828-46cb-ba9d-f58217067516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:37:56 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5472c3c8-e4fa-43d1-87dd-0b800e3b1223 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3883f74d-8595-44ce-bc2d-b59ef4bfc827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:37:56 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-5472c3c8-e4fa-43d1-87dd-0b800e3b1223 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Volume 572519db-cffe-4171-a60f-4f2855bac12f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-572519db-cffe-4171-a60f-4f2855bac12f', 'volume_size': 1} Jun 23 16:37:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5472c3c8-e4fa-43d1-87dd-0b800e3b1223 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:37:59 devstack sudo[105268]: pam_unix(sudo:session): session closed for user root Jun 23 16:37:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-902e8168-fa96-42f4-bb82-28c87f633e5a tempest-VolumesActionsTest-1224009287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3434346-f7a9-4aaa-8210-6e8c244d1a95 /opt/stack/data/cinder/conversion/e3434346-f7a9-4aaa-8210-6e8c244d1a95.temp_image.83d2c40c-5893-4935-b839-bef28f327b10ji87wm6o.img" returned: 0 in 5.424s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:37:59 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[66be55e3-a6f8-46a6-bf29-97a64c7dadae]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:37:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-902e8168-fa96-42f4-bb82-28c87f633e5a tempest-VolumesActionsTest-1224009287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3434346-f7a9-4aaa-8210-6e8c244d1a95 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:37:59 devstack sudo[105291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3434346-f7a9-4aaa-8210-6e8c244d1a95 Jun 23 16:37:59 devstack sudo[105291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:00 devstack sudo[105291]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-902e8168-fa96-42f4-bb82-28c87f633e5a tempest-VolumesActionsTest-1224009287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3434346-f7a9-4aaa-8210-6e8c244d1a95" returned: 0 in 0.907s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:00 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-902e8168-fa96-42f4-bb82-28c87f633e5a tempest-VolumesActionsTest-1224009287 None] Image conversion details: src /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3434346-f7a9-4aaa-8210-6e8c244d1a95, size 1024.00 MB, duration 5.42 sec, destination /opt/stack/data/cinder/conversion/e3434346-f7a9-4aaa-8210-6e8c244d1a95.temp_image.83d2c40c-5893-4935-b839-bef28f327b10ji87wm6o.img {{(pid=93788) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 16:38:00 devstack cinder-volume[93788]: INFO cinder.image.image_utils [None req-902e8168-fa96-42f4-bb82-28c87f633e5a tempest-VolumesActionsTest-1224009287 None] Converted 1024.00 MB image at 188.76 MB/s Jun 23 16:38:00 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-902e8168-fa96-42f4-bb82-28c87f633e5a tempest-VolumesActionsTest-1224009287 None] 83d2c40c-5893-4935-b839-bef28f327b10 was raw, converting to qcow2 {{(pid=93788) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jun 23 16:38:00 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8510cc4-2329-4017-9710-b47b11566d41]: (4, 'raw') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:38:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-902e8168-fa96-42f4-bb82-28c87f633e5a tempest-VolumesActionsTest-1224009287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e3434346-f7a9-4aaa-8210-6e8c244d1a95.temp_image.83d2c40c-5893-4935-b839-bef28f327b10ji87wm6o.img {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:00 devstack sudo[105297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e3434346-f7a9-4aaa-8210-6e8c244d1a95.temp_image.83d2c40c-5893-4935-b839-bef28f327b10ji87wm6o.img Jun 23 16:38:00 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:00 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-902e8168-fa96-42f4-bb82-28c87f633e5a tempest-VolumesActionsTest-1224009287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e3434346-f7a9-4aaa-8210-6e8c244d1a95.temp_image.83d2c40c-5893-4935-b839-bef28f327b10ji87wm6o.img" returned: 0 in 0.712s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-902e8168-fa96-42f4-bb82-28c87f633e5a tempest-VolumesActionsTest-1224009287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e3434346-f7a9-4aaa-8210-6e8c244d1a95.temp_image.83d2c40c-5893-4935-b839-bef28f327b10ji87wm6o.img {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:00 devstack sudo[105301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e3434346-f7a9-4aaa-8210-6e8c244d1a95.temp_image.83d2c40c-5893-4935-b839-bef28f327b10ji87wm6o.img Jun 23 16:38:00 devstack sudo[105301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:01 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:38:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:38:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:38:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:38:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:38:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:38:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:01 devstack sudo[105303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:38:01 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:01 devstack sudo[105301]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-902e8168-fa96-42f4-bb82-28c87f633e5a tempest-VolumesActionsTest-1224009287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e3434346-f7a9-4aaa-8210-6e8c244d1a95.temp_image.83d2c40c-5893-4935-b839-bef28f327b10ji87wm6o.img" returned: 1 in 0.708s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-902e8168-fa96-42f4-bb82-28c87f633e5a tempest-VolumesActionsTest-1224009287 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e3434346-f7a9-4aaa-8210-6e8c244d1a95.temp_image.83d2c40c-5893-4935-b839-bef28f327b10ji87wm6o.img' failed. Not Retrying. {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:38:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-902e8168-fa96-42f4-bb82-28c87f633e5a tempest-VolumesActionsTest-1224009287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e3434346-f7a9-4aaa-8210-6e8c244d1a95.temp_image.83d2c40c-5893-4935-b839-bef28f327b10ji87wm6o.img /opt/stack/data/cinder/conversion/vol_upload_jdjwc9yo {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:01 devstack sudo[105308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e3434346-f7a9-4aaa-8210-6e8c244d1a95.temp_image.83d2c40c-5893-4935-b839-bef28f327b10ji87wm6o.img /opt/stack/data/cinder/conversion/vol_upload_jdjwc9yo Jun 23 16:38:01 devstack sudo[105308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:02 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.726s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:02 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:38:02 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager._thread_info {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:38:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread count: 28 {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 16:38:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread info: [<_MainThread(MainThread, started 126303828988032)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 16:38:02 devstack sudo[105308]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-902e8168-fa96-42f4-bb82-28c87f633e5a tempest-VolumesActionsTest-1224009287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e3434346-f7a9-4aaa-8210-6e8c244d1a95.temp_image.83d2c40c-5893-4935-b839-bef28f327b10ji87wm6o.img /opt/stack/data/cinder/conversion/vol_upload_jdjwc9yo" returned: 0 in 0.711s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:02 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-902e8168-fa96-42f4-bb82-28c87f633e5a tempest-VolumesActionsTest-1224009287 None] Image conversion details: src /opt/stack/data/cinder/conversion/e3434346-f7a9-4aaa-8210-6e8c244d1a95.temp_image.83d2c40c-5893-4935-b839-bef28f327b10ji87wm6o.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_jdjwc9yo {{(pid=93788) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 16:38:02 devstack cinder-volume[93788]: INFO cinder.image.image_utils [None req-902e8168-fa96-42f4-bb82-28c87f633e5a tempest-VolumesActionsTest-1224009287 None] Converted 1024.00 MB image at 1024.00 MB/s Jun 23 16:38:02 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f90d13-838e-4dd5-baca-9116dafd2c2d]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:38:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-902e8168-fa96-42f4-bb82-28c87f633e5a tempest-VolumesActionsTest-1224009287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_jdjwc9yo {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:02 devstack sudo[105315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_jdjwc9yo Jun 23 16:38:02 devstack sudo[105315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:02 devstack sudo[105315]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-902e8168-fa96-42f4-bb82-28c87f633e5a tempest-VolumesActionsTest-1224009287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_jdjwc9yo" returned: 0 in 0.700s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-902e8168-fa96-42f4-bb82-28c87f633e5a tempest-VolumesActionsTest-1224009287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.207s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:38:04 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-902e8168-fa96-42f4-bb82-28c87f633e5a tempest-VolumesActionsTest-1224009287 None] Uploaded volume to glance image-id: 83d2c40c-5893-4935-b839-bef28f327b10. {{(pid=93788) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 23 16:38:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-c4682818-4305-4a48-9d06-4ad45569438b req-38ced16e-8ef5-4067-95da-6af4b1532ee9 tempest-VolumesSnapshotsTestJSON-1321212680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.437s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:38:04 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [req-c4682818-4305-4a48-9d06-4ad45569438b req-38ced16e-8ef5-4067-95da-6af4b1532ee9 tempest-VolumesSnapshotsTestJSON-1321212680 None] Creating offline snapshot 997e97ee-70c7-4066-90e6-17866ac88a33 of volume 9bcf134c-8fd7-40cf-b79f-6eb167ca09cf {{(pid=93788) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:38:04 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-902e8168-fa96-42f4-bb82-28c87f633e5a tempest-VolumesActionsTest-1224009287 None] Copy volume to image completed successfully. Jun 23 16:38:04 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5837049b-a8ae-4948-b48a-66da40433e9c]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:38:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-c4682818-4305-4a48-9d06-4ad45569438b req-38ced16e-8ef5-4067-95da-6af4b1532ee9 tempest-VolumesSnapshotsTestJSON-1321212680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:04 devstack sudo[105321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf Jun 23 16:38:04 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:05 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-c4682818-4305-4a48-9d06-4ad45569438b req-38ced16e-8ef5-4067-95da-6af4b1532ee9 tempest-VolumesSnapshotsTestJSON-1321212680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf" returned: 0 in 0.741s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-c4682818-4305-4a48-9d06-4ad45569438b req-38ced16e-8ef5-4067-95da-6af4b1532ee9 tempest-VolumesSnapshotsTestJSON-1321212680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf.997e97ee-70c7-4066-90e6-17866ac88a33 1G {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:05 devstack sudo[105326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf.997e97ee-70c7-4066-90e6-17866ac88a33 1G Jun 23 16:38:05 devstack sudo[105326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:05 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-465b0125-51a6-434f-8fcf-14a860031cfa tempest-VolumesActionsTest-1224009287 None] Acquiring lock "cinder-e3434346-f7a9-4aaa-8210-6e8c244d1a95-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:38:05 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-465b0125-51a6-434f-8fcf-14a860031cfa tempest-VolumesActionsTest-1224009287 None] Lock "cinder-e3434346-f7a9-4aaa-8210-6e8c244d1a95-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:38:05 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-465b0125-51a6-434f-8fcf-14a860031cfa tempest-VolumesActionsTest-1224009287 None] Acquiring lock "cinder-quobyte-e3434346-f7a9-4aaa-8210-6e8c244d1a95" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:38:05 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-465b0125-51a6-434f-8fcf-14a860031cfa tempest-VolumesActionsTest-1224009287 None] Lock "cinder-quobyte-e3434346-f7a9-4aaa-8210-6e8c244d1a95" acquired by "delete_volume" :: waited 0.020s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:38:05 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2161d6cd-7460-4449-bdc2-f8608a85c696]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:38:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-465b0125-51a6-434f-8fcf-14a860031cfa tempest-VolumesActionsTest-1224009287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3434346-f7a9-4aaa-8210-6e8c244d1a95 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:05 devstack sudo[105330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3434346-f7a9-4aaa-8210-6e8c244d1a95 Jun 23 16:38:05 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:05 devstack sudo[105326]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-c4682818-4305-4a48-9d06-4ad45569438b req-38ced16e-8ef5-4067-95da-6af4b1532ee9 tempest-VolumesSnapshotsTestJSON-1321212680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf.997e97ee-70c7-4066-90e6-17866ac88a33 1G" returned: 0 in 0.831s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-c4682818-4305-4a48-9d06-4ad45569438b req-38ced16e-8ef5-4067-95da-6af4b1532ee9 tempest-VolumesSnapshotsTestJSON-1321212680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf.997e97ee-70c7-4066-90e6-17866ac88a33 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:05 devstack sudo[105334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf.997e97ee-70c7-4066-90e6-17866ac88a33 Jun 23 16:38:05 devstack sudo[105334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:06 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-465b0125-51a6-434f-8fcf-14a860031cfa tempest-VolumesActionsTest-1224009287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3434346-f7a9-4aaa-8210-6e8c244d1a95" returned: 0 in 0.852s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-465b0125-51a6-434f-8fcf-14a860031cfa tempest-VolumesActionsTest-1224009287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3434346-f7a9-4aaa-8210-6e8c244d1a95 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:06 devstack sudo[105342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3434346-f7a9-4aaa-8210-6e8c244d1a95 Jun 23 16:38:06 devstack sudo[105342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:06 devstack sudo[105334]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-c4682818-4305-4a48-9d06-4ad45569438b req-38ced16e-8ef5-4067-95da-6af4b1532ee9 tempest-VolumesSnapshotsTestJSON-1321212680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf.997e97ee-70c7-4066-90e6-17866ac88a33" returned: 0 in 0.698s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:06 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [req-c4682818-4305-4a48-9d06-4ad45569438b req-38ced16e-8ef5-4067-95da-6af4b1532ee9 tempest-VolumesSnapshotsTestJSON-1321212680 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf.997e97ee-70c7-4066-90e6-17866ac88a33 is being set with open permissions: ugo+rw Jun 23 16:38:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-c4682818-4305-4a48-9d06-4ad45569438b req-38ced16e-8ef5-4067-95da-6af4b1532ee9 tempest-VolumesSnapshotsTestJSON-1321212680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf.997e97ee-70c7-4066-90e6-17866ac88a33 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:06 devstack sudo[105344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf.997e97ee-70c7-4066-90e6-17866ac88a33 Jun 23 16:38:06 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:07 devstack sudo[105342]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-465b0125-51a6-434f-8fcf-14a860031cfa tempest-VolumesActionsTest-1224009287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3434346-f7a9-4aaa-8210-6e8c244d1a95" returned: 0 in 0.671s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:07 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-465b0125-51a6-434f-8fcf-14a860031cfa tempest-VolumesActionsTest-1224009287 None] Lock "cinder-quobyte-e3434346-f7a9-4aaa-8210-6e8c244d1a95" released by "delete_volume" :: held 1.567s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:38:07 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-c4682818-4305-4a48-9d06-4ad45569438b req-38ced16e-8ef5-4067-95da-6af4b1532ee9 tempest-VolumesSnapshotsTestJSON-1321212680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf.997e97ee-70c7-4066-90e6-17866ac88a33" returned: 0 in 0.620s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:07 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-465b0125-51a6-434f-8fcf-14a860031cfa tempest-VolumesActionsTest-1224009287 None] Created reservations ['a070e7d6-a5bd-405f-ab95-7df0247a068e', '8e3e0876-8574-4cdb-b85b-1a0c3e17afdb', '218b326f-0837-48da-a6d0-141b6af60bc6', 'faef9330-6fa8-48c1-9282-f4b4c5e649c0'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:38:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-c4682818-4305-4a48-9d06-4ad45569438b req-38ced16e-8ef5-4067-95da-6af4b1532ee9 tempest-VolumesSnapshotsTestJSON-1321212680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:07 devstack sudo[105348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf.info Jun 23 16:38:07 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-465b0125-51a6-434f-8fcf-14a860031cfa tempest-VolumesActionsTest-1224009287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:38:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-465b0125-51a6-434f-8fcf-14a860031cfa tempest-VolumesActionsTest-1224009287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:38:07 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-465b0125-51a6-434f-8fcf-14a860031cfa tempest-VolumesActionsTest-1224009287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:38:07 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-465b0125-51a6-434f-8fcf-14a860031cfa tempest-VolumesActionsTest-1224009287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:38:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-465b0125-51a6-434f-8fcf-14a860031cfa tempest-VolumesActionsTest-1224009287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:38:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-465b0125-51a6-434f-8fcf-14a860031cfa tempest-VolumesActionsTest-1224009287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:07 devstack sudo[105350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:38:07 devstack sudo[105350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:07 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-c4682818-4305-4a48-9d06-4ad45569438b req-38ced16e-8ef5-4067-95da-6af4b1532ee9 tempest-VolumesSnapshotsTestJSON-1321212680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf.info" returned: 0 in 0.626s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:07 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [req-c4682818-4305-4a48-9d06-4ad45569438b req-38ced16e-8ef5-4067-95da-6af4b1532ee9 tempest-VolumesSnapshotsTestJSON-1321212680 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf.info is being set with open permissions: ugo+rw Jun 23 16:38:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-c4682818-4305-4a48-9d06-4ad45569438b req-38ced16e-8ef5-4067-95da-6af4b1532ee9 tempest-VolumesSnapshotsTestJSON-1321212680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:07 devstack sudo[105354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf.info Jun 23 16:38:07 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:08 devstack sudo[105350]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-465b0125-51a6-434f-8fcf-14a860031cfa tempest-VolumesActionsTest-1224009287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.678s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:08 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-465b0125-51a6-434f-8fcf-14a860031cfa tempest-VolumesActionsTest-1224009287 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:38:08 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-465b0125-51a6-434f-8fcf-14a860031cfa tempest-VolumesActionsTest-1224009287 None] Deleted volume successfully. Jun 23 16:38:08 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-465b0125-51a6-434f-8fcf-14a860031cfa tempest-VolumesActionsTest-1224009287 None] Lock "cinder-e3434346-f7a9-4aaa-8210-6e8c244d1a95-delete_volume" released by "delete_volume" :: held 2.507s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:38:08 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-c4682818-4305-4a48-9d06-4ad45569438b req-38ced16e-8ef5-4067-95da-6af4b1532ee9 tempest-VolumesSnapshotsTestJSON-1321212680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf.info" returned: 0 in 0.696s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-c4682818-4305-4a48-9d06-4ad45569438b req-38ced16e-8ef5-4067-95da-6af4b1532ee9 tempest-VolumesSnapshotsTestJSON-1321212680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.327s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:38:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b598e4fb-4093-4115-8eb5-8b7541aeb57d tempest-VolumesActionsTest-1113820978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.237s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:38:08 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b598e4fb-4093-4115-8eb5-8b7541aeb57d tempest-VolumesActionsTest-1113820978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-14676500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69e8216c-c375-48d0-a5a2-29e1a94ff302,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfc07113077b492c8ba668960a6f4dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:37:52Z,use_quota=True,user_id='8bf540cfe6304942beeb4e6870a7f49d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:38:08 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-b598e4fb-4093-4115-8eb5-8b7541aeb57d tempest-VolumesActionsTest-1113820978 None] Creating volume 69e8216c-c375-48d0-a5a2-29e1a94ff302 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:38:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b598e4fb-4093-4115-8eb5-8b7541aeb57d tempest-VolumesActionsTest-1113820978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:38:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b598e4fb-4093-4115-8eb5-8b7541aeb57d tempest-VolumesActionsTest-1113820978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:38:08 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b598e4fb-4093-4115-8eb5-8b7541aeb57d tempest-VolumesActionsTest-1113820978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:38:08 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b598e4fb-4093-4115-8eb5-8b7541aeb57d tempest-VolumesActionsTest-1113820978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:38:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b598e4fb-4093-4115-8eb5-8b7541aeb57d tempest-VolumesActionsTest-1113820978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:38:08 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b598e4fb-4093-4115-8eb5-8b7541aeb57d tempest-VolumesActionsTest-1113820978 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:38:08 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-b598e4fb-4093-4115-8eb5-8b7541aeb57d tempest-VolumesActionsTest-1113820978 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:38:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b598e4fb-4093-4115-8eb5-8b7541aeb57d tempest-VolumesActionsTest-1113820978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69e8216c-c375-48d0-a5a2-29e1a94ff302 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:08 devstack sudo[105359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69e8216c-c375-48d0-a5a2-29e1a94ff302 1073741824 Jun 23 16:38:08 devstack sudo[105359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:08 devstack cinder-volume[93788]: INFO cinder.volume.manager [req-c4682818-4305-4a48-9d06-4ad45569438b req-38ced16e-8ef5-4067-95da-6af4b1532ee9 tempest-VolumesSnapshotsTestJSON-1321212680 None] Create snapshot completed successfully Jun 23 16:38:09 devstack sudo[105359]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b598e4fb-4093-4115-8eb5-8b7541aeb57d tempest-VolumesActionsTest-1113820978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69e8216c-c375-48d0-a5a2-29e1a94ff302 1073741824" returned: 0 in 0.845s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b598e4fb-4093-4115-8eb5-8b7541aeb57d tempest-VolumesActionsTest-1113820978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69e8216c-c375-48d0-a5a2-29e1a94ff302 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:09 devstack sudo[105365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69e8216c-c375-48d0-a5a2-29e1a94ff302 Jun 23 16:38:09 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:09 devstack cinder-volume[93788]: DEBUG cinder.coordination [req-1a05d393-e259-485d-8a0e-198037282d0e req-0fb8bcef-dd64-47c1-acbb-2e5f260d3077 tempest-VolumesSnapshotsTestJSON-1321212680 None] Acquiring lock "cinder-997e97ee-70c7-4066-90e6-17866ac88a33-delete_snapshot" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:38:09 devstack cinder-volume[93788]: DEBUG cinder.coordination [req-1a05d393-e259-485d-8a0e-198037282d0e req-0fb8bcef-dd64-47c1-acbb-2e5f260d3077 tempest-VolumesSnapshotsTestJSON-1321212680 None] Lock "cinder-997e97ee-70c7-4066-90e6-17866ac88a33-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:38:09 devstack cinder-volume[93788]: DEBUG cinder.coordination [req-1a05d393-e259-485d-8a0e-198037282d0e req-0fb8bcef-dd64-47c1-acbb-2e5f260d3077 tempest-VolumesSnapshotsTestJSON-1321212680 None] Acquiring lock "cinder-quobyte-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:38:09 devstack cinder-volume[93788]: DEBUG cinder.coordination [req-1a05d393-e259-485d-8a0e-198037282d0e req-0fb8bcef-dd64-47c1-acbb-2e5f260d3077 tempest-VolumesSnapshotsTestJSON-1321212680 None] Lock "cinder-quobyte-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:38:09 devstack cinder-volume[93788]: DEBUG cinder.coordination [req-1a05d393-e259-485d-8a0e-198037282d0e req-0fb8bcef-dd64-47c1-acbb-2e5f260d3077 tempest-VolumesSnapshotsTestJSON-1321212680 None] Acquiring lock "cinder-quobyte-997e97ee-70c7-4066-90e6-17866ac88a33" by "_delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:38:09 devstack cinder-volume[93788]: DEBUG cinder.coordination [req-1a05d393-e259-485d-8a0e-198037282d0e req-0fb8bcef-dd64-47c1-acbb-2e5f260d3077 tempest-VolumesSnapshotsTestJSON-1321212680 None] Lock "cinder-quobyte-997e97ee-70c7-4066-90e6-17866ac88a33" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:38:09 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [req-1a05d393-e259-485d-8a0e-198037282d0e req-0fb8bcef-dd64-47c1-acbb-2e5f260d3077 tempest-VolumesSnapshotsTestJSON-1321212680 None] Deleting offline snapshot 997e97ee-70c7-4066-90e6-17866ac88a33 of volume 9bcf134c-8fd7-40cf-b79f-6eb167ca09cf {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:38:09 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [req-1a05d393-e259-485d-8a0e-198037282d0e req-0fb8bcef-dd64-47c1-acbb-2e5f260d3077 tempest-VolumesSnapshotsTestJSON-1321212680 None] snapshot_file for this snap is: volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf.997e97ee-70c7-4066-90e6-17866ac88a33 {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:38:09 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ad63ba-2bae-4955-b299-45147d2aeac0]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:38:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-1a05d393-e259-485d-8a0e-198037282d0e req-0fb8bcef-dd64-47c1-acbb-2e5f260d3077 tempest-VolumesSnapshotsTestJSON-1321212680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf.997e97ee-70c7-4066-90e6-17866ac88a33 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:10 devstack sudo[105367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf.997e97ee-70c7-4066-90e6-17866ac88a33 Jun 23 16:38:10 devstack sudo[105367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:10 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b598e4fb-4093-4115-8eb5-8b7541aeb57d tempest-VolumesActionsTest-1113820978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69e8216c-c375-48d0-a5a2-29e1a94ff302" returned: 0 in 0.693s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:10 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b598e4fb-4093-4115-8eb5-8b7541aeb57d tempest-VolumesActionsTest-1113820978 None] <== create_volume: return (1578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:38:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b598e4fb-4093-4115-8eb5-8b7541aeb57d tempest-VolumesActionsTest-1113820978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.582s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:38:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5472c3c8-e4fa-43d1-87dd-0b800e3b1223 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.236s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:38:10 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-5472c3c8-e4fa-43d1-87dd-0b800e3b1223 tempest-VolumeQuotasAdminTestJSON-1348781368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:37:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-74137062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=572519db-cffe-4171-a60f-4f2855bac12f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a459011b8004593b300ebb1ef6c06e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:37:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:37:57Z,use_quota=True,user_id='0285a72506514a0bb7c6d10e5fd62235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:38:10 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-5472c3c8-e4fa-43d1-87dd-0b800e3b1223 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Creating volume 572519db-cffe-4171-a60f-4f2855bac12f {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:38:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5472c3c8-e4fa-43d1-87dd-0b800e3b1223 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:38:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5472c3c8-e4fa-43d1-87dd-0b800e3b1223 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:38:10 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-5472c3c8-e4fa-43d1-87dd-0b800e3b1223 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:38:10 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-5472c3c8-e4fa-43d1-87dd-0b800e3b1223 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:38:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5472c3c8-e4fa-43d1-87dd-0b800e3b1223 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:38:10 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-5472c3c8-e4fa-43d1-87dd-0b800e3b1223 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:38:10 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-5472c3c8-e4fa-43d1-87dd-0b800e3b1223 tempest-VolumeQuotasAdminTestJSON-1348781368 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:38:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5472c3c8-e4fa-43d1-87dd-0b800e3b1223 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-572519db-cffe-4171-a60f-4f2855bac12f 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b598e4fb-4093-4115-8eb5-8b7541aeb57d tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20744104-f3bb-4f7a-9ae4-a8e59139458d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69e8216c-c375-48d0-a5a2-29e1a94ff302', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b598e4fb-4093-4115-8eb5-8b7541aeb57d tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb22ce8b-7661-43b7-8dd8-63d9dcc35e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:10 devstack sudo[105370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-572519db-cffe-4171-a60f-4f2855bac12f 1073741824 Jun 23 16:38:10 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:10 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-b598e4fb-4093-4115-8eb5-8b7541aeb57d tempest-VolumesActionsTest-1113820978 None] Volume volume-69e8216c-c375-48d0-a5a2-29e1a94ff302 (69e8216c-c375-48d0-a5a2-29e1a94ff302): created successfully Jun 23 16:38:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b598e4fb-4093-4115-8eb5-8b7541aeb57d tempest-VolumesActionsTest-1113820978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb22ce8b-7661-43b7-8dd8-63d9dcc35e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b598e4fb-4093-4115-8eb5-8b7541aeb57d tempest-VolumesActionsTest-1113820978 None] Flow 'volume_create_manager' (5ab87eb2-772a-418b-a3db-06785e6f8187) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:38:10 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-b598e4fb-4093-4115-8eb5-8b7541aeb57d tempest-VolumesActionsTest-1113820978 None] Created volume successfully. Jun 23 16:38:10 devstack sudo[105367]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-1a05d393-e259-485d-8a0e-198037282d0e req-0fb8bcef-dd64-47c1-acbb-2e5f260d3077 tempest-VolumesSnapshotsTestJSON-1321212680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf.997e97ee-70c7-4066-90e6-17866ac88a33" returned: 0 in 0.975s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:10 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [req-1a05d393-e259-485d-8a0e-198037282d0e req-0fb8bcef-dd64-47c1-acbb-2e5f260d3077 tempest-VolumesSnapshotsTestJSON-1321212680 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:38:10 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[84edb11d-f461-49fa-a72c-48258382b7ec]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:38:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-1a05d393-e259-485d-8a0e-198037282d0e req-0fb8bcef-dd64-47c1-acbb-2e5f260d3077 tempest-VolumesSnapshotsTestJSON-1321212680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:11 devstack sudo[105375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf Jun 23 16:38:11 devstack sudo[105375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:11 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5472c3c8-e4fa-43d1-87dd-0b800e3b1223 tempest-VolumeQuotasAdminTestJSON-1348781368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-572519db-cffe-4171-a60f-4f2855bac12f 1073741824" returned: 0 in 1.255s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5472c3c8-e4fa-43d1-87dd-0b800e3b1223 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-572519db-cffe-4171-a60f-4f2855bac12f {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:11 devstack sudo[105381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-572519db-cffe-4171-a60f-4f2855bac12f Jun 23 16:38:11 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:11 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-14d57bd7-4e2e-4d97-85c0-5217d9f88315 tempest-VolumesActionsTest-1113820978 None] Acquiring lock "cinder-69e8216c-c375-48d0-a5a2-29e1a94ff302-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:38:11 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-14d57bd7-4e2e-4d97-85c0-5217d9f88315 tempest-VolumesActionsTest-1113820978 None] Lock "cinder-69e8216c-c375-48d0-a5a2-29e1a94ff302-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:38:11 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-14d57bd7-4e2e-4d97-85c0-5217d9f88315 tempest-VolumesActionsTest-1113820978 None] Acquiring lock "cinder-quobyte-69e8216c-c375-48d0-a5a2-29e1a94ff302" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:38:11 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-14d57bd7-4e2e-4d97-85c0-5217d9f88315 tempest-VolumesActionsTest-1113820978 None] Lock "cinder-quobyte-69e8216c-c375-48d0-a5a2-29e1a94ff302" acquired by "delete_volume" :: waited 0.027s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:38:11 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3386f53-f486-4df2-b292-f97a56ede414]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:38:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-14d57bd7-4e2e-4d97-85c0-5217d9f88315 tempest-VolumesActionsTest-1113820978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69e8216c-c375-48d0-a5a2-29e1a94ff302 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:12 devstack sudo[105375]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-1a05d393-e259-485d-8a0e-198037282d0e req-0fb8bcef-dd64-47c1-acbb-2e5f260d3077 tempest-VolumesSnapshotsTestJSON-1321212680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf" returned: 0 in 1.099s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-1a05d393-e259-485d-8a0e-198037282d0e req-0fb8bcef-dd64-47c1-acbb-2e5f260d3077 tempest-VolumesSnapshotsTestJSON-1321212680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf.997e97ee-70c7-4066-90e6-17866ac88a33 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:12 devstack sudo[105389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf.997e97ee-70c7-4066-90e6-17866ac88a33 Jun 23 16:38:12 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:12 devstack sudo[105388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69e8216c-c375-48d0-a5a2-29e1a94ff302 Jun 23 16:38:12 devstack sudo[105388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:12 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5472c3c8-e4fa-43d1-87dd-0b800e3b1223 tempest-VolumeQuotasAdminTestJSON-1348781368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-572519db-cffe-4171-a60f-4f2855bac12f" returned: 0 in 0.842s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:12 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-5472c3c8-e4fa-43d1-87dd-0b800e3b1223 tempest-VolumeQuotasAdminTestJSON-1348781368 None] <== create_volume: return (2172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:38:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5472c3c8-e4fa-43d1-87dd-0b800e3b1223 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.175s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:38:12 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5472c3c8-e4fa-43d1-87dd-0b800e3b1223 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3883f74d-8595-44ce-bc2d-b59ef4bfc827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-572519db-cffe-4171-a60f-4f2855bac12f', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:12 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5472c3c8-e4fa-43d1-87dd-0b800e3b1223 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (290f53e5-fc71-4e22-82ee-8b869f34b35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:12 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-5472c3c8-e4fa-43d1-87dd-0b800e3b1223 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Volume volume-572519db-cffe-4171-a60f-4f2855bac12f (572519db-cffe-4171-a60f-4f2855bac12f): created successfully Jun 23 16:38:12 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5472c3c8-e4fa-43d1-87dd-0b800e3b1223 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (290f53e5-fc71-4e22-82ee-8b869f34b35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:12 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5472c3c8-e4fa-43d1-87dd-0b800e3b1223 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Flow 'volume_create_manager' (5c99253c-abc5-4892-85b7-35b2a906b8bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:38:12 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-5472c3c8-e4fa-43d1-87dd-0b800e3b1223 tempest-VolumeQuotasAdminTestJSON-1348781368 None] Created volume successfully. Jun 23 16:38:12 devstack sudo[105388]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-14d57bd7-4e2e-4d97-85c0-5217d9f88315 tempest-VolumesActionsTest-1113820978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69e8216c-c375-48d0-a5a2-29e1a94ff302" returned: 0 in 0.992s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-14d57bd7-4e2e-4d97-85c0-5217d9f88315 tempest-VolumesActionsTest-1113820978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69e8216c-c375-48d0-a5a2-29e1a94ff302 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:12 devstack sudo[105400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69e8216c-c375-48d0-a5a2-29e1a94ff302 Jun 23 16:38:12 devstack sudo[105400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:13 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-1a05d393-e259-485d-8a0e-198037282d0e req-0fb8bcef-dd64-47c1-acbb-2e5f260d3077 tempest-VolumesSnapshotsTestJSON-1321212680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf.997e97ee-70c7-4066-90e6-17866ac88a33" returned: 0 in 1.032s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-1a05d393-e259-485d-8a0e-198037282d0e req-0fb8bcef-dd64-47c1-acbb-2e5f260d3077 tempest-VolumesSnapshotsTestJSON-1321212680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf.997e97ee-70c7-4066-90e6-17866ac88a33 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:13 devstack sudo[105402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf.997e97ee-70c7-4066-90e6-17866ac88a33 Jun 23 16:38:13 devstack sudo[105402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:13 devstack sudo[105400]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-14d57bd7-4e2e-4d97-85c0-5217d9f88315 tempest-VolumesActionsTest-1113820978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69e8216c-c375-48d0-a5a2-29e1a94ff302" returned: 0 in 0.762s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:13 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-14d57bd7-4e2e-4d97-85c0-5217d9f88315 tempest-VolumesActionsTest-1113820978 None] Lock "cinder-quobyte-69e8216c-c375-48d0-a5a2-29e1a94ff302" released by "delete_volume" :: held 1.825s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:38:13 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-14d57bd7-4e2e-4d97-85c0-5217d9f88315 tempest-VolumesActionsTest-1113820978 None] Created reservations ['1c3ade33-1064-4eb2-bd52-cdbfc789a8fd', '201d423a-fc33-402a-82a6-946551502d22', '13459b6b-f3e2-4850-b509-a1aa5645ad55', '54c3b888-288b-4191-97e8-38907d7d7ee1'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:38:13 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-4f1794e0-8138-456f-a6e0-8d5b87d02674 tempest-VolumeQuotasAdminTestJSON-2141335745 None] Transfer volume completed successfully. Jun 23 16:38:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-14d57bd7-4e2e-4d97-85c0-5217d9f88315 tempest-VolumesActionsTest-1113820978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:38:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-14d57bd7-4e2e-4d97-85c0-5217d9f88315 tempest-VolumesActionsTest-1113820978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:38:13 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-14d57bd7-4e2e-4d97-85c0-5217d9f88315 tempest-VolumesActionsTest-1113820978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:38:13 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-14d57bd7-4e2e-4d97-85c0-5217d9f88315 tempest-VolumesActionsTest-1113820978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:38:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-14d57bd7-4e2e-4d97-85c0-5217d9f88315 tempest-VolumesActionsTest-1113820978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:38:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-14d57bd7-4e2e-4d97-85c0-5217d9f88315 tempest-VolumesActionsTest-1113820978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:13 devstack sudo[105402]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-1a05d393-e259-485d-8a0e-198037282d0e req-0fb8bcef-dd64-47c1-acbb-2e5f260d3077 tempest-VolumesSnapshotsTestJSON-1321212680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf.997e97ee-70c7-4066-90e6-17866ac88a33" returned: 0 in 0.860s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:13 devstack sudo[105406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:38:13 devstack sudo[105406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:13 devstack cinder-volume[93788]: DEBUG cinder.coordination [req-1a05d393-e259-485d-8a0e-198037282d0e req-0fb8bcef-dd64-47c1-acbb-2e5f260d3077 tempest-VolumesSnapshotsTestJSON-1321212680 None] Lock "cinder-quobyte-997e97ee-70c7-4066-90e6-17866ac88a33" released by "_delete_snapshot" :: held 4.134s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:38:13 devstack cinder-volume[93788]: DEBUG cinder.coordination [req-1a05d393-e259-485d-8a0e-198037282d0e req-0fb8bcef-dd64-47c1-acbb-2e5f260d3077 tempest-VolumesSnapshotsTestJSON-1321212680 None] Lock "cinder-quobyte-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf" released by "delete_snapshot" :: held 4.169s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:38:14 devstack cinder-volume[93788]: DEBUG cinder.quota [req-1a05d393-e259-485d-8a0e-198037282d0e req-0fb8bcef-dd64-47c1-acbb-2e5f260d3077 tempest-VolumesSnapshotsTestJSON-1321212680 None] Created reservations ['e5d2ef44-97a7-4839-b511-9f8be3f181d8', 'dd84bde9-77e9-44d8-a872-83d2f77ec6b9', '1acaa8fa-3c53-4b66-9d66-25c3afb8724a', '1e5a48ee-6b89-48ed-9ccc-f91e9524adb1'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:38:14 devstack cinder-volume[93788]: INFO cinder.volume.manager [req-1a05d393-e259-485d-8a0e-198037282d0e req-0fb8bcef-dd64-47c1-acbb-2e5f260d3077 tempest-VolumesSnapshotsTestJSON-1321212680 None] Delete snapshot completed successfully. Jun 23 16:38:14 devstack cinder-volume[93788]: DEBUG cinder.coordination [req-1a05d393-e259-485d-8a0e-198037282d0e req-0fb8bcef-dd64-47c1-acbb-2e5f260d3077 tempest-VolumesSnapshotsTestJSON-1321212680 None] Lock "cinder-997e97ee-70c7-4066-90e6-17866ac88a33-delete_snapshot" released by "delete_snapshot" :: held 4.445s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:38:14 devstack sudo[105406]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-14d57bd7-4e2e-4d97-85c0-5217d9f88315 tempest-VolumesActionsTest-1113820978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.921s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:14 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-14d57bd7-4e2e-4d97-85c0-5217d9f88315 tempest-VolumesActionsTest-1113820978 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:38:14 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-14d57bd7-4e2e-4d97-85c0-5217d9f88315 tempest-VolumesActionsTest-1113820978 None] Deleted volume successfully. Jun 23 16:38:14 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-14d57bd7-4e2e-4d97-85c0-5217d9f88315 tempest-VolumesActionsTest-1113820978 None] Lock "cinder-69e8216c-c375-48d0-a5a2-29e1a94ff302-delete_volume" released by "delete_volume" :: held 3.097s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:38:14 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-47a9ed61-d85b-4b94-acf5-c145a74fc8af tempest-VolumeQuotasAdminTestJSON-612238203 None] Acquiring lock "cinder-572519db-cffe-4171-a60f-4f2855bac12f-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:38:14 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-47a9ed61-d85b-4b94-acf5-c145a74fc8af tempest-VolumeQuotasAdminTestJSON-612238203 None] Lock "cinder-572519db-cffe-4171-a60f-4f2855bac12f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:38:14 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-47a9ed61-d85b-4b94-acf5-c145a74fc8af tempest-VolumeQuotasAdminTestJSON-612238203 None] Acquiring lock "cinder-quobyte-572519db-cffe-4171-a60f-4f2855bac12f" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:38:14 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-47a9ed61-d85b-4b94-acf5-c145a74fc8af tempest-VolumeQuotasAdminTestJSON-612238203 None] Lock "cinder-quobyte-572519db-cffe-4171-a60f-4f2855bac12f" acquired by "delete_volume" :: waited 0.030s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:38:15 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ba1cd5-e6cc-41b5-a99a-8c0abb814266]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:38:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-47a9ed61-d85b-4b94-acf5-c145a74fc8af tempest-VolumeQuotasAdminTestJSON-612238203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-572519db-cffe-4171-a60f-4f2855bac12f {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:15 devstack sudo[105411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-572519db-cffe-4171-a60f-4f2855bac12f Jun 23 16:38:15 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:15 devstack cinder-volume[93788]: DEBUG cinder.coordination [req-6a8247cb-c62b-40a8-8e1b-2680808a7531 req-df88be07-7675-4586-9adf-34e0f1b9c6c6 tempest-VolumesSnapshotsTestJSON-1321212680 None] Acquiring lock "cinder-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:38:15 devstack cinder-volume[93788]: DEBUG cinder.coordination [req-6a8247cb-c62b-40a8-8e1b-2680808a7531 req-df88be07-7675-4586-9adf-34e0f1b9c6c6 tempest-VolumesSnapshotsTestJSON-1321212680 None] Lock "cinder-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:38:15 devstack cinder-volume[93788]: DEBUG cinder.coordination [req-6a8247cb-c62b-40a8-8e1b-2680808a7531 req-df88be07-7675-4586-9adf-34e0f1b9c6c6 tempest-VolumesSnapshotsTestJSON-1321212680 None] Acquiring lock "cinder-quobyte-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:38:15 devstack cinder-volume[93788]: DEBUG cinder.coordination [req-6a8247cb-c62b-40a8-8e1b-2680808a7531 req-df88be07-7675-4586-9adf-34e0f1b9c6c6 tempest-VolumesSnapshotsTestJSON-1321212680 None] Lock "cinder-quobyte-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf" acquired by "delete_volume" :: waited 0.022s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:38:15 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1935f94-0d51-40ae-a4e4-8caaf02bad14]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:38:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-6a8247cb-c62b-40a8-8e1b-2680808a7531 req-df88be07-7675-4586-9adf-34e0f1b9c6c6 tempest-VolumesSnapshotsTestJSON-1321212680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:15 devstack sudo[105413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf Jun 23 16:38:15 devstack sudo[105413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-47a9ed61-d85b-4b94-acf5-c145a74fc8af tempest-VolumeQuotasAdminTestJSON-612238203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-572519db-cffe-4171-a60f-4f2855bac12f" returned: 0 in 1.001s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:16 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-47a9ed61-d85b-4b94-acf5-c145a74fc8af tempest-VolumeQuotasAdminTestJSON-612238203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-572519db-cffe-4171-a60f-4f2855bac12f {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:16 devstack sudo[105420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-572519db-cffe-4171-a60f-4f2855bac12f Jun 23 16:38:16 devstack sudo[105420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:16 devstack sudo[105413]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-6a8247cb-c62b-40a8-8e1b-2680808a7531 req-df88be07-7675-4586-9adf-34e0f1b9c6c6 tempest-VolumesSnapshotsTestJSON-1321212680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf" returned: 0 in 0.968s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-6a8247cb-c62b-40a8-8e1b-2680808a7531 req-df88be07-7675-4586-9adf-34e0f1b9c6c6 tempest-VolumesSnapshotsTestJSON-1321212680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:16 devstack sudo[105425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf Jun 23 16:38:16 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:16 devstack sudo[105420]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-47a9ed61-d85b-4b94-acf5-c145a74fc8af tempest-VolumeQuotasAdminTestJSON-612238203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-572519db-cffe-4171-a60f-4f2855bac12f" returned: 0 in 0.924s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:16 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-47a9ed61-d85b-4b94-acf5-c145a74fc8af tempest-VolumeQuotasAdminTestJSON-612238203 None] Lock "cinder-quobyte-572519db-cffe-4171-a60f-4f2855bac12f" released by "delete_volume" :: held 1.980s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:38:17 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-47a9ed61-d85b-4b94-acf5-c145a74fc8af tempest-VolumeQuotasAdminTestJSON-612238203 None] Created reservations ['ff3344bf-06b9-4843-81f3-3f6bdaa6df84', '26a34364-4055-4636-8fce-9d1670e26ff2', '272ace71-5f9c-4541-9c29-36ab826c1fb1', 'ef3be120-d4f0-4d9f-b839-9b613cd8fb1b'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:38:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-47a9ed61-d85b-4b94-acf5-c145a74fc8af tempest-VolumeQuotasAdminTestJSON-612238203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:38:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-47a9ed61-d85b-4b94-acf5-c145a74fc8af tempest-VolumeQuotasAdminTestJSON-612238203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:38:17 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-47a9ed61-d85b-4b94-acf5-c145a74fc8af tempest-VolumeQuotasAdminTestJSON-612238203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:38:17 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-47a9ed61-d85b-4b94-acf5-c145a74fc8af tempest-VolumeQuotasAdminTestJSON-612238203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:38:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-47a9ed61-d85b-4b94-acf5-c145a74fc8af tempest-VolumeQuotasAdminTestJSON-612238203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:38:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-47a9ed61-d85b-4b94-acf5-c145a74fc8af tempest-VolumeQuotasAdminTestJSON-612238203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:17 devstack sudo[105429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:38:17 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:17 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-6a8247cb-c62b-40a8-8e1b-2680808a7531 req-df88be07-7675-4586-9adf-34e0f1b9c6c6 tempest-VolumesSnapshotsTestJSON-1321212680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf" returned: 0 in 0.834s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:17 devstack cinder-volume[93788]: DEBUG cinder.coordination [req-6a8247cb-c62b-40a8-8e1b-2680808a7531 req-df88be07-7675-4586-9adf-34e0f1b9c6c6 tempest-VolumesSnapshotsTestJSON-1321212680 None] Lock "cinder-quobyte-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf" released by "delete_volume" :: held 1.900s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:38:17 devstack cinder-volume[93788]: DEBUG cinder.quota [req-6a8247cb-c62b-40a8-8e1b-2680808a7531 req-df88be07-7675-4586-9adf-34e0f1b9c6c6 tempest-VolumesSnapshotsTestJSON-1321212680 None] Created reservations ['974078cf-780f-4bcd-b3e7-cf207a4daecd', '7a20b118-9cad-48c5-a39f-cc4c647f55d5', '2c3c38e6-4d2e-4368-a69b-b253b216aeca', '62c3c368-b10d-4a2a-8146-f36ebd279e88'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:38:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-6a8247cb-c62b-40a8-8e1b-2680808a7531 req-df88be07-7675-4586-9adf-34e0f1b9c6c6 tempest-VolumesSnapshotsTestJSON-1321212680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:38:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-6a8247cb-c62b-40a8-8e1b-2680808a7531 req-df88be07-7675-4586-9adf-34e0f1b9c6c6 tempest-VolumesSnapshotsTestJSON-1321212680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:38:17 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [req-6a8247cb-c62b-40a8-8e1b-2680808a7531 req-df88be07-7675-4586-9adf-34e0f1b9c6c6 tempest-VolumesSnapshotsTestJSON-1321212680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:38:17 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [req-6a8247cb-c62b-40a8-8e1b-2680808a7531 req-df88be07-7675-4586-9adf-34e0f1b9c6c6 tempest-VolumesSnapshotsTestJSON-1321212680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:38:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-6a8247cb-c62b-40a8-8e1b-2680808a7531 req-df88be07-7675-4586-9adf-34e0f1b9c6c6 tempest-VolumesSnapshotsTestJSON-1321212680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:38:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-6a8247cb-c62b-40a8-8e1b-2680808a7531 req-df88be07-7675-4586-9adf-34e0f1b9c6c6 tempest-VolumesSnapshotsTestJSON-1321212680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:17 devstack sudo[105431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:38:17 devstack sudo[105431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:18 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:18 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-47a9ed61-d85b-4b94-acf5-c145a74fc8af tempest-VolumeQuotasAdminTestJSON-612238203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.206s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:18 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-47a9ed61-d85b-4b94-acf5-c145a74fc8af tempest-VolumeQuotasAdminTestJSON-612238203 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:38:18 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-47a9ed61-d85b-4b94-acf5-c145a74fc8af tempest-VolumeQuotasAdminTestJSON-612238203 None] Deleted volume successfully. Jun 23 16:38:18 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-47a9ed61-d85b-4b94-acf5-c145a74fc8af tempest-VolumeQuotasAdminTestJSON-612238203 None] Lock "cinder-572519db-cffe-4171-a60f-4f2855bac12f-delete_volume" released by "delete_volume" :: held 3.471s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:38:18 devstack sudo[105431]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:18 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-6a8247cb-c62b-40a8-8e1b-2680808a7531 req-df88be07-7675-4586-9adf-34e0f1b9c6c6 tempest-VolumesSnapshotsTestJSON-1321212680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.372s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:18 devstack cinder-volume[93788]: DEBUG cinder.manager [req-6a8247cb-c62b-40a8-8e1b-2680808a7531 req-df88be07-7675-4586-9adf-34e0f1b9c6c6 tempest-VolumesSnapshotsTestJSON-1321212680 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:38:18 devstack cinder-volume[93788]: INFO cinder.volume.manager [req-6a8247cb-c62b-40a8-8e1b-2680808a7531 req-df88be07-7675-4586-9adf-34e0f1b9c6c6 tempest-VolumesSnapshotsTestJSON-1321212680 None] Deleted volume successfully. Jun 23 16:38:19 devstack cinder-volume[93788]: DEBUG cinder.coordination [req-6a8247cb-c62b-40a8-8e1b-2680808a7531 req-df88be07-7675-4586-9adf-34e0f1b9c6c6 tempest-VolumesSnapshotsTestJSON-1321212680 None] Lock "cinder-9bcf134c-8fd7-40cf-b79f-6eb167ca09cf-delete_volume" released by "delete_volume" :: held 3.596s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:38:25 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-edb05a1c-3b16-40a8-a709-2447682ca94b tempest-GroupsTest-2100010410 None] Group tempest-Group1-1998134397: creating Jun 23 16:38:25 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-edb05a1c-3b16-40a8-a709-2447682ca94b tempest-GroupsTest-2100010410 None] Group tempest-Group1-1998134397: created successfully Jun 23 16:38:25 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-edb05a1c-3b16-40a8-a709-2447682ca94b tempest-GroupsTest-2100010410 None] Create group completed successfully. Jun 23 16:38:26 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-75857ee3-34c9-4867-a135-2d74a2159d9f tempest-GroupsTest-2100010410 None] Group tempest-Group2-1952724613: creating Jun 23 16:38:26 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-75857ee3-34c9-4867-a135-2d74a2159d9f tempest-GroupsTest-2100010410 None] Group tempest-Group2-1952724613: created successfully Jun 23 16:38:26 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-75857ee3-34c9-4867-a135-2d74a2159d9f tempest-GroupsTest-2100010410 None] Create group completed successfully. Jun 23 16:38:28 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce207426-eafb-4ed9-904e-b8d8ceab2128 tempest-GroupsTest-2100010410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:38:28 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ce207426-eafb-4ed9-904e-b8d8ceab2128 tempest-GroupsTest-2100010410 None] Flow 'volume_create_manager' (5dd65477-336a-48ef-a1ac-68a6ae4b5044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:38:28 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ce207426-eafb-4ed9-904e-b8d8ceab2128 tempest-GroupsTest-2100010410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4892be8f-2afa-4c7e-9a05-511b13ddae9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:28 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ce207426-eafb-4ed9-904e-b8d8ceab2128 tempest-GroupsTest-2100010410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4892be8f-2afa-4c7e-9a05-511b13ddae9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1050289132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9884a6f0-f410-424a-a49b-b13152e4e396,host='devstack@QuobyteHD#QuobyteHD',id=085ca0d3-6429-44cc-ab80-3f20f915e871,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef521dfb4018495d82137f7f329466c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:38:28Z,use_quota=True,user_id='a7fa8a6c6c0c4478ac1da1661abf0651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f51addd-6bed-4e83-b35e-e50e6532301d),volume_type_id=2f51addd-6bed-4e83-b35e-e50e6532301d)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:28 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ce207426-eafb-4ed9-904e-b8d8ceab2128 tempest-GroupsTest-2100010410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (409195e7-55b1-4203-8f6d-fb3533e95294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:28 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ce207426-eafb-4ed9-904e-b8d8ceab2128 tempest-GroupsTest-2100010410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (409195e7-55b1-4203-8f6d-fb3533e95294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:28 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ce207426-eafb-4ed9-904e-b8d8ceab2128 tempest-GroupsTest-2100010410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (606b3395-068f-472d-9a6f-0ce0f51f522f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:28 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ce207426-eafb-4ed9-904e-b8d8ceab2128 tempest-GroupsTest-2100010410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (606b3395-068f-472d-9a6f-0ce0f51f522f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '085ca0d3-6429-44cc-ab80-3f20f915e871', 'volume_name': 'volume-085ca0d3-6429-44cc-ab80-3f20f915e871', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:28 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ce207426-eafb-4ed9-904e-b8d8ceab2128 tempest-GroupsTest-2100010410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a5f16d1-8815-48c5-8fe0-5eabd46d5dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:28 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ce207426-eafb-4ed9-904e-b8d8ceab2128 tempest-GroupsTest-2100010410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a5f16d1-8815-48c5-8fe0-5eabd46d5dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:28 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ce207426-eafb-4ed9-904e-b8d8ceab2128 tempest-GroupsTest-2100010410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f322469a-3527-4d5c-8b64-413db26e987a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:28 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-ce207426-eafb-4ed9-904e-b8d8ceab2128 tempest-GroupsTest-2100010410 None] Volume 085ca0d3-6429-44cc-ab80-3f20f915e871: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-085ca0d3-6429-44cc-ab80-3f20f915e871', 'volume_size': 1} Jun 23 16:38:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ce207426-eafb-4ed9-904e-b8d8ceab2128 tempest-GroupsTest-2100010410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:38:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ce207426-eafb-4ed9-904e-b8d8ceab2128 tempest-GroupsTest-2100010410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:38:28 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-ce207426-eafb-4ed9-904e-b8d8ceab2128 tempest-GroupsTest-2100010410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9884a6f0-f410-424a-a49b-b13152e4e396,created_at=2026-06-23T14:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1050289132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9884a6f0-f410-424a-a49b-b13152e4e396,host='devstack@QuobyteHD#QuobyteHD',id=085ca0d3-6429-44cc-ab80-3f20f915e871,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef521dfb4018495d82137f7f329466c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:38:28Z,use_quota=True,user_id='a7fa8a6c6c0c4478ac1da1661abf0651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f51addd-6bed-4e83-b35e-e50e6532301d),volume_type_id=2f51addd-6bed-4e83-b35e-e50e6532301d)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:38:28 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-ce207426-eafb-4ed9-904e-b8d8ceab2128 tempest-GroupsTest-2100010410 None] Creating volume 085ca0d3-6429-44cc-ab80-3f20f915e871 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:38:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ce207426-eafb-4ed9-904e-b8d8ceab2128 tempest-GroupsTest-2100010410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:38:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ce207426-eafb-4ed9-904e-b8d8ceab2128 tempest-GroupsTest-2100010410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:38:28 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-ce207426-eafb-4ed9-904e-b8d8ceab2128 tempest-GroupsTest-2100010410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:38:28 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-ce207426-eafb-4ed9-904e-b8d8ceab2128 tempest-GroupsTest-2100010410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:38:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ce207426-eafb-4ed9-904e-b8d8ceab2128 tempest-GroupsTest-2100010410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:38:28 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-ce207426-eafb-4ed9-904e-b8d8ceab2128 tempest-GroupsTest-2100010410 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:38:28 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-ce207426-eafb-4ed9-904e-b8d8ceab2128 tempest-GroupsTest-2100010410 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:38:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ce207426-eafb-4ed9-904e-b8d8ceab2128 tempest-GroupsTest-2100010410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-085ca0d3-6429-44cc-ab80-3f20f915e871 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:28 devstack sudo[105440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-085ca0d3-6429-44cc-ab80-3f20f915e871 1073741824 Jun 23 16:38:28 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:29 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ce207426-eafb-4ed9-904e-b8d8ceab2128 tempest-GroupsTest-2100010410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-085ca0d3-6429-44cc-ab80-3f20f915e871 1073741824" returned: 0 in 1.198s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ce207426-eafb-4ed9-904e-b8d8ceab2128 tempest-GroupsTest-2100010410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-085ca0d3-6429-44cc-ab80-3f20f915e871 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:29 devstack sudo[105447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-085ca0d3-6429-44cc-ab80-3f20f915e871 Jun 23 16:38:29 devstack sudo[105447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:30 devstack sudo[105447]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ce207426-eafb-4ed9-904e-b8d8ceab2128 tempest-GroupsTest-2100010410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-085ca0d3-6429-44cc-ab80-3f20f915e871" returned: 0 in 1.119s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:30 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-ce207426-eafb-4ed9-904e-b8d8ceab2128 tempest-GroupsTest-2100010410 None] <== create_volume: return (2410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:38:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ce207426-eafb-4ed9-904e-b8d8ceab2128 tempest-GroupsTest-2100010410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.414s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:38:30 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ce207426-eafb-4ed9-904e-b8d8ceab2128 tempest-GroupsTest-2100010410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f322469a-3527-4d5c-8b64-413db26e987a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-085ca0d3-6429-44cc-ab80-3f20f915e871', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:30 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ce207426-eafb-4ed9-904e-b8d8ceab2128 tempest-GroupsTest-2100010410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02539a4c-7f2e-4690-98c7-6777aecb0dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:30 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-ce207426-eafb-4ed9-904e-b8d8ceab2128 tempest-GroupsTest-2100010410 None] Volume volume-085ca0d3-6429-44cc-ab80-3f20f915e871 (085ca0d3-6429-44cc-ab80-3f20f915e871): created successfully Jun 23 16:38:30 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ce207426-eafb-4ed9-904e-b8d8ceab2128 tempest-GroupsTest-2100010410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02539a4c-7f2e-4690-98c7-6777aecb0dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:30 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ce207426-eafb-4ed9-904e-b8d8ceab2128 tempest-GroupsTest-2100010410 None] Flow 'volume_create_manager' (5dd65477-336a-48ef-a1ac-68a6ae4b5044) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:38:31 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-ce207426-eafb-4ed9-904e-b8d8ceab2128 tempest-GroupsTest-2100010410 None] Created volume successfully. Jun 23 16:38:32 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-080e9588-a941-4b31-80c5-b590ab14473c tempest-VolumeQuotasNegativeTestJSON-965676506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:38:32 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-080e9588-a941-4b31-80c5-b590ab14473c tempest-VolumeQuotasNegativeTestJSON-965676506 None] Flow 'volume_create_manager' (8631839d-0b29-476c-b434-853d6c86089f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:38:32 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-080e9588-a941-4b31-80c5-b590ab14473c tempest-VolumeQuotasNegativeTestJSON-965676506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd6d4dc5-ba65-46c1-87ca-87483e240315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:32 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-080e9588-a941-4b31-80c5-b590ab14473c tempest-VolumeQuotasNegativeTestJSON-965676506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd6d4dc5-ba65-46c1-87ca-87483e240315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:38:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-963273077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=051f7544-9ae5-4714-b0c2-99aaa4403d5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f9b528acb5f48d784452c97f7275513',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:38:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:38:32Z,use_quota=True,user_id='9eee478c7a364eb08089fe50b9118e57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:32 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-080e9588-a941-4b31-80c5-b590ab14473c tempest-VolumeQuotasNegativeTestJSON-965676506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7170265d-4f79-4e57-9c86-bdb9070a6ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:32 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-080e9588-a941-4b31-80c5-b590ab14473c tempest-VolumeQuotasNegativeTestJSON-965676506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7170265d-4f79-4e57-9c86-bdb9070a6ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:32 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-080e9588-a941-4b31-80c5-b590ab14473c tempest-VolumeQuotasNegativeTestJSON-965676506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e50e2a6-ddbc-4854-afff-dd7b97eae45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:32 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-080e9588-a941-4b31-80c5-b590ab14473c tempest-VolumeQuotasNegativeTestJSON-965676506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e50e2a6-ddbc-4854-afff-dd7b97eae45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '051f7544-9ae5-4714-b0c2-99aaa4403d5b', 'volume_name': 'volume-051f7544-9ae5-4714-b0c2-99aaa4403d5b', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:32 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-080e9588-a941-4b31-80c5-b590ab14473c tempest-VolumeQuotasNegativeTestJSON-965676506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9904035f-3497-43e1-b8d6-8b69ecb60790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:32 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-080e9588-a941-4b31-80c5-b590ab14473c tempest-VolumeQuotasNegativeTestJSON-965676506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9904035f-3497-43e1-b8d6-8b69ecb60790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:32 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-080e9588-a941-4b31-80c5-b590ab14473c tempest-VolumeQuotasNegativeTestJSON-965676506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb64d547-d298-46a7-88a1-ce570902ea8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:32 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-080e9588-a941-4b31-80c5-b590ab14473c tempest-VolumeQuotasNegativeTestJSON-965676506 None] Volume 051f7544-9ae5-4714-b0c2-99aaa4403d5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-051f7544-9ae5-4714-b0c2-99aaa4403d5b', 'volume_size': 1} Jun 23 16:38:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-080e9588-a941-4b31-80c5-b590ab14473c tempest-VolumeQuotasNegativeTestJSON-965676506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:38:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-080e9588-a941-4b31-80c5-b590ab14473c tempest-VolumeQuotasNegativeTestJSON-965676506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:38:32 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-080e9588-a941-4b31-80c5-b590ab14473c tempest-VolumeQuotasNegativeTestJSON-965676506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:38:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-963273077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=051f7544-9ae5-4714-b0c2-99aaa4403d5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f9b528acb5f48d784452c97f7275513',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:38:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:38:32Z,use_quota=True,user_id='9eee478c7a364eb08089fe50b9118e57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:38:32 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-080e9588-a941-4b31-80c5-b590ab14473c tempest-VolumeQuotasNegativeTestJSON-965676506 None] Creating volume 051f7544-9ae5-4714-b0c2-99aaa4403d5b {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:38:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-080e9588-a941-4b31-80c5-b590ab14473c tempest-VolumeQuotasNegativeTestJSON-965676506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:38:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-080e9588-a941-4b31-80c5-b590ab14473c tempest-VolumeQuotasNegativeTestJSON-965676506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:38:32 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-080e9588-a941-4b31-80c5-b590ab14473c tempest-VolumeQuotasNegativeTestJSON-965676506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:38:32 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-080e9588-a941-4b31-80c5-b590ab14473c tempest-VolumeQuotasNegativeTestJSON-965676506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:38:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-080e9588-a941-4b31-80c5-b590ab14473c tempest-VolumeQuotasNegativeTestJSON-965676506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:38:32 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-080e9588-a941-4b31-80c5-b590ab14473c tempest-VolumeQuotasNegativeTestJSON-965676506 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:38:32 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-080e9588-a941-4b31-80c5-b590ab14473c tempest-VolumeQuotasNegativeTestJSON-965676506 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:38:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-080e9588-a941-4b31-80c5-b590ab14473c tempest-VolumeQuotasNegativeTestJSON-965676506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-051f7544-9ae5-4714-b0c2-99aaa4403d5b 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:32 devstack sudo[105450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-051f7544-9ae5-4714-b0c2-99aaa4403d5b 1073741824 Jun 23 16:38:32 devstack sudo[105450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:33 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-1dc85c62-4301-48bf-89ca-c0257d52fbba tempest-GroupsTest-2100010410 None] Acquiring lock "cinder-quobyte-085ca0d3-6429-44cc-ab80-3f20f915e871" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:38:33 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-1dc85c62-4301-48bf-89ca-c0257d52fbba tempest-GroupsTest-2100010410 None] Lock "cinder-quobyte-085ca0d3-6429-44cc-ab80-3f20f915e871" acquired by "delete_volume" :: waited 0.018s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:38:33 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8ef9eb-1d0b-45cc-bb90-e424a2ee980b]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:38:33 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1dc85c62-4301-48bf-89ca-c0257d52fbba tempest-GroupsTest-2100010410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-085ca0d3-6429-44cc-ab80-3f20f915e871 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:33 devstack sudo[105486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-085ca0d3-6429-44cc-ab80-3f20f915e871 Jun 23 16:38:33 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:33 devstack sudo[105450]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:33 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-080e9588-a941-4b31-80c5-b590ab14473c tempest-VolumeQuotasNegativeTestJSON-965676506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-051f7544-9ae5-4714-b0c2-99aaa4403d5b 1073741824" returned: 0 in 1.279s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:33 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-080e9588-a941-4b31-80c5-b590ab14473c tempest-VolumeQuotasNegativeTestJSON-965676506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-051f7544-9ae5-4714-b0c2-99aaa4403d5b {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:34 devstack sudo[105494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-051f7544-9ae5-4714-b0c2-99aaa4403d5b Jun 23 16:38:34 devstack sudo[105494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:34 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1dc85c62-4301-48bf-89ca-c0257d52fbba tempest-GroupsTest-2100010410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-085ca0d3-6429-44cc-ab80-3f20f915e871" returned: 0 in 1.179s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1dc85c62-4301-48bf-89ca-c0257d52fbba tempest-GroupsTest-2100010410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-085ca0d3-6429-44cc-ab80-3f20f915e871 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:34 devstack sudo[105499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-085ca0d3-6429-44cc-ab80-3f20f915e871 Jun 23 16:38:34 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:34 devstack sudo[105494]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-080e9588-a941-4b31-80c5-b590ab14473c tempest-VolumeQuotasNegativeTestJSON-965676506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-051f7544-9ae5-4714-b0c2-99aaa4403d5b" returned: 0 in 0.991s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:34 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-080e9588-a941-4b31-80c5-b590ab14473c tempest-VolumeQuotasNegativeTestJSON-965676506 None] <== create_volume: return (2327ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:38:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-080e9588-a941-4b31-80c5-b590ab14473c tempest-VolumeQuotasNegativeTestJSON-965676506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.330s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:38:34 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-080e9588-a941-4b31-80c5-b590ab14473c tempest-VolumeQuotasNegativeTestJSON-965676506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb64d547-d298-46a7-88a1-ce570902ea8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-051f7544-9ae5-4714-b0c2-99aaa4403d5b', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:34 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-080e9588-a941-4b31-80c5-b590ab14473c tempest-VolumeQuotasNegativeTestJSON-965676506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcf9f4f6-ca6e-45b6-95e3-fa0b312d3d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:35 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-080e9588-a941-4b31-80c5-b590ab14473c tempest-VolumeQuotasNegativeTestJSON-965676506 None] Volume volume-051f7544-9ae5-4714-b0c2-99aaa4403d5b (051f7544-9ae5-4714-b0c2-99aaa4403d5b): created successfully Jun 23 16:38:35 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-080e9588-a941-4b31-80c5-b590ab14473c tempest-VolumeQuotasNegativeTestJSON-965676506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcf9f4f6-ca6e-45b6-95e3-fa0b312d3d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:35 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-080e9588-a941-4b31-80c5-b590ab14473c tempest-VolumeQuotasNegativeTestJSON-965676506 None] Flow 'volume_create_manager' (8631839d-0b29-476c-b434-853d6c86089f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:38:35 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-080e9588-a941-4b31-80c5-b590ab14473c tempest-VolumeQuotasNegativeTestJSON-965676506 None] Created volume successfully. Jun 23 16:38:35 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1dc85c62-4301-48bf-89ca-c0257d52fbba tempest-GroupsTest-2100010410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-085ca0d3-6429-44cc-ab80-3f20f915e871" returned: 0 in 1.003s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:35 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-1dc85c62-4301-48bf-89ca-c0257d52fbba tempest-GroupsTest-2100010410 None] Lock "cinder-quobyte-085ca0d3-6429-44cc-ab80-3f20f915e871" released by "delete_volume" :: held 2.279s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:38:35 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-1dc85c62-4301-48bf-89ca-c0257d52fbba tempest-GroupsTest-2100010410 None] Created reservations ['68a53d3e-c906-418d-976a-7481897d3f7f'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:38:35 devstack cinder-volume[93788]: WARNING cinder.quota [None req-1dc85c62-4301-48bf-89ca-c0257d52fbba tempest-GroupsTest-2100010410 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1454964674 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1454964674, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:38:35 devstack cinder-volume[93788]: WARNING cinder.quota [None req-1dc85c62-4301-48bf-89ca-c0257d52fbba tempest-GroupsTest-2100010410 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1454964674 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1454964674, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:38:35 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-1dc85c62-4301-48bf-89ca-c0257d52fbba tempest-GroupsTest-2100010410 None] Created reservations ['8454fbc4-a7c2-469b-978d-7f46244dff54', 'aef4983a-0c46-421a-a3e5-e8ed14400e15', '55b620e7-837e-476b-b5c4-a1dbbb7a05b5', 'fc352840-6cb1-42b6-aeac-1eb21826ccb4'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:38:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-1dc85c62-4301-48bf-89ca-c0257d52fbba tempest-GroupsTest-2100010410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:38:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-1dc85c62-4301-48bf-89ca-c0257d52fbba tempest-GroupsTest-2100010410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:38:35 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-1dc85c62-4301-48bf-89ca-c0257d52fbba tempest-GroupsTest-2100010410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:38:35 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-1dc85c62-4301-48bf-89ca-c0257d52fbba tempest-GroupsTest-2100010410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:38:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-1dc85c62-4301-48bf-89ca-c0257d52fbba tempest-GroupsTest-2100010410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:38:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1dc85c62-4301-48bf-89ca-c0257d52fbba tempest-GroupsTest-2100010410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:35 devstack sudo[105503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:38:35 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:36 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1dc85c62-4301-48bf-89ca-c0257d52fbba tempest-GroupsTest-2100010410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.831s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:36 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-1dc85c62-4301-48bf-89ca-c0257d52fbba tempest-GroupsTest-2100010410 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:38:36 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-1dc85c62-4301-48bf-89ca-c0257d52fbba tempest-GroupsTest-2100010410 None] Delete group completed successfully. Jun 23 16:38:37 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:SELECT=71,cinder:UPDATE=93,cinder:INSERT=20,cinder:DELETE=8 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:38:37 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-fb256d85-514b-4d21-9f6e-6e61e4dfb213 tempest-GroupsTest-2100010410 None] Created reservations ['c0b7cd7a-cb31-460f-bcb1-b9753725d9dd'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:38:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-fb256d85-514b-4d21-9f6e-6e61e4dfb213 tempest-GroupsTest-2100010410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:38:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-fb256d85-514b-4d21-9f6e-6e61e4dfb213 tempest-GroupsTest-2100010410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:38:37 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-fb256d85-514b-4d21-9f6e-6e61e4dfb213 tempest-GroupsTest-2100010410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:38:37 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-fb256d85-514b-4d21-9f6e-6e61e4dfb213 tempest-GroupsTest-2100010410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:38:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-fb256d85-514b-4d21-9f6e-6e61e4dfb213 tempest-GroupsTest-2100010410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:38:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-fb256d85-514b-4d21-9f6e-6e61e4dfb213 tempest-GroupsTest-2100010410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:37 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:38:37 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:37 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-230ef472-a18d-40c1-b79a-ce3bc5fe59ba tempest-VolumeQuotasNegativeTestJSON-965676506 None] Acquiring lock "cinder-051f7544-9ae5-4714-b0c2-99aaa4403d5b-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:38:37 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-230ef472-a18d-40c1-b79a-ce3bc5fe59ba tempest-VolumeQuotasNegativeTestJSON-965676506 None] Lock "cinder-051f7544-9ae5-4714-b0c2-99aaa4403d5b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:38:37 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-230ef472-a18d-40c1-b79a-ce3bc5fe59ba tempest-VolumeQuotasNegativeTestJSON-965676506 None] Acquiring lock "cinder-quobyte-051f7544-9ae5-4714-b0c2-99aaa4403d5b" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:38:37 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-230ef472-a18d-40c1-b79a-ce3bc5fe59ba tempest-VolumeQuotasNegativeTestJSON-965676506 None] Lock "cinder-quobyte-051f7544-9ae5-4714-b0c2-99aaa4403d5b" acquired by "delete_volume" :: waited 0.019s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:38:37 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e9d828-7fe3-47a2-bcf5-c56da5a43a6b]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:38:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-230ef472-a18d-40c1-b79a-ce3bc5fe59ba tempest-VolumeQuotasNegativeTestJSON-965676506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-051f7544-9ae5-4714-b0c2-99aaa4403d5b {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:37 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-051f7544-9ae5-4714-b0c2-99aaa4403d5b Jun 23 16:38:37 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:38 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-fb256d85-514b-4d21-9f6e-6e61e4dfb213 tempest-GroupsTest-2100010410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.905s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:38 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-fb256d85-514b-4d21-9f6e-6e61e4dfb213 tempest-GroupsTest-2100010410 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:38:38 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-fb256d85-514b-4d21-9f6e-6e61e4dfb213 tempest-GroupsTest-2100010410 None] Delete group completed successfully. Jun 23 16:38:38 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-230ef472-a18d-40c1-b79a-ce3bc5fe59ba tempest-VolumeQuotasNegativeTestJSON-965676506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-051f7544-9ae5-4714-b0c2-99aaa4403d5b" returned: 0 in 1.125s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-230ef472-a18d-40c1-b79a-ce3bc5fe59ba tempest-VolumeQuotasNegativeTestJSON-965676506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-051f7544-9ae5-4714-b0c2-99aaa4403d5b {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:38 devstack sudo[105514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-051f7544-9ae5-4714-b0c2-99aaa4403d5b Jun 23 16:38:38 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:39 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-3569faf2-4eab-4ba2-a9bb-166946c66974 tempest-GroupsTest-2100010410 None] Group tempest-GroupsTest-Group-1831335064: creating Jun 23 16:38:39 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-3569faf2-4eab-4ba2-a9bb-166946c66974 tempest-GroupsTest-2100010410 None] Group tempest-GroupsTest-Group-1831335064: created successfully Jun 23 16:38:39 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-3569faf2-4eab-4ba2-a9bb-166946c66974 tempest-GroupsTest-2100010410 None] Create group completed successfully. Jun 23 16:38:39 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-230ef472-a18d-40c1-b79a-ce3bc5fe59ba tempest-VolumeQuotasNegativeTestJSON-965676506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-051f7544-9ae5-4714-b0c2-99aaa4403d5b" returned: 0 in 0.804s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:39 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-230ef472-a18d-40c1-b79a-ce3bc5fe59ba tempest-VolumeQuotasNegativeTestJSON-965676506 None] Lock "cinder-quobyte-051f7544-9ae5-4714-b0c2-99aaa4403d5b" released by "delete_volume" :: held 1.980s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:38:39 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-230ef472-a18d-40c1-b79a-ce3bc5fe59ba tempest-VolumeQuotasNegativeTestJSON-965676506 None] Created reservations ['9fe209a4-71c7-499c-99cd-5afe354664b4', 'b18c26cf-d291-462f-b741-320abf757416', 'f702eb8c-b554-4133-858c-1d52064f6a71', '76fc523a-5073-4011-928e-f91d99f5f5e8'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:38:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-230ef472-a18d-40c1-b79a-ce3bc5fe59ba tempest-VolumeQuotasNegativeTestJSON-965676506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:38:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-230ef472-a18d-40c1-b79a-ce3bc5fe59ba tempest-VolumeQuotasNegativeTestJSON-965676506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:38:39 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-230ef472-a18d-40c1-b79a-ce3bc5fe59ba tempest-VolumeQuotasNegativeTestJSON-965676506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:38:39 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-230ef472-a18d-40c1-b79a-ce3bc5fe59ba tempest-VolumeQuotasNegativeTestJSON-965676506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:38:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-230ef472-a18d-40c1-b79a-ce3bc5fe59ba tempest-VolumeQuotasNegativeTestJSON-965676506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:38:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-230ef472-a18d-40c1-b79a-ce3bc5fe59ba tempest-VolumeQuotasNegativeTestJSON-965676506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:39 devstack sudo[105518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:38:39 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:40 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc5123e3-3b79-4397-af0d-fa41510a7e5b tempest-VolumesTransfersV355Test-1117687244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:38:40 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bc5123e3-3b79-4397-af0d-fa41510a7e5b tempest-VolumesTransfersV355Test-1117687244 None] Flow 'volume_create_manager' (fb04de64-358e-45fc-ab14-27a00ec2e15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:38:40 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bc5123e3-3b79-4397-af0d-fa41510a7e5b tempest-VolumesTransfersV355Test-1117687244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3f3f7de-6508-48e1-84ae-71c4bf62bf14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:40 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bc5123e3-3b79-4397-af0d-fa41510a7e5b tempest-VolumesTransfersV355Test-1117687244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3f3f7de-6508-48e1-84ae-71c4bf62bf14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:38:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2025542268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1313b5f6-e57b-40a1-8e9c-43fe5241ec73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d331f00ac0b4013bd36bea7a04702dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:38:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:38:40Z,use_quota=True,user_id='719ee3a1063a4c69a8587fee402fbacf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:40 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bc5123e3-3b79-4397-af0d-fa41510a7e5b tempest-VolumesTransfersV355Test-1117687244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (499ffa9e-8212-48ea-8cec-96637a40616e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:40 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bc5123e3-3b79-4397-af0d-fa41510a7e5b tempest-VolumesTransfersV355Test-1117687244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (499ffa9e-8212-48ea-8cec-96637a40616e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:40 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bc5123e3-3b79-4397-af0d-fa41510a7e5b tempest-VolumesTransfersV355Test-1117687244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9f8a28d-c085-49a0-80f5-72f8f6614608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:40 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bc5123e3-3b79-4397-af0d-fa41510a7e5b tempest-VolumesTransfersV355Test-1117687244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9f8a28d-c085-49a0-80f5-72f8f6614608) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1313b5f6-e57b-40a1-8e9c-43fe5241ec73', 'volume_name': 'volume-1313b5f6-e57b-40a1-8e9c-43fe5241ec73', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:40 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bc5123e3-3b79-4397-af0d-fa41510a7e5b tempest-VolumesTransfersV355Test-1117687244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e804bbe-9a8d-46ec-b242-0d463fe87985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:40 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bc5123e3-3b79-4397-af0d-fa41510a7e5b tempest-VolumesTransfersV355Test-1117687244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e804bbe-9a8d-46ec-b242-0d463fe87985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:40 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bc5123e3-3b79-4397-af0d-fa41510a7e5b tempest-VolumesTransfersV355Test-1117687244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef827ab1-6ca8-43d1-b038-f39bcfb49090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:40 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-bc5123e3-3b79-4397-af0d-fa41510a7e5b tempest-VolumesTransfersV355Test-1117687244 None] Volume 1313b5f6-e57b-40a1-8e9c-43fe5241ec73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1313b5f6-e57b-40a1-8e9c-43fe5241ec73', 'volume_size': 1} Jun 23 16:38:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-bc5123e3-3b79-4397-af0d-fa41510a7e5b tempest-VolumesTransfersV355Test-1117687244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:38:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-bc5123e3-3b79-4397-af0d-fa41510a7e5b tempest-VolumesTransfersV355Test-1117687244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:38:40 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-bc5123e3-3b79-4397-af0d-fa41510a7e5b tempest-VolumesTransfersV355Test-1117687244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:38:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2025542268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1313b5f6-e57b-40a1-8e9c-43fe5241ec73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d331f00ac0b4013bd36bea7a04702dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:38:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:38:40Z,use_quota=True,user_id='719ee3a1063a4c69a8587fee402fbacf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:38:40 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-bc5123e3-3b79-4397-af0d-fa41510a7e5b tempest-VolumesTransfersV355Test-1117687244 None] Creating volume 1313b5f6-e57b-40a1-8e9c-43fe5241ec73 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:38:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-bc5123e3-3b79-4397-af0d-fa41510a7e5b tempest-VolumesTransfersV355Test-1117687244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:38:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-bc5123e3-3b79-4397-af0d-fa41510a7e5b tempest-VolumesTransfersV355Test-1117687244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:38:40 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-bc5123e3-3b79-4397-af0d-fa41510a7e5b tempest-VolumesTransfersV355Test-1117687244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:38:40 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-bc5123e3-3b79-4397-af0d-fa41510a7e5b tempest-VolumesTransfersV355Test-1117687244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:38:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-bc5123e3-3b79-4397-af0d-fa41510a7e5b tempest-VolumesTransfersV355Test-1117687244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:38:40 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-bc5123e3-3b79-4397-af0d-fa41510a7e5b tempest-VolumesTransfersV355Test-1117687244 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:38:40 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-bc5123e3-3b79-4397-af0d-fa41510a7e5b tempest-VolumesTransfersV355Test-1117687244 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:38:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-bc5123e3-3b79-4397-af0d-fa41510a7e5b tempest-VolumesTransfersV355Test-1117687244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1313b5f6-e57b-40a1-8e9c-43fe5241ec73 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:40 devstack sudo[105521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1313b5f6-e57b-40a1-8e9c-43fe5241ec73 1073741824 Jun 23 16:38:40 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:40 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-230ef472-a18d-40c1-b79a-ce3bc5fe59ba tempest-VolumeQuotasNegativeTestJSON-965676506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.200s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:40 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-230ef472-a18d-40c1-b79a-ce3bc5fe59ba tempest-VolumeQuotasNegativeTestJSON-965676506 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:38:40 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-230ef472-a18d-40c1-b79a-ce3bc5fe59ba tempest-VolumeQuotasNegativeTestJSON-965676506 None] Deleted volume successfully. Jun 23 16:38:40 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-230ef472-a18d-40c1-b79a-ce3bc5fe59ba tempest-VolumeQuotasNegativeTestJSON-965676506 None] Lock "cinder-051f7544-9ae5-4714-b0c2-99aaa4403d5b-delete_volume" released by "delete_volume" :: held 3.432s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:38:41 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-6155d63f-0aca-4c5d-9c0b-bf4d5da85fe0 tempest-GroupsTest-2100010410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:38:41 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6155d63f-0aca-4c5d-9c0b-bf4d5da85fe0 tempest-GroupsTest-2100010410 None] Flow 'volume_create_manager' (fe31124f-03e6-47fd-9c64-490eb7061387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:38:41 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6155d63f-0aca-4c5d-9c0b-bf4d5da85fe0 tempest-GroupsTest-2100010410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13f8c84a-6524-4ae7-80cc-7fbcd5a45f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:41 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6155d63f-0aca-4c5d-9c0b-bf4d5da85fe0 tempest-GroupsTest-2100010410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13f8c84a-6524-4ae7-80cc-7fbcd5a45f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:38:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1754671290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fc7ee009-47fb-454b-b816-d490dfcc2670,host='devstack@QuobyteHD#QuobyteHD',id=feb9d878-0164-46c2-8936-88b8312aef1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef521dfb4018495d82137f7f329466c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:38:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:38:41Z,use_quota=True,user_id='a7fa8a6c6c0c4478ac1da1661abf0651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8386b4b1-97bd-4f22-8089-29ba0f56c206),volume_type_id=8386b4b1-97bd-4f22-8089-29ba0f56c206)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:41 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6155d63f-0aca-4c5d-9c0b-bf4d5da85fe0 tempest-GroupsTest-2100010410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (500a612d-374f-410e-909c-e023d2afd087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:41 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6155d63f-0aca-4c5d-9c0b-bf4d5da85fe0 tempest-GroupsTest-2100010410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (500a612d-374f-410e-909c-e023d2afd087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:41 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6155d63f-0aca-4c5d-9c0b-bf4d5da85fe0 tempest-GroupsTest-2100010410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e99b924c-a380-45bc-af73-4e6c5bb411fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:41 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6155d63f-0aca-4c5d-9c0b-bf4d5da85fe0 tempest-GroupsTest-2100010410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e99b924c-a380-45bc-af73-4e6c5bb411fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'feb9d878-0164-46c2-8936-88b8312aef1e', 'volume_name': 'volume-feb9d878-0164-46c2-8936-88b8312aef1e', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:41 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6155d63f-0aca-4c5d-9c0b-bf4d5da85fe0 tempest-GroupsTest-2100010410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11c5c7bc-8551-4d99-b614-e84877b42542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:41 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6155d63f-0aca-4c5d-9c0b-bf4d5da85fe0 tempest-GroupsTest-2100010410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11c5c7bc-8551-4d99-b614-e84877b42542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:41 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6155d63f-0aca-4c5d-9c0b-bf4d5da85fe0 tempest-GroupsTest-2100010410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d71491e-28dd-4291-b0ab-86fcbbe24aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:41 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-6155d63f-0aca-4c5d-9c0b-bf4d5da85fe0 tempest-GroupsTest-2100010410 None] Volume feb9d878-0164-46c2-8936-88b8312aef1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-feb9d878-0164-46c2-8936-88b8312aef1e', 'volume_size': 1} Jun 23 16:38:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-6155d63f-0aca-4c5d-9c0b-bf4d5da85fe0 tempest-GroupsTest-2100010410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:38:41 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-bc5123e3-3b79-4397-af0d-fa41510a7e5b tempest-VolumesTransfersV355Test-1117687244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1313b5f6-e57b-40a1-8e9c-43fe5241ec73 1073741824" returned: 0 in 1.268s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-bc5123e3-3b79-4397-af0d-fa41510a7e5b tempest-VolumesTransfersV355Test-1117687244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1313b5f6-e57b-40a1-8e9c-43fe5241ec73 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:41 devstack sudo[105527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1313b5f6-e57b-40a1-8e9c-43fe5241ec73 Jun 23 16:38:41 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:42 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:42 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-bc5123e3-3b79-4397-af0d-fa41510a7e5b tempest-VolumesTransfersV355Test-1117687244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1313b5f6-e57b-40a1-8e9c-43fe5241ec73" returned: 0 in 0.970s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:42 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-bc5123e3-3b79-4397-af0d-fa41510a7e5b tempest-VolumesTransfersV355Test-1117687244 None] <== create_volume: return (2296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:38:42 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-bc5123e3-3b79-4397-af0d-fa41510a7e5b tempest-VolumesTransfersV355Test-1117687244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.298s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:38:42 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-6155d63f-0aca-4c5d-9c0b-bf4d5da85fe0 tempest-GroupsTest-2100010410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.659s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:38:42 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-6155d63f-0aca-4c5d-9c0b-bf4d5da85fe0 tempest-GroupsTest-2100010410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fc7ee009-47fb-454b-b816-d490dfcc2670,created_at=2026-06-23T14:38:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1754671290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fc7ee009-47fb-454b-b816-d490dfcc2670,host='devstack@QuobyteHD#QuobyteHD',id=feb9d878-0164-46c2-8936-88b8312aef1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef521dfb4018495d82137f7f329466c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:38:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:38:41Z,use_quota=True,user_id='a7fa8a6c6c0c4478ac1da1661abf0651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8386b4b1-97bd-4f22-8089-29ba0f56c206),volume_type_id=8386b4b1-97bd-4f22-8089-29ba0f56c206)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:38:42 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-6155d63f-0aca-4c5d-9c0b-bf4d5da85fe0 tempest-GroupsTest-2100010410 None] Creating volume feb9d878-0164-46c2-8936-88b8312aef1e {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:38:42 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-6155d63f-0aca-4c5d-9c0b-bf4d5da85fe0 tempest-GroupsTest-2100010410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:38:42 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-6155d63f-0aca-4c5d-9c0b-bf4d5da85fe0 tempest-GroupsTest-2100010410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:38:42 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-6155d63f-0aca-4c5d-9c0b-bf4d5da85fe0 tempest-GroupsTest-2100010410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:38:42 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-6155d63f-0aca-4c5d-9c0b-bf4d5da85fe0 tempest-GroupsTest-2100010410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:38:42 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-6155d63f-0aca-4c5d-9c0b-bf4d5da85fe0 tempest-GroupsTest-2100010410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:38:42 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-6155d63f-0aca-4c5d-9c0b-bf4d5da85fe0 tempest-GroupsTest-2100010410 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:38:42 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-6155d63f-0aca-4c5d-9c0b-bf4d5da85fe0 tempest-GroupsTest-2100010410 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:38:42 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-6155d63f-0aca-4c5d-9c0b-bf4d5da85fe0 tempest-GroupsTest-2100010410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-feb9d878-0164-46c2-8936-88b8312aef1e 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:42 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bc5123e3-3b79-4397-af0d-fa41510a7e5b tempest-VolumesTransfersV355Test-1117687244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef827ab1-6ca8-43d1-b038-f39bcfb49090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1313b5f6-e57b-40a1-8e9c-43fe5241ec73', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:42 devstack sudo[105530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-feb9d878-0164-46c2-8936-88b8312aef1e 1073741824 Jun 23 16:38:42 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:42 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bc5123e3-3b79-4397-af0d-fa41510a7e5b tempest-VolumesTransfersV355Test-1117687244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (698926dd-89c0-404c-9659-129eb11d54de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:42 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-bc5123e3-3b79-4397-af0d-fa41510a7e5b tempest-VolumesTransfersV355Test-1117687244 None] Volume volume-1313b5f6-e57b-40a1-8e9c-43fe5241ec73 (1313b5f6-e57b-40a1-8e9c-43fe5241ec73): created successfully Jun 23 16:38:42 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bc5123e3-3b79-4397-af0d-fa41510a7e5b tempest-VolumesTransfersV355Test-1117687244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (698926dd-89c0-404c-9659-129eb11d54de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:42 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bc5123e3-3b79-4397-af0d-fa41510a7e5b tempest-VolumesTransfersV355Test-1117687244 None] Flow 'volume_create_manager' (fb04de64-358e-45fc-ab14-27a00ec2e15d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:38:42 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-bc5123e3-3b79-4397-af0d-fa41510a7e5b tempest-VolumesTransfersV355Test-1117687244 None] Created volume successfully. Jun 23 16:38:44 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-6155d63f-0aca-4c5d-9c0b-bf4d5da85fe0 tempest-GroupsTest-2100010410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-feb9d878-0164-46c2-8936-88b8312aef1e 1073741824" returned: 0 in 1.262s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-6155d63f-0aca-4c5d-9c0b-bf4d5da85fe0 tempest-GroupsTest-2100010410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-feb9d878-0164-46c2-8936-88b8312aef1e {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:44 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-feb9d878-0164-46c2-8936-88b8312aef1e Jun 23 16:38:44 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:44 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-6a814ef7-96d4-424c-914b-11d20391fca0 tempest-VolumesTransfersV355Test-1875802864 None] Transfer volume completed successfully. Jun 23 16:38:44 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-6155d63f-0aca-4c5d-9c0b-bf4d5da85fe0 tempest-GroupsTest-2100010410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-feb9d878-0164-46c2-8936-88b8312aef1e" returned: 0 in 0.774s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:44 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-6155d63f-0aca-4c5d-9c0b-bf4d5da85fe0 tempest-GroupsTest-2100010410 None] <== create_volume: return (2110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:38:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-6155d63f-0aca-4c5d-9c0b-bf4d5da85fe0 tempest-GroupsTest-2100010410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.118s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:38:44 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6155d63f-0aca-4c5d-9c0b-bf4d5da85fe0 tempest-GroupsTest-2100010410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d71491e-28dd-4291-b0ab-86fcbbe24aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-feb9d878-0164-46c2-8936-88b8312aef1e', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:44 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6155d63f-0aca-4c5d-9c0b-bf4d5da85fe0 tempest-GroupsTest-2100010410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (803c4164-3421-470c-97f2-572f726d8dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:45 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-6155d63f-0aca-4c5d-9c0b-bf4d5da85fe0 tempest-GroupsTest-2100010410 None] Volume volume-feb9d878-0164-46c2-8936-88b8312aef1e (feb9d878-0164-46c2-8936-88b8312aef1e): created successfully Jun 23 16:38:45 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6155d63f-0aca-4c5d-9c0b-bf4d5da85fe0 tempest-GroupsTest-2100010410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (803c4164-3421-470c-97f2-572f726d8dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:45 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6155d63f-0aca-4c5d-9c0b-bf4d5da85fe0 tempest-GroupsTest-2100010410 None] Flow 'volume_create_manager' (fe31124f-03e6-47fd-9c64-490eb7061387) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:38:45 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-6155d63f-0aca-4c5d-9c0b-bf4d5da85fe0 tempest-GroupsTest-2100010410 None] Created volume successfully. Jun 23 16:38:46 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-41050eff-4ccc-4b5a-813f-e7343cc0423e tempest-VolumesTransfersV355Test-1108577638 None] Acquiring lock "cinder-1313b5f6-e57b-40a1-8e9c-43fe5241ec73-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:38:46 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-41050eff-4ccc-4b5a-813f-e7343cc0423e tempest-VolumesTransfersV355Test-1108577638 None] Lock "cinder-1313b5f6-e57b-40a1-8e9c-43fe5241ec73-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:38:46 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-41050eff-4ccc-4b5a-813f-e7343cc0423e tempest-VolumesTransfersV355Test-1108577638 None] Acquiring lock "cinder-quobyte-1313b5f6-e57b-40a1-8e9c-43fe5241ec73" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:38:46 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-41050eff-4ccc-4b5a-813f-e7343cc0423e tempest-VolumesTransfersV355Test-1108577638 None] Lock "cinder-quobyte-1313b5f6-e57b-40a1-8e9c-43fe5241ec73" acquired by "delete_volume" :: waited 0.017s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:38:46 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf47851-bb40-4ab7-a451-12fca2dff716]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:38:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-41050eff-4ccc-4b5a-813f-e7343cc0423e tempest-VolumesTransfersV355Test-1108577638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1313b5f6-e57b-40a1-8e9c-43fe5241ec73 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:46 devstack sudo[105539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1313b5f6-e57b-40a1-8e9c-43fe5241ec73 Jun 23 16:38:46 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:47 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:SELECT=79,cinder:INSERT=27,cinder:UPDATE=102,cinder:DELETE=7 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:38:47 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5d68fc9-02f6-4718-975b-837748fd73ab tempest-GroupsTest-2100010410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:38:47 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a5d68fc9-02f6-4718-975b-837748fd73ab tempest-GroupsTest-2100010410 None] Flow 'volume_create_manager' (654e1502-2db9-44f8-bcbc-e9d21752284b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:38:47 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a5d68fc9-02f6-4718-975b-837748fd73ab tempest-GroupsTest-2100010410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e2cb3a0-5b55-407a-b695-a9cbd9ef98ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:47 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a5d68fc9-02f6-4718-975b-837748fd73ab tempest-GroupsTest-2100010410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e2cb3a0-5b55-407a-b695-a9cbd9ef98ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1899842792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fc7ee009-47fb-454b-b816-d490dfcc2670,host='devstack@QuobyteHD#QuobyteHD',id=bc9fed9f-a324-4a6b-83f7-da2193b5a30a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef521dfb4018495d82137f7f329466c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:38:47Z,use_quota=True,user_id='a7fa8a6c6c0c4478ac1da1661abf0651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8386b4b1-97bd-4f22-8089-29ba0f56c206),volume_type_id=8386b4b1-97bd-4f22-8089-29ba0f56c206)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:47 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a5d68fc9-02f6-4718-975b-837748fd73ab tempest-GroupsTest-2100010410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (986b482c-2371-4e09-8906-f66a3069083c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:47 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a5d68fc9-02f6-4718-975b-837748fd73ab tempest-GroupsTest-2100010410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (986b482c-2371-4e09-8906-f66a3069083c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:47 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a5d68fc9-02f6-4718-975b-837748fd73ab tempest-GroupsTest-2100010410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (771dc5b9-f525-45f7-ab6f-d77bf090af52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:47 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a5d68fc9-02f6-4718-975b-837748fd73ab tempest-GroupsTest-2100010410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (771dc5b9-f525-45f7-ab6f-d77bf090af52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc9fed9f-a324-4a6b-83f7-da2193b5a30a', 'volume_name': 'volume-bc9fed9f-a324-4a6b-83f7-da2193b5a30a', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:47 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a5d68fc9-02f6-4718-975b-837748fd73ab tempest-GroupsTest-2100010410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0898dc2-3909-44f5-9a9d-2fe3bdce774b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:47 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a5d68fc9-02f6-4718-975b-837748fd73ab tempest-GroupsTest-2100010410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0898dc2-3909-44f5-9a9d-2fe3bdce774b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:47 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a5d68fc9-02f6-4718-975b-837748fd73ab tempest-GroupsTest-2100010410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f91176b4-ba28-4665-8b89-6b440900f93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:47 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-a5d68fc9-02f6-4718-975b-837748fd73ab tempest-GroupsTest-2100010410 None] Volume bc9fed9f-a324-4a6b-83f7-da2193b5a30a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc9fed9f-a324-4a6b-83f7-da2193b5a30a', 'volume_size': 1} Jun 23 16:38:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a5d68fc9-02f6-4718-975b-837748fd73ab tempest-GroupsTest-2100010410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:38:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a5d68fc9-02f6-4718-975b-837748fd73ab tempest-GroupsTest-2100010410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:38:47 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-a5d68fc9-02f6-4718-975b-837748fd73ab tempest-GroupsTest-2100010410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fc7ee009-47fb-454b-b816-d490dfcc2670,created_at=2026-06-23T14:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1899842792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fc7ee009-47fb-454b-b816-d490dfcc2670,host='devstack@QuobyteHD#QuobyteHD',id=bc9fed9f-a324-4a6b-83f7-da2193b5a30a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef521dfb4018495d82137f7f329466c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:38:47Z,use_quota=True,user_id='a7fa8a6c6c0c4478ac1da1661abf0651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8386b4b1-97bd-4f22-8089-29ba0f56c206),volume_type_id=8386b4b1-97bd-4f22-8089-29ba0f56c206)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:38:47 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-a5d68fc9-02f6-4718-975b-837748fd73ab tempest-GroupsTest-2100010410 None] Creating volume bc9fed9f-a324-4a6b-83f7-da2193b5a30a {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:38:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a5d68fc9-02f6-4718-975b-837748fd73ab tempest-GroupsTest-2100010410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:38:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a5d68fc9-02f6-4718-975b-837748fd73ab tempest-GroupsTest-2100010410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:38:47 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-a5d68fc9-02f6-4718-975b-837748fd73ab tempest-GroupsTest-2100010410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:38:47 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-a5d68fc9-02f6-4718-975b-837748fd73ab tempest-GroupsTest-2100010410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:38:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a5d68fc9-02f6-4718-975b-837748fd73ab tempest-GroupsTest-2100010410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:38:47 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-a5d68fc9-02f6-4718-975b-837748fd73ab tempest-GroupsTest-2100010410 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:38:47 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-a5d68fc9-02f6-4718-975b-837748fd73ab tempest-GroupsTest-2100010410 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:38:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a5d68fc9-02f6-4718-975b-837748fd73ab tempest-GroupsTest-2100010410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bc9fed9f-a324-4a6b-83f7-da2193b5a30a 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:47 devstack sudo[105547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bc9fed9f-a324-4a6b-83f7-da2193b5a30a 1073741824 Jun 23 16:38:47 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:47 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-41050eff-4ccc-4b5a-813f-e7343cc0423e tempest-VolumesTransfersV355Test-1108577638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1313b5f6-e57b-40a1-8e9c-43fe5241ec73" returned: 0 in 1.208s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-41050eff-4ccc-4b5a-813f-e7343cc0423e tempest-VolumesTransfersV355Test-1108577638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1313b5f6-e57b-40a1-8e9c-43fe5241ec73 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:47 devstack sudo[105553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1313b5f6-e57b-40a1-8e9c-43fe5241ec73 Jun 23 16:38:47 devstack sudo[105553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:48 devstack sudo[105553]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-41050eff-4ccc-4b5a-813f-e7343cc0423e tempest-VolumesTransfersV355Test-1108577638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1313b5f6-e57b-40a1-8e9c-43fe5241ec73" returned: 0 in 0.961s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:48 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a5d68fc9-02f6-4718-975b-837748fd73ab tempest-GroupsTest-2100010410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bc9fed9f-a324-4a6b-83f7-da2193b5a30a 1073741824" returned: 0 in 1.248s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:48 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-41050eff-4ccc-4b5a-813f-e7343cc0423e tempest-VolumesTransfersV355Test-1108577638 None] Lock "cinder-quobyte-1313b5f6-e57b-40a1-8e9c-43fe5241ec73" released by "delete_volume" :: held 2.227s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:38:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a5d68fc9-02f6-4718-975b-837748fd73ab tempest-GroupsTest-2100010410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bc9fed9f-a324-4a6b-83f7-da2193b5a30a {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:48 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bc9fed9f-a324-4a6b-83f7-da2193b5a30a Jun 23 16:38:48 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:48 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-41050eff-4ccc-4b5a-813f-e7343cc0423e tempest-VolumesTransfersV355Test-1108577638 None] Created reservations ['ff07c5b7-d5c2-4525-93f8-b4e940d574d2', '95ab4a48-60bf-4215-a66f-c5fb6ec1855e', 'ce4bb9dc-2f42-4bdd-8229-87cf61f4b1ac', '734649ea-a34d-449c-adaf-0e8d8963d31c'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:38:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-41050eff-4ccc-4b5a-813f-e7343cc0423e tempest-VolumesTransfersV355Test-1108577638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:38:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-41050eff-4ccc-4b5a-813f-e7343cc0423e tempest-VolumesTransfersV355Test-1108577638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:38:48 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-41050eff-4ccc-4b5a-813f-e7343cc0423e tempest-VolumesTransfersV355Test-1108577638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:38:48 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-41050eff-4ccc-4b5a-813f-e7343cc0423e tempest-VolumesTransfersV355Test-1108577638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:38:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-41050eff-4ccc-4b5a-813f-e7343cc0423e tempest-VolumesTransfersV355Test-1108577638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:38:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-41050eff-4ccc-4b5a-813f-e7343cc0423e tempest-VolumesTransfersV355Test-1108577638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:48 devstack sudo[105563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:38:48 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:49 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a5d68fc9-02f6-4718-975b-837748fd73ab tempest-GroupsTest-2100010410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bc9fed9f-a324-4a6b-83f7-da2193b5a30a" returned: 0 in 0.846s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:49 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-a5d68fc9-02f6-4718-975b-837748fd73ab tempest-GroupsTest-2100010410 None] <== create_volume: return (2158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:38:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a5d68fc9-02f6-4718-975b-837748fd73ab tempest-GroupsTest-2100010410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.163s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:38:49 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a5d68fc9-02f6-4718-975b-837748fd73ab tempest-GroupsTest-2100010410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f91176b4-ba28-4665-8b89-6b440900f93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc9fed9f-a324-4a6b-83f7-da2193b5a30a', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:49 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a5d68fc9-02f6-4718-975b-837748fd73ab tempest-GroupsTest-2100010410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cbacdee-093c-474f-b38c-36f790687080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:49 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-41050eff-4ccc-4b5a-813f-e7343cc0423e tempest-VolumesTransfersV355Test-1108577638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.727s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:49 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-41050eff-4ccc-4b5a-813f-e7343cc0423e tempest-VolumesTransfersV355Test-1108577638 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:38:49 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-41050eff-4ccc-4b5a-813f-e7343cc0423e tempest-VolumesTransfersV355Test-1108577638 None] Deleted volume successfully. Jun 23 16:38:49 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-a5d68fc9-02f6-4718-975b-837748fd73ab tempest-GroupsTest-2100010410 None] Volume volume-bc9fed9f-a324-4a6b-83f7-da2193b5a30a (bc9fed9f-a324-4a6b-83f7-da2193b5a30a): created successfully Jun 23 16:38:49 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a5d68fc9-02f6-4718-975b-837748fd73ab tempest-GroupsTest-2100010410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cbacdee-093c-474f-b38c-36f790687080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:49 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a5d68fc9-02f6-4718-975b-837748fd73ab tempest-GroupsTest-2100010410 None] Flow 'volume_create_manager' (654e1502-2db9-44f8-bcbc-e9d21752284b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:38:49 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-a5d68fc9-02f6-4718-975b-837748fd73ab tempest-GroupsTest-2100010410 None] Created volume successfully. Jun 23 16:38:49 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-41050eff-4ccc-4b5a-813f-e7343cc0423e tempest-VolumesTransfersV355Test-1108577638 None] Lock "cinder-1313b5f6-e57b-40a1-8e9c-43fe5241ec73-delete_volume" released by "delete_volume" :: held 3.284s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:38:49 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-df2cb4d2-62c2-4890-a613-02d665e18c62 tempest-GroupsTest-2100010410 None] Update group completed successfully. Jun 23 16:38:50 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-045f7e1b-a242-4800-9ff0-eaa0fedd0937 tempest-VolumesTransfersV355Test-1117687244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:38:50 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-045f7e1b-a242-4800-9ff0-eaa0fedd0937 tempest-VolumesTransfersV355Test-1117687244 None] Flow 'volume_create_manager' (aeee5a38-9dd5-4186-b2ea-bee929345a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:38:50 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-045f7e1b-a242-4800-9ff0-eaa0fedd0937 tempest-VolumesTransfersV355Test-1117687244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c876c98c-9939-4f34-88f1-d9361e16745c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:50 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-045f7e1b-a242-4800-9ff0-eaa0fedd0937 tempest-VolumesTransfersV355Test-1117687244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c876c98c-9939-4f34-88f1-d9361e16745c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1456168277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=114fd766-ee14-4b50-9851-cea149c38686,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d331f00ac0b4013bd36bea7a04702dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:38:50Z,use_quota=True,user_id='719ee3a1063a4c69a8587fee402fbacf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:50 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-045f7e1b-a242-4800-9ff0-eaa0fedd0937 tempest-VolumesTransfersV355Test-1117687244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e724401c-0d0e-427a-8def-a526a700861e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:50 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-045f7e1b-a242-4800-9ff0-eaa0fedd0937 tempest-VolumesTransfersV355Test-1117687244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e724401c-0d0e-427a-8def-a526a700861e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:50 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-045f7e1b-a242-4800-9ff0-eaa0fedd0937 tempest-VolumesTransfersV355Test-1117687244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (624fd9dd-95d5-482c-a68a-c8510efa24f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:50 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-045f7e1b-a242-4800-9ff0-eaa0fedd0937 tempest-VolumesTransfersV355Test-1117687244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (624fd9dd-95d5-482c-a68a-c8510efa24f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '114fd766-ee14-4b50-9851-cea149c38686', 'volume_name': 'volume-114fd766-ee14-4b50-9851-cea149c38686', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:50 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-045f7e1b-a242-4800-9ff0-eaa0fedd0937 tempest-VolumesTransfersV355Test-1117687244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21885e9b-fed8-42c7-b1ef-6281a3423adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:50 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-045f7e1b-a242-4800-9ff0-eaa0fedd0937 tempest-VolumesTransfersV355Test-1117687244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21885e9b-fed8-42c7-b1ef-6281a3423adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:50 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-045f7e1b-a242-4800-9ff0-eaa0fedd0937 tempest-VolumesTransfersV355Test-1117687244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (633859f6-41b5-4877-9def-c0c5f79b2ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:50 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-045f7e1b-a242-4800-9ff0-eaa0fedd0937 tempest-VolumesTransfersV355Test-1117687244 None] Volume 114fd766-ee14-4b50-9851-cea149c38686: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-114fd766-ee14-4b50-9851-cea149c38686', 'volume_size': 1} Jun 23 16:38:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-045f7e1b-a242-4800-9ff0-eaa0fedd0937 tempest-VolumesTransfersV355Test-1117687244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:38:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-045f7e1b-a242-4800-9ff0-eaa0fedd0937 tempest-VolumesTransfersV355Test-1117687244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:38:50 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-045f7e1b-a242-4800-9ff0-eaa0fedd0937 tempest-VolumesTransfersV355Test-1117687244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1456168277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=114fd766-ee14-4b50-9851-cea149c38686,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d331f00ac0b4013bd36bea7a04702dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:38:50Z,use_quota=True,user_id='719ee3a1063a4c69a8587fee402fbacf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:38:50 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-045f7e1b-a242-4800-9ff0-eaa0fedd0937 tempest-VolumesTransfersV355Test-1117687244 None] Creating volume 114fd766-ee14-4b50-9851-cea149c38686 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:38:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-045f7e1b-a242-4800-9ff0-eaa0fedd0937 tempest-VolumesTransfersV355Test-1117687244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:38:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-045f7e1b-a242-4800-9ff0-eaa0fedd0937 tempest-VolumesTransfersV355Test-1117687244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:38:50 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-045f7e1b-a242-4800-9ff0-eaa0fedd0937 tempest-VolumesTransfersV355Test-1117687244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:38:50 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-045f7e1b-a242-4800-9ff0-eaa0fedd0937 tempest-VolumesTransfersV355Test-1117687244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:38:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-045f7e1b-a242-4800-9ff0-eaa0fedd0937 tempest-VolumesTransfersV355Test-1117687244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:38:50 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-045f7e1b-a242-4800-9ff0-eaa0fedd0937 tempest-VolumesTransfersV355Test-1117687244 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:38:50 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-045f7e1b-a242-4800-9ff0-eaa0fedd0937 tempest-VolumesTransfersV355Test-1117687244 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:38:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-045f7e1b-a242-4800-9ff0-eaa0fedd0937 tempest-VolumesTransfersV355Test-1117687244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-114fd766-ee14-4b50-9851-cea149c38686 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:50 devstack sudo[105567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-114fd766-ee14-4b50-9851-cea149c38686 1073741824 Jun 23 16:38:50 devstack sudo[105567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:51 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-934c1eaa-ee1f-4502-bc6f-b6459be53065 tempest-GroupsTest-2100010410 None] Update group completed successfully. Jun 23 16:38:51 devstack sudo[105567]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-045f7e1b-a242-4800-9ff0-eaa0fedd0937 tempest-VolumesTransfersV355Test-1117687244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-114fd766-ee14-4b50-9851-cea149c38686 1073741824" returned: 0 in 1.010s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-045f7e1b-a242-4800-9ff0-eaa0fedd0937 tempest-VolumesTransfersV355Test-1117687244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-114fd766-ee14-4b50-9851-cea149c38686 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:51 devstack sudo[105573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-114fd766-ee14-4b50-9851-cea149c38686 Jun 23 16:38:51 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:52 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-045f7e1b-a242-4800-9ff0-eaa0fedd0937 tempest-VolumesTransfersV355Test-1117687244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-114fd766-ee14-4b50-9851-cea149c38686" returned: 0 in 0.701s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:52 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-045f7e1b-a242-4800-9ff0-eaa0fedd0937 tempest-VolumesTransfersV355Test-1117687244 None] <== create_volume: return (1763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:38:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-045f7e1b-a242-4800-9ff0-eaa0fedd0937 tempest-VolumesTransfersV355Test-1117687244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.766s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:38:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-045f7e1b-a242-4800-9ff0-eaa0fedd0937 tempest-VolumesTransfersV355Test-1117687244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (633859f6-41b5-4877-9def-c0c5f79b2ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-114fd766-ee14-4b50-9851-cea149c38686', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-045f7e1b-a242-4800-9ff0-eaa0fedd0937 tempest-VolumesTransfersV355Test-1117687244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d75276e-ccb1-45b9-a3d4-cda536962d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:52 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-045f7e1b-a242-4800-9ff0-eaa0fedd0937 tempest-VolumesTransfersV355Test-1117687244 None] Volume volume-114fd766-ee14-4b50-9851-cea149c38686 (114fd766-ee14-4b50-9851-cea149c38686): created successfully Jun 23 16:38:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-045f7e1b-a242-4800-9ff0-eaa0fedd0937 tempest-VolumesTransfersV355Test-1117687244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d75276e-ccb1-45b9-a3d4-cda536962d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-045f7e1b-a242-4800-9ff0-eaa0fedd0937 tempest-VolumesTransfersV355Test-1117687244 None] Flow 'volume_create_manager' (aeee5a38-9dd5-4186-b2ea-bee929345a97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:38:52 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-045f7e1b-a242-4800-9ff0-eaa0fedd0937 tempest-VolumesTransfersV355Test-1117687244 None] Created volume successfully. Jun 23 16:38:52 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-a89a3d52-499c-4c7a-ab23-14e6a3cdd8d8 tempest-TestInstancesWithCinderVolumes-865228744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:38:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a89a3d52-499c-4c7a-ab23-14e6a3cdd8d8 tempest-TestInstancesWithCinderVolumes-865228744 None] Flow 'volume_create_manager' (9fae291a-c316-4136-a608-319521030b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:38:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a89a3d52-499c-4c7a-ab23-14e6a3cdd8d8 tempest-TestInstancesWithCinderVolumes-865228744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d43e547-d45f-4126-9310-c54dc3bb526c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a89a3d52-499c-4c7a-ab23-14e6a3cdd8d8 tempest-TestInstancesWithCinderVolumes-865228744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d43e547-d45f-4126-9310-c54dc3bb526c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-129657054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6a5072e-4d4d-4303-8a1b-ef8b7dc46562,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b5eb69099bd4622b5be7b1cfb9d80bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:38:53Z,use_quota=True,user_id='b484b0ba25a94c438d3fbb4b472e6d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db306286-bb3b-45e4-8ba0-990bd7396cdb),volume_type_id=db306286-bb3b-45e4-8ba0-990bd7396cdb)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a89a3d52-499c-4c7a-ab23-14e6a3cdd8d8 tempest-TestInstancesWithCinderVolumes-865228744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e00d1307-d58b-4050-818a-460f6ff3d49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a89a3d52-499c-4c7a-ab23-14e6a3cdd8d8 tempest-TestInstancesWithCinderVolumes-865228744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e00d1307-d58b-4050-818a-460f6ff3d49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a89a3d52-499c-4c7a-ab23-14e6a3cdd8d8 tempest-TestInstancesWithCinderVolumes-865228744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (490848f5-4d6a-419d-81df-86e6ae357b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a89a3d52-499c-4c7a-ab23-14e6a3cdd8d8 tempest-TestInstancesWithCinderVolumes-865228744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (490848f5-4d6a-419d-81df-86e6ae357b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6a5072e-4d4d-4303-8a1b-ef8b7dc46562', 'volume_name': 'volume-f6a5072e-4d4d-4303-8a1b-ef8b7dc46562', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a89a3d52-499c-4c7a-ab23-14e6a3cdd8d8 tempest-TestInstancesWithCinderVolumes-865228744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4104b52b-ac5a-431b-8a2a-d87e696ff3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a89a3d52-499c-4c7a-ab23-14e6a3cdd8d8 tempest-TestInstancesWithCinderVolumes-865228744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4104b52b-ac5a-431b-8a2a-d87e696ff3a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a89a3d52-499c-4c7a-ab23-14e6a3cdd8d8 tempest-TestInstancesWithCinderVolumes-865228744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3f7e23f-ea58-4675-a9e4-1f10a6b08299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:52 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-a89a3d52-499c-4c7a-ab23-14e6a3cdd8d8 tempest-TestInstancesWithCinderVolumes-865228744 None] Volume f6a5072e-4d4d-4303-8a1b-ef8b7dc46562: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6a5072e-4d4d-4303-8a1b-ef8b7dc46562', 'volume_size': 1} Jun 23 16:38:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a89a3d52-499c-4c7a-ab23-14e6a3cdd8d8 tempest-TestInstancesWithCinderVolumes-865228744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:38:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a89a3d52-499c-4c7a-ab23-14e6a3cdd8d8 tempest-TestInstancesWithCinderVolumes-865228744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:38:52 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-a89a3d52-499c-4c7a-ab23-14e6a3cdd8d8 tempest-TestInstancesWithCinderVolumes-865228744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-129657054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6a5072e-4d4d-4303-8a1b-ef8b7dc46562,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b5eb69099bd4622b5be7b1cfb9d80bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:38:53Z,use_quota=True,user_id='b484b0ba25a94c438d3fbb4b472e6d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db306286-bb3b-45e4-8ba0-990bd7396cdb),volume_type_id=db306286-bb3b-45e4-8ba0-990bd7396cdb)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:38:52 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-a89a3d52-499c-4c7a-ab23-14e6a3cdd8d8 tempest-TestInstancesWithCinderVolumes-865228744 None] Creating volume f6a5072e-4d4d-4303-8a1b-ef8b7dc46562 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:38:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a89a3d52-499c-4c7a-ab23-14e6a3cdd8d8 tempest-TestInstancesWithCinderVolumes-865228744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:38:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a89a3d52-499c-4c7a-ab23-14e6a3cdd8d8 tempest-TestInstancesWithCinderVolumes-865228744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:38:52 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-a89a3d52-499c-4c7a-ab23-14e6a3cdd8d8 tempest-TestInstancesWithCinderVolumes-865228744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:38:52 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-a89a3d52-499c-4c7a-ab23-14e6a3cdd8d8 tempest-TestInstancesWithCinderVolumes-865228744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:38:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a89a3d52-499c-4c7a-ab23-14e6a3cdd8d8 tempest-TestInstancesWithCinderVolumes-865228744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:38:52 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-a89a3d52-499c-4c7a-ab23-14e6a3cdd8d8 tempest-TestInstancesWithCinderVolumes-865228744 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:38:52 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-a89a3d52-499c-4c7a-ab23-14e6a3cdd8d8 tempest-TestInstancesWithCinderVolumes-865228744 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:38:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a89a3d52-499c-4c7a-ab23-14e6a3cdd8d8 tempest-TestInstancesWithCinderVolumes-865228744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f6a5072e-4d4d-4303-8a1b-ef8b7dc46562 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:52 devstack sudo[105576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f6a5072e-4d4d-4303-8a1b-ef8b7dc46562 1073741824 Jun 23 16:38:52 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:53 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d7a73a48-0274-4e24-8357-e96a32c61786 tempest-GroupsTest-2100010410 None] Acquiring lock "cinder-quobyte-bc9fed9f-a324-4a6b-83f7-da2193b5a30a" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:38:53 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d7a73a48-0274-4e24-8357-e96a32c61786 tempest-GroupsTest-2100010410 None] Lock "cinder-quobyte-bc9fed9f-a324-4a6b-83f7-da2193b5a30a" acquired by "delete_volume" :: waited 0.045s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:38:53 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f880e058-1137-46a2-9bf4-8a4e89200b1a]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:38:53 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d7a73a48-0274-4e24-8357-e96a32c61786 tempest-GroupsTest-2100010410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bc9fed9f-a324-4a6b-83f7-da2193b5a30a {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:53 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-24ef825d-5439-4fc3-be12-397c18c048b5 tempest-TestInstancesWithCinderVolumes-865228744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:38:53 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-24ef825d-5439-4fc3-be12-397c18c048b5 tempest-TestInstancesWithCinderVolumes-865228744 None] Flow 'volume_create_manager' (d0cae056-b258-4176-80a7-e6fb2d5aa752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:38:53 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-24ef825d-5439-4fc3-be12-397c18c048b5 tempest-TestInstancesWithCinderVolumes-865228744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7746c307-bc59-4492-aeb2-497e3ebaa048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:53 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-24ef825d-5439-4fc3-be12-397c18c048b5 tempest-TestInstancesWithCinderVolumes-865228744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7746c307-bc59-4492-aeb2-497e3ebaa048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-423003265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed5b7957-ce1a-466c-8010-be34e6ce89fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b5eb69099bd4622b5be7b1cfb9d80bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:38:53Z,use_quota=True,user_id='b484b0ba25a94c438d3fbb4b472e6d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a96f7a1e-e5bb-4b08-b702-081af2833f1d),volume_type_id=a96f7a1e-e5bb-4b08-b702-081af2833f1d)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:53 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-24ef825d-5439-4fc3-be12-397c18c048b5 tempest-TestInstancesWithCinderVolumes-865228744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b370f56e-a8fa-46c4-9fb6-09ca70331ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:53 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-24ef825d-5439-4fc3-be12-397c18c048b5 tempest-TestInstancesWithCinderVolumes-865228744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b370f56e-a8fa-46c4-9fb6-09ca70331ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:53 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-24ef825d-5439-4fc3-be12-397c18c048b5 tempest-TestInstancesWithCinderVolumes-865228744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c0e6646-720f-49ec-87a6-fe22b87ce228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:53 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-24ef825d-5439-4fc3-be12-397c18c048b5 tempest-TestInstancesWithCinderVolumes-865228744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c0e6646-720f-49ec-87a6-fe22b87ce228) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed5b7957-ce1a-466c-8010-be34e6ce89fd', 'volume_name': 'volume-ed5b7957-ce1a-466c-8010-be34e6ce89fd', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:53 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-24ef825d-5439-4fc3-be12-397c18c048b5 tempest-TestInstancesWithCinderVolumes-865228744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03c70cc4-7e66-449f-b1e3-01bb24cab29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:53 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-24ef825d-5439-4fc3-be12-397c18c048b5 tempest-TestInstancesWithCinderVolumes-865228744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03c70cc4-7e66-449f-b1e3-01bb24cab29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:53 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-24ef825d-5439-4fc3-be12-397c18c048b5 tempest-TestInstancesWithCinderVolumes-865228744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7f7e7af-7ed0-47b6-aa33-267c242843ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:53 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-24ef825d-5439-4fc3-be12-397c18c048b5 tempest-TestInstancesWithCinderVolumes-865228744 None] Volume ed5b7957-ce1a-466c-8010-be34e6ce89fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed5b7957-ce1a-466c-8010-be34e6ce89fd', 'volume_size': 1} Jun 23 16:38:53 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-24ef825d-5439-4fc3-be12-397c18c048b5 tempest-TestInstancesWithCinderVolumes-865228744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:38:53 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bc9fed9f-a324-4a6b-83f7-da2193b5a30a Jun 23 16:38:53 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:53 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5d36bf25-cb35-4835-8847-014b249e1eb7 tempest-VolumesTransfersV355Test-1108577638 None] Acquiring lock "cinder-114fd766-ee14-4b50-9851-cea149c38686-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:38:54 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5d36bf25-cb35-4835-8847-014b249e1eb7 tempest-VolumesTransfersV355Test-1108577638 None] Lock "cinder-114fd766-ee14-4b50-9851-cea149c38686-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:38:54 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5d36bf25-cb35-4835-8847-014b249e1eb7 tempest-VolumesTransfersV355Test-1108577638 None] Acquiring lock "cinder-quobyte-114fd766-ee14-4b50-9851-cea149c38686" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:38:54 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5d36bf25-cb35-4835-8847-014b249e1eb7 tempest-VolumesTransfersV355Test-1108577638 None] Lock "cinder-quobyte-114fd766-ee14-4b50-9851-cea149c38686" acquired by "delete_volume" :: waited 0.028s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:38:54 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fb4373-c91e-45f9-a358-e036a06e619a]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:38:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5d36bf25-cb35-4835-8847-014b249e1eb7 tempest-VolumesTransfersV355Test-1108577638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-114fd766-ee14-4b50-9851-cea149c38686 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:54 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a89a3d52-499c-4c7a-ab23-14e6a3cdd8d8 tempest-TestInstancesWithCinderVolumes-865228744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f6a5072e-4d4d-4303-8a1b-ef8b7dc46562 1073741824" returned: 0 in 1.301s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:54 devstack sudo[105584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-114fd766-ee14-4b50-9851-cea149c38686 Jun 23 16:38:54 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a89a3d52-499c-4c7a-ab23-14e6a3cdd8d8 tempest-TestInstancesWithCinderVolumes-865228744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f6a5072e-4d4d-4303-8a1b-ef8b7dc46562 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:54 devstack sudo[105586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f6a5072e-4d4d-4303-8a1b-ef8b7dc46562 Jun 23 16:38:54 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:54 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d7a73a48-0274-4e24-8357-e96a32c61786 tempest-GroupsTest-2100010410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bc9fed9f-a324-4a6b-83f7-da2193b5a30a" returned: 0 in 1.222s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d7a73a48-0274-4e24-8357-e96a32c61786 tempest-GroupsTest-2100010410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bc9fed9f-a324-4a6b-83f7-da2193b5a30a {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:54 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bc9fed9f-a324-4a6b-83f7-da2193b5a30a Jun 23 16:38:54 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:55 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:38:55 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] Flow 'volume_create_manager' (6bf9842b-2c8d-46fb-805b-bf0597d6a9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:38:55 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85746bb3-60d5-4d82-ac3d-c04e9c3e91aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:55 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85746bb3-60d5-4d82-ac3d-c04e9c3e91aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:38:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1014531495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d607b6f6-a013-44e8-bd80-e8a3d6356a83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b5eb69099bd4622b5be7b1cfb9d80bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:38:55Z,use_quota=True,user_id='b484b0ba25a94c438d3fbb4b472e6d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(18538c8f-390a-412f-bab3-55bb5cd1f331),volume_type_id=18538c8f-390a-412f-bab3-55bb5cd1f331)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:55 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54c784a0-1371-4cb5-a0f2-0b1bcad99a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:55 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54c784a0-1371-4cb5-a0f2-0b1bcad99a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:55 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95ea9b24-6001-49d9-9c27-973ee0ab4b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:55 devstack cinder-volume[93788]: DEBUG cinder.image.glance [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] Creating Keystone auth plugin from conf {{(pid=93788) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 16:38:55 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a89a3d52-499c-4c7a-ab23-14e6a3cdd8d8 tempest-TestInstancesWithCinderVolumes-865228744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f6a5072e-4d4d-4303-8a1b-ef8b7dc46562" returned: 0 in 1.093s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:55 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-a89a3d52-499c-4c7a-ab23-14e6a3cdd8d8 tempest-TestInstancesWithCinderVolumes-865228744 None] <== create_volume: return (2457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:38:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a89a3d52-499c-4c7a-ab23-14e6a3cdd8d8 tempest-TestInstancesWithCinderVolumes-865228744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.460s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:38:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-24ef825d-5439-4fc3-be12-397c18c048b5 tempest-TestInstancesWithCinderVolumes-865228744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.807s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:38:55 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-24ef825d-5439-4fc3-be12-397c18c048b5 tempest-TestInstancesWithCinderVolumes-865228744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-423003265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed5b7957-ce1a-466c-8010-be34e6ce89fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b5eb69099bd4622b5be7b1cfb9d80bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:38:53Z,use_quota=True,user_id='b484b0ba25a94c438d3fbb4b472e6d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a96f7a1e-e5bb-4b08-b702-081af2833f1d),volume_type_id=a96f7a1e-e5bb-4b08-b702-081af2833f1d)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:38:55 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-24ef825d-5439-4fc3-be12-397c18c048b5 tempest-TestInstancesWithCinderVolumes-865228744 None] Creating volume ed5b7957-ce1a-466c-8010-be34e6ce89fd {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:38:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-24ef825d-5439-4fc3-be12-397c18c048b5 tempest-TestInstancesWithCinderVolumes-865228744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:38:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-24ef825d-5439-4fc3-be12-397c18c048b5 tempest-TestInstancesWithCinderVolumes-865228744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:38:55 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-24ef825d-5439-4fc3-be12-397c18c048b5 tempest-TestInstancesWithCinderVolumes-865228744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:38:55 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-24ef825d-5439-4fc3-be12-397c18c048b5 tempest-TestInstancesWithCinderVolumes-865228744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:38:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-24ef825d-5439-4fc3-be12-397c18c048b5 tempest-TestInstancesWithCinderVolumes-865228744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:38:55 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-24ef825d-5439-4fc3-be12-397c18c048b5 tempest-TestInstancesWithCinderVolumes-865228744 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:38:55 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-24ef825d-5439-4fc3-be12-397c18c048b5 tempest-TestInstancesWithCinderVolumes-865228744 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:38:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-24ef825d-5439-4fc3-be12-397c18c048b5 tempest-TestInstancesWithCinderVolumes-865228744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-ed5b7957-ce1a-466c-8010-be34e6ce89fd 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:55 devstack sudo[105598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-ed5b7957-ce1a-466c-8010-be34e6ce89fd 1073741824 Jun 23 16:38:55 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:55 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a89a3d52-499c-4c7a-ab23-14e6a3cdd8d8 tempest-TestInstancesWithCinderVolumes-865228744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3f7e23f-ea58-4675-a9e4-1f10a6b08299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6a5072e-4d4d-4303-8a1b-ef8b7dc46562', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:55 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a89a3d52-499c-4c7a-ab23-14e6a3cdd8d8 tempest-TestInstancesWithCinderVolumes-865228744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e53c4dd3-a937-4acb-9488-a0bf936036db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:55 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-a89a3d52-499c-4c7a-ab23-14e6a3cdd8d8 tempest-TestInstancesWithCinderVolumes-865228744 None] Volume volume-f6a5072e-4d4d-4303-8a1b-ef8b7dc46562 (f6a5072e-4d4d-4303-8a1b-ef8b7dc46562): created successfully Jun 23 16:38:55 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a89a3d52-499c-4c7a-ab23-14e6a3cdd8d8 tempest-TestInstancesWithCinderVolumes-865228744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e53c4dd3-a937-4acb-9488-a0bf936036db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:55 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a89a3d52-499c-4c7a-ab23-14e6a3cdd8d8 tempest-TestInstancesWithCinderVolumes-865228744 None] Flow 'volume_create_manager' (9fae291a-c316-4136-a608-319521030b35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:38:55 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-a89a3d52-499c-4c7a-ab23-14e6a3cdd8d8 tempest-TestInstancesWithCinderVolumes-865228744 None] Created volume successfully. Jun 23 16:38:55 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5d36bf25-cb35-4835-8847-014b249e1eb7 tempest-VolumesTransfersV355Test-1108577638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-114fd766-ee14-4b50-9851-cea149c38686" returned: 0 in 1.453s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5d36bf25-cb35-4835-8847-014b249e1eb7 tempest-VolumesTransfersV355Test-1108577638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-114fd766-ee14-4b50-9851-cea149c38686 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:55 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-114fd766-ee14-4b50-9851-cea149c38686 Jun 23 16:38:55 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:55 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d7a73a48-0274-4e24-8357-e96a32c61786 tempest-GroupsTest-2100010410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bc9fed9f-a324-4a6b-83f7-da2193b5a30a" returned: 0 in 1.013s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:55 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d7a73a48-0274-4e24-8357-e96a32c61786 tempest-GroupsTest-2100010410 None] Lock "cinder-quobyte-bc9fed9f-a324-4a6b-83f7-da2193b5a30a" released by "delete_volume" :: held 2.315s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:38:55 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d7a73a48-0274-4e24-8357-e96a32c61786 tempest-GroupsTest-2100010410 None] Acquiring lock "cinder-quobyte-feb9d878-0164-46c2-8936-88b8312aef1e" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:38:55 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d7a73a48-0274-4e24-8357-e96a32c61786 tempest-GroupsTest-2100010410 None] Lock "cinder-quobyte-feb9d878-0164-46c2-8936-88b8312aef1e" acquired by "delete_volume" :: waited 0.055s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:38:55 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[4792c788-1af0-46df-a751-dcd319c5f3f3]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:38:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d7a73a48-0274-4e24-8357-e96a32c61786 tempest-GroupsTest-2100010410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-feb9d878-0164-46c2-8936-88b8312aef1e {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:55 devstack sudo[105602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-feb9d878-0164-46c2-8936-88b8312aef1e Jun 23 16:38:56 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:56 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95ea9b24-6001-49d9-9c27-973ee0ab4b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd607b6f6-a013-44e8-bd80-e8a3d6356a83', 'volume_name': 'volume-d607b6f6-a013-44e8-bd80-e8a3d6356a83', 'volume_size': 1, 'image_id': '0887b9d3-87b4-49cb-9e09-4239c820f3b7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0887b9d3-87b4-49cb-9e09-4239c820f3b7', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1961885506', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b5eb69099bd4622b5be7b1cfb9d80bb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0887b9d3-87b4-49cb-9e09-4239c820f3b7', 'created_at': datetime.datetime(2026, 6, 23, 14, 38, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 14, 38, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0887b9d3-87b4-49cb-9e09-4239c820f3b7/file', 'properties': {}}, 'image_service': }' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:56 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad266f2e-b660-48a2-b241-970b4fe86fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:56 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad266f2e-b660-48a2-b241-970b4fe86fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:56 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c758837-2d26-4cf2-be1d-9232659cb937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:56 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] Volume d607b6f6-a013-44e8-bd80-e8a3d6356a83: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d607b6f6-a013-44e8-bd80-e8a3d6356a83', 'volume_size': 1, 'image_id': '0887b9d3-87b4-49cb-9e09-4239c820f3b7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0887b9d3-87b4-49cb-9e09-4239c820f3b7', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1961885506', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b5eb69099bd4622b5be7b1cfb9d80bb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0887b9d3-87b4-49cb-9e09-4239c820f3b7', 'created_at': datetime.datetime(2026, 6, 23, 14, 38, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 14, 38, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0887b9d3-87b4-49cb-9e09-4239c820f3b7/file', 'properties': {}}, 'image_service': } Jun 23 16:38:56 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] Trying to clone d607b6f6-a013-44e8-bd80-e8a3d6356a83 from image 0887b9d3-87b4-49cb-9e09-4239c820f3b7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0887b9d3-87b4-49cb-9e09-4239c820f3b7', 'metadata': {}}]). {{(pid=93788) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 16:38:56 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5d36bf25-cb35-4835-8847-014b249e1eb7 tempest-VolumesTransfersV355Test-1108577638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-114fd766-ee14-4b50-9851-cea149c38686" returned: 0 in 1.026s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:56 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5d36bf25-cb35-4835-8847-014b249e1eb7 tempest-VolumesTransfersV355Test-1108577638 None] Lock "cinder-quobyte-114fd766-ee14-4b50-9851-cea149c38686" released by "delete_volume" :: held 2.549s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:38:56 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-5d36bf25-cb35-4835-8847-014b249e1eb7 tempest-VolumesTransfersV355Test-1108577638 None] Created reservations ['61ac4fab-aae3-46a0-a599-e4e5ab541e1a', '077aeba1-e703-4fdb-8b9a-f4cb048bdf95', 'c1fe6fae-0f58-45f0-be42-b67e64f42aa5', '40e04a0a-c2fb-4d00-a2e6-bdfb77e9e8c1'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:38:56 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-24ef825d-5439-4fc3-be12-397c18c048b5 tempest-TestInstancesWithCinderVolumes-865228744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-ed5b7957-ce1a-466c-8010-be34e6ce89fd 1073741824" returned: 0 in 1.420s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5d36bf25-cb35-4835-8847-014b249e1eb7 tempest-VolumesTransfersV355Test-1108577638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:38:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5d36bf25-cb35-4835-8847-014b249e1eb7 tempest-VolumesTransfersV355Test-1108577638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:38:56 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-5d36bf25-cb35-4835-8847-014b249e1eb7 tempest-VolumesTransfersV355Test-1108577638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:38:56 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-5d36bf25-cb35-4835-8847-014b249e1eb7 tempest-VolumesTransfersV355Test-1108577638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:38:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5d36bf25-cb35-4835-8847-014b249e1eb7 tempest-VolumesTransfersV355Test-1108577638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:38:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5d36bf25-cb35-4835-8847-014b249e1eb7 tempest-VolumesTransfersV355Test-1108577638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-24ef825d-5439-4fc3-be12-397c18c048b5 tempest-TestInstancesWithCinderVolumes-865228744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-ed5b7957-ce1a-466c-8010-be34e6ce89fd {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:56 devstack sudo[105612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:38:56 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:56 devstack sudo[105613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-ed5b7957-ce1a-466c-8010-be34e6ce89fd Jun 23 16:38:56 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:57 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d7a73a48-0274-4e24-8357-e96a32c61786 tempest-GroupsTest-2100010410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-feb9d878-0164-46c2-8936-88b8312aef1e" returned: 0 in 1.187s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d7a73a48-0274-4e24-8357-e96a32c61786 tempest-GroupsTest-2100010410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-feb9d878-0164-46c2-8936-88b8312aef1e {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:57 devstack sudo[105616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-feb9d878-0164-46c2-8936-88b8312aef1e Jun 23 16:38:57 devstack sudo[105616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:57 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5d36bf25-cb35-4835-8847-014b249e1eb7 tempest-VolumesTransfersV355Test-1108577638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.042s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:57 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-5d36bf25-cb35-4835-8847-014b249e1eb7 tempest-VolumesTransfersV355Test-1108577638 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:38:57 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-5d36bf25-cb35-4835-8847-014b249e1eb7 tempest-VolumesTransfersV355Test-1108577638 None] Deleted volume successfully. Jun 23 16:38:57 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5d36bf25-cb35-4835-8847-014b249e1eb7 tempest-VolumesTransfersV355Test-1108577638 None] Lock "cinder-114fd766-ee14-4b50-9851-cea149c38686-delete_volume" released by "delete_volume" :: held 3.964s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:38:58 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-24ef825d-5439-4fc3-be12-397c18c048b5 tempest-TestInstancesWithCinderVolumes-865228744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-ed5b7957-ce1a-466c-8010-be34e6ce89fd" returned: 0 in 1.188s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:58 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-24ef825d-5439-4fc3-be12-397c18c048b5 tempest-TestInstancesWithCinderVolumes-865228744 None] <== create_volume: return (2698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:38:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-24ef825d-5439-4fc3-be12-397c18c048b5 tempest-TestInstancesWithCinderVolumes-865228744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.701s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:38:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-24ef825d-5439-4fc3-be12-397c18c048b5 tempest-TestInstancesWithCinderVolumes-865228744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7f7e7af-7ed0-47b6-aa33-267c242843ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed5b7957-ce1a-466c-8010-be34e6ce89fd', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-24ef825d-5439-4fc3-be12-397c18c048b5 tempest-TestInstancesWithCinderVolumes-865228744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8cee5fe-3fbd-4e08-bcdb-be7661226b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:38:58 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-24ef825d-5439-4fc3-be12-397c18c048b5 tempest-TestInstancesWithCinderVolumes-865228744 None] Volume volume-ed5b7957-ce1a-466c-8010-be34e6ce89fd (ed5b7957-ce1a-466c-8010-be34e6ce89fd): created successfully Jun 23 16:38:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-24ef825d-5439-4fc3-be12-397c18c048b5 tempest-TestInstancesWithCinderVolumes-865228744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8cee5fe-3fbd-4e08-bcdb-be7661226b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:38:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-24ef825d-5439-4fc3-be12-397c18c048b5 tempest-TestInstancesWithCinderVolumes-865228744 None] Flow 'volume_create_manager' (d0cae056-b258-4176-80a7-e6fb2d5aa752) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:38:58 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-24ef825d-5439-4fc3-be12-397c18c048b5 tempest-TestInstancesWithCinderVolumes-865228744 None] Created volume successfully. Jun 23 16:38:58 devstack sudo[105616]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d7a73a48-0274-4e24-8357-e96a32c61786 tempest-GroupsTest-2100010410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-feb9d878-0164-46c2-8936-88b8312aef1e" returned: 0 in 1.207s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:58 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d7a73a48-0274-4e24-8357-e96a32c61786 tempest-GroupsTest-2100010410 None] Lock "cinder-quobyte-feb9d878-0164-46c2-8936-88b8312aef1e" released by "delete_volume" :: held 2.475s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:38:58 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-d7a73a48-0274-4e24-8357-e96a32c61786 tempest-GroupsTest-2100010410 None] Created reservations ['6b7902d0-cd67-4019-9fec-7175b9c109b7'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:38:58 devstack cinder-volume[93788]: WARNING cinder.quota [None req-d7a73a48-0274-4e24-8357-e96a32c61786 tempest-GroupsTest-2100010410 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-324514040 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-324514040, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:38:58 devstack cinder-volume[93788]: WARNING cinder.quota [None req-d7a73a48-0274-4e24-8357-e96a32c61786 tempest-GroupsTest-2100010410 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-324514040 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-324514040, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:38:58 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-d7a73a48-0274-4e24-8357-e96a32c61786 tempest-GroupsTest-2100010410 None] Created reservations ['e2f4aae0-fe1e-4dd2-8585-88bb8b31fdaa', '62617b7a-d18d-4d60-a5b2-62509c143d5d', '5dac3c3c-1fed-4dc7-aadb-69f9572ab935', '42e699fc-1b22-4073-9a07-e7aae862a478'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:38:58 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-d7a73a48-0274-4e24-8357-e96a32c61786 tempest-GroupsTest-2100010410 None] Created reservations ['f424f938-e5ea-4fcd-baa1-c911adebe211', 'dff7d27d-06d9-4272-8dd5-1ddaf300f092', '665d808a-ead8-4597-ba65-0e37b84ed362', 'e33ddcd0-959d-41b0-b72d-d7b0852e6010'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:38:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d7a73a48-0274-4e24-8357-e96a32c61786 tempest-GroupsTest-2100010410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:38:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d7a73a48-0274-4e24-8357-e96a32c61786 tempest-GroupsTest-2100010410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:38:58 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-d7a73a48-0274-4e24-8357-e96a32c61786 tempest-GroupsTest-2100010410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:38:58 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-d7a73a48-0274-4e24-8357-e96a32c61786 tempest-GroupsTest-2100010410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:38:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d7a73a48-0274-4e24-8357-e96a32c61786 tempest-GroupsTest-2100010410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:38:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d7a73a48-0274-4e24-8357-e96a32c61786 tempest-GroupsTest-2100010410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:38:58 devstack sudo[105622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:38:58 devstack sudo[105622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:38:59 devstack sudo[105622]: pam_unix(sudo:session): session closed for user root Jun 23 16:38:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d7a73a48-0274-4e24-8357-e96a32c61786 tempest-GroupsTest-2100010410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.842s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:38:59 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-d7a73a48-0274-4e24-8357-e96a32c61786 tempest-GroupsTest-2100010410 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:38:59 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-d7a73a48-0274-4e24-8357-e96a32c61786 tempest-GroupsTest-2100010410 None] Delete group completed successfully. Jun 23 16:39:01 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0887b9d3-87b4-49cb-9e09-4239c820f3b7_zew0dm83devstack@QuobyteHD, size 20.69 MB, duration 5.12 sec {{(pid=93788) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 16:39:01 devstack cinder-volume[93788]: INFO cinder.image.image_utils [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] Image download 20.69 MB at 4.04 MB/s Jun 23 16:39:01 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe112f7-d9b1-4d54-9ef1-95b079c422bc]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:39:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0887b9d3-87b4-49cb-9e09-4239c820f3b7_zew0dm83devstack@QuobyteHD {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:01 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:39:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:39:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:39:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:39:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:39:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:39:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:01 devstack sudo[105626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:39:01 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:01 devstack sudo[105625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0887b9d3-87b4-49cb-9e09-4239c820f3b7_zew0dm83devstack@QuobyteHD Jun 23 16:39:01 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:02 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.051s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:02 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:39:02 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager._thread_info {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:39:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread count: 28 {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 16:39:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread info: [<_MainThread(MainThread, started 126303828988032)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 16:39:02 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9fd9cb2-5db4-47d8-bef8-df1b577a483c tempest-VolumesListAdminTestJSON-1302367810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:39:02 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e9fd9cb2-5db4-47d8-bef8-df1b577a483c tempest-VolumesListAdminTestJSON-1302367810 None] Flow 'volume_create_manager' (0643cd03-778a-4b49-a162-deaa92c60ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:39:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e9fd9cb2-5db4-47d8-bef8-df1b577a483c tempest-VolumesListAdminTestJSON-1302367810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28e2aea5-95d6-41d9-86e7-bfe8b25c4075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0887b9d3-87b4-49cb-9e09-4239c820f3b7_zew0dm83devstack@QuobyteHD" returned: 0 in 1.258s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:02 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] Temporary image 0887b9d3-87b4-49cb-9e09-4239c820f3b7 is fetched for user b484b0ba25a94c438d3fbb4b472e6d2c. {{(pid=93788) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 16:39:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e9fd9cb2-5db4-47d8-bef8-df1b577a483c tempest-VolumesListAdminTestJSON-1302367810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28e2aea5-95d6-41d9-86e7-bfe8b25c4075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:39:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-714060564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41d163ea-1796-47e0-a657-1b740c57ffb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c84e996bd5b64daca37c0ede5157dc5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:39:02Z,use_quota=True,user_id='b4d4247d39d74c4fa28213045976b390',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e9fd9cb2-5db4-47d8-bef8-df1b577a483c tempest-VolumesListAdminTestJSON-1302367810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (851fb832-871e-4284-8ba3-a21d6d718679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e9fd9cb2-5db4-47d8-bef8-df1b577a483c tempest-VolumesListAdminTestJSON-1302367810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (851fb832-871e-4284-8ba3-a21d6d718679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e9fd9cb2-5db4-47d8-bef8-df1b577a483c tempest-VolumesListAdminTestJSON-1302367810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4564be03-003e-4cae-bc9b-a5f65de942d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e9fd9cb2-5db4-47d8-bef8-df1b577a483c tempest-VolumesListAdminTestJSON-1302367810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4564be03-003e-4cae-bc9b-a5f65de942d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41d163ea-1796-47e0-a657-1b740c57ffb2', 'volume_name': 'volume-41d163ea-1796-47e0-a657-1b740c57ffb2', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e9fd9cb2-5db4-47d8-bef8-df1b577a483c tempest-VolumesListAdminTestJSON-1302367810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7fe4fd4-bc12-44ea-b383-5e520fcf14c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e9fd9cb2-5db4-47d8-bef8-df1b577a483c tempest-VolumesListAdminTestJSON-1302367810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7fe4fd4-bc12-44ea-b383-5e520fcf14c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e9fd9cb2-5db4-47d8-bef8-df1b577a483c tempest-VolumesListAdminTestJSON-1302367810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37adbcd5-d4bf-4230-ab2a-037bfd939f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:02 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-e9fd9cb2-5db4-47d8-bef8-df1b577a483c tempest-VolumesListAdminTestJSON-1302367810 None] Volume 41d163ea-1796-47e0-a657-1b740c57ffb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41d163ea-1796-47e0-a657-1b740c57ffb2', 'volume_size': 1} Jun 23 16:39:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e9fd9cb2-5db4-47d8-bef8-df1b577a483c tempest-VolumesListAdminTestJSON-1302367810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:39:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e9fd9cb2-5db4-47d8-bef8-df1b577a483c tempest-VolumesListAdminTestJSON-1302367810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:39:02 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e9fd9cb2-5db4-47d8-bef8-df1b577a483c tempest-VolumesListAdminTestJSON-1302367810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:39:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-714060564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41d163ea-1796-47e0-a657-1b740c57ffb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c84e996bd5b64daca37c0ede5157dc5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:39:02Z,use_quota=True,user_id='b4d4247d39d74c4fa28213045976b390',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:39:02 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-e9fd9cb2-5db4-47d8-bef8-df1b577a483c tempest-VolumesListAdminTestJSON-1302367810 None] Creating volume 41d163ea-1796-47e0-a657-1b740c57ffb2 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:39:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e9fd9cb2-5db4-47d8-bef8-df1b577a483c tempest-VolumesListAdminTestJSON-1302367810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:39:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e9fd9cb2-5db4-47d8-bef8-df1b577a483c tempest-VolumesListAdminTestJSON-1302367810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:39:02 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e9fd9cb2-5db4-47d8-bef8-df1b577a483c tempest-VolumesListAdminTestJSON-1302367810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:39:02 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e9fd9cb2-5db4-47d8-bef8-df1b577a483c tempest-VolumesListAdminTestJSON-1302367810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:39:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e9fd9cb2-5db4-47d8-bef8-df1b577a483c tempest-VolumesListAdminTestJSON-1302367810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:39:02 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e9fd9cb2-5db4-47d8-bef8-df1b577a483c tempest-VolumesListAdminTestJSON-1302367810 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:39:02 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-e9fd9cb2-5db4-47d8-bef8-df1b577a483c tempest-VolumesListAdminTestJSON-1302367810 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:39:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e9fd9cb2-5db4-47d8-bef8-df1b577a483c tempest-VolumesListAdminTestJSON-1302367810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-41d163ea-1796-47e0-a657-1b740c57ffb2 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:02 devstack sudo[105634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-41d163ea-1796-47e0-a657-1b740c57ffb2 1073741824 Jun 23 16:39:02 devstack sudo[105634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:02 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[59332028-445f-4d96-99bd-eb3e194a9d20]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:39:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0887b9d3-87b4-49cb-9e09-4239c820f3b7_zew0dm83devstack@QuobyteHD {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:02 devstack sudo[105636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0887b9d3-87b4-49cb-9e09-4239c820f3b7_zew0dm83devstack@QuobyteHD Jun 23 16:39:02 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:03 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0887b9d3-87b4-49cb-9e09-4239c820f3b7_zew0dm83devstack@QuobyteHD" returned: 0 in 1.001s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:39:03 devstack sudo[105634]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e9fd9cb2-5db4-47d8-bef8-df1b577a483c tempest-VolumesListAdminTestJSON-1302367810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-41d163ea-1796-47e0-a657-1b740c57ffb2 1073741824" returned: 0 in 1.164s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e9fd9cb2-5db4-47d8-bef8-df1b577a483c tempest-VolumesListAdminTestJSON-1302367810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-41d163ea-1796-47e0-a657-1b740c57ffb2 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:03 devstack sudo[105645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-41d163ea-1796-47e0-a657-1b740c57ffb2 Jun 23 16:39:03 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:04 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e9fd9cb2-5db4-47d8-bef8-df1b577a483c tempest-VolumesListAdminTestJSON-1302367810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-41d163ea-1796-47e0-a657-1b740c57ffb2" returned: 0 in 0.727s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:04 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e9fd9cb2-5db4-47d8-bef8-df1b577a483c tempest-VolumesListAdminTestJSON-1302367810 None] <== create_volume: return (1971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:39:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e9fd9cb2-5db4-47d8-bef8-df1b577a483c tempest-VolumesListAdminTestJSON-1302367810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.974s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:39:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.887s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:39:04 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:38:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1014531495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d607b6f6-a013-44e8-bd80-e8a3d6356a83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b5eb69099bd4622b5be7b1cfb9d80bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:38:55Z,use_quota=True,user_id='b484b0ba25a94c438d3fbb4b472e6d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(18538c8f-390a-412f-bab3-55bb5cd1f331),volume_type_id=18538c8f-390a-412f-bab3-55bb5cd1f331)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:39:04 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] Creating volume d607b6f6-a013-44e8-bd80-e8a3d6356a83 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:39:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:39:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:39:04 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:39:04 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:39:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:39:04 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:39:04 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:39:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d607b6f6-a013-44e8-bd80-e8a3d6356a83 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:04 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e9fd9cb2-5db4-47d8-bef8-df1b577a483c tempest-VolumesListAdminTestJSON-1302367810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37adbcd5-d4bf-4230-ab2a-037bfd939f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41d163ea-1796-47e0-a657-1b740c57ffb2', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:04 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d607b6f6-a013-44e8-bd80-e8a3d6356a83 1073741824 Jun 23 16:39:04 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:04 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e9fd9cb2-5db4-47d8-bef8-df1b577a483c tempest-VolumesListAdminTestJSON-1302367810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec829763-9963-4e20-a9b4-0fd76e1f4738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:04 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-e9fd9cb2-5db4-47d8-bef8-df1b577a483c tempest-VolumesListAdminTestJSON-1302367810 None] Volume volume-41d163ea-1796-47e0-a657-1b740c57ffb2 (41d163ea-1796-47e0-a657-1b740c57ffb2): created successfully Jun 23 16:39:04 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e9fd9cb2-5db4-47d8-bef8-df1b577a483c tempest-VolumesListAdminTestJSON-1302367810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec829763-9963-4e20-a9b4-0fd76e1f4738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:04 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e9fd9cb2-5db4-47d8-bef8-df1b577a483c tempest-VolumesListAdminTestJSON-1302367810 None] Flow 'volume_create_manager' (0643cd03-778a-4b49-a162-deaa92c60ef4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:39:04 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-e9fd9cb2-5db4-47d8-bef8-df1b577a483c tempest-VolumesListAdminTestJSON-1302367810 None] Created volume successfully. Jun 23 16:39:05 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d607b6f6-a013-44e8-bd80-e8a3d6356a83 1073741824" returned: 0 in 1.015s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d607b6f6-a013-44e8-bd80-e8a3d6356a83 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:05 devstack sudo[105654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d607b6f6-a013-44e8-bd80-e8a3d6356a83 Jun 23 16:39:05 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:06 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-17dc2963-621c-48d3-b2c9-dcc053bdb19e tempest-VolumesListAdminTestJSON-1302367810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:39:06 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-17dc2963-621c-48d3-b2c9-dcc053bdb19e tempest-VolumesListAdminTestJSON-1302367810 None] Flow 'volume_create_manager' (0755b9e8-1b24-42a4-8bb6-4a365e4e4e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:39:06 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-17dc2963-621c-48d3-b2c9-dcc053bdb19e tempest-VolumesListAdminTestJSON-1302367810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d734ec21-316a-48c7-a0fe-e275913d0b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:06 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-17dc2963-621c-48d3-b2c9-dcc053bdb19e tempest-VolumesListAdminTestJSON-1302367810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d734ec21-316a-48c7-a0fe-e275913d0b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1525122537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7b53ebc-3caa-4fd6-9608-170cf30a8e00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c84e996bd5b64daca37c0ede5157dc5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:39:06Z,use_quota=True,user_id='b4d4247d39d74c4fa28213045976b390',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:06 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-17dc2963-621c-48d3-b2c9-dcc053bdb19e tempest-VolumesListAdminTestJSON-1302367810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c78eeee8-c27c-468a-afcd-190ad24dfc12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:06 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-17dc2963-621c-48d3-b2c9-dcc053bdb19e tempest-VolumesListAdminTestJSON-1302367810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c78eeee8-c27c-468a-afcd-190ad24dfc12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:06 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-17dc2963-621c-48d3-b2c9-dcc053bdb19e tempest-VolumesListAdminTestJSON-1302367810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3e81387-c85f-4dfb-a1db-ebf3ff7cc97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:06 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-17dc2963-621c-48d3-b2c9-dcc053bdb19e tempest-VolumesListAdminTestJSON-1302367810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3e81387-c85f-4dfb-a1db-ebf3ff7cc97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7b53ebc-3caa-4fd6-9608-170cf30a8e00', 'volume_name': 'volume-c7b53ebc-3caa-4fd6-9608-170cf30a8e00', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:06 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-17dc2963-621c-48d3-b2c9-dcc053bdb19e tempest-VolumesListAdminTestJSON-1302367810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9e209e3-c66e-4f9a-9aaf-a02a5a94f66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:06 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-17dc2963-621c-48d3-b2c9-dcc053bdb19e tempest-VolumesListAdminTestJSON-1302367810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9e209e3-c66e-4f9a-9aaf-a02a5a94f66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:06 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-17dc2963-621c-48d3-b2c9-dcc053bdb19e tempest-VolumesListAdminTestJSON-1302367810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a065c49-a037-4189-9356-18017ad4c04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:06 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-17dc2963-621c-48d3-b2c9-dcc053bdb19e tempest-VolumesListAdminTestJSON-1302367810 None] Volume c7b53ebc-3caa-4fd6-9608-170cf30a8e00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7b53ebc-3caa-4fd6-9608-170cf30a8e00', 'volume_size': 1} Jun 23 16:39:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-17dc2963-621c-48d3-b2c9-dcc053bdb19e tempest-VolumesListAdminTestJSON-1302367810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:39:06 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d607b6f6-a013-44e8-bd80-e8a3d6356a83" returned: 0 in 0.864s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:06 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] <== create_volume: return (1930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:39:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.932s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:39:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-17dc2963-621c-48d3-b2c9-dcc053bdb19e tempest-VolumesListAdminTestJSON-1302367810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.126s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:39:06 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-17dc2963-621c-48d3-b2c9-dcc053bdb19e tempest-VolumesListAdminTestJSON-1302367810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1525122537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7b53ebc-3caa-4fd6-9608-170cf30a8e00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c84e996bd5b64daca37c0ede5157dc5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:39:06Z,use_quota=True,user_id='b4d4247d39d74c4fa28213045976b390',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:39:06 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-17dc2963-621c-48d3-b2c9-dcc053bdb19e tempest-VolumesListAdminTestJSON-1302367810 None] Creating volume c7b53ebc-3caa-4fd6-9608-170cf30a8e00 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:39:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-17dc2963-621c-48d3-b2c9-dcc053bdb19e tempest-VolumesListAdminTestJSON-1302367810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:39:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-17dc2963-621c-48d3-b2c9-dcc053bdb19e tempest-VolumesListAdminTestJSON-1302367810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:39:06 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-17dc2963-621c-48d3-b2c9-dcc053bdb19e tempest-VolumesListAdminTestJSON-1302367810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:39:06 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-17dc2963-621c-48d3-b2c9-dcc053bdb19e tempest-VolumesListAdminTestJSON-1302367810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:39:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-17dc2963-621c-48d3-b2c9-dcc053bdb19e tempest-VolumesListAdminTestJSON-1302367810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:39:06 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-17dc2963-621c-48d3-b2c9-dcc053bdb19e tempest-VolumesListAdminTestJSON-1302367810 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:39:06 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-17dc2963-621c-48d3-b2c9-dcc053bdb19e tempest-VolumesListAdminTestJSON-1302367810 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:39:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-17dc2963-621c-48d3-b2c9-dcc053bdb19e tempest-VolumesListAdminTestJSON-1302367810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c7b53ebc-3caa-4fd6-9608-170cf30a8e00 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:06 devstack sudo[105657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c7b53ebc-3caa-4fd6-9608-170cf30a8e00 1073741824 Jun 23 16:39:06 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:06 devstack cinder-volume[93788]: DEBUG cinder.volume.volume_utils [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] Attempting download of 0887b9d3-87b4-49cb-9e09-4239c820f3b7 ((None, [{'url': 'file:///opt/stack/data/glance/images/0887b9d3-87b4-49cb-9e09-4239c820f3b7', 'metadata': {}}])) to volume d607b6f6-a013-44e8-bd80-e8a3d6356a83. {{(pid=93788) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 16:39:06 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[10960ee8-f6be-44d2-93bb-a05dc90f2950]: (4, 'raw') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:39:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0887b9d3-87b4-49cb-9e09-4239c820f3b7_gqanxlju {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:06 devstack sudo[105659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0887b9d3-87b4-49cb-9e09-4239c820f3b7_gqanxlju Jun 23 16:39:06 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:07 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-895c0d1f-b80e-41d9-8ede-67d8fbbf449b tempest-GroupsV320Test-889167702 None] Group tempest-GroupsV320Test-Group-1314323348: creating Jun 23 16:39:07 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-895c0d1f-b80e-41d9-8ede-67d8fbbf449b tempest-GroupsV320Test-889167702 None] Group tempest-GroupsV320Test-Group-1314323348: created successfully Jun 23 16:39:07 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-895c0d1f-b80e-41d9-8ede-67d8fbbf449b tempest-GroupsV320Test-889167702 None] Create group completed successfully. Jun 23 16:39:07 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0887b9d3-87b4-49cb-9e09-4239c820f3b7_gqanxlju" returned: 0 in 0.907s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0887b9d3-87b4-49cb-9e09-4239c820f3b7_gqanxlju {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:07 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-17dc2963-621c-48d3-b2c9-dcc053bdb19e tempest-VolumesListAdminTestJSON-1302367810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c7b53ebc-3caa-4fd6-9608-170cf30a8e00 1073741824" returned: 0 in 1.066s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:07 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-03737783-d061-4928-bbb4-c9d0afdbbcaa tempest-VolumesTransfersV357Test-1597628400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:39:07 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-03737783-d061-4928-bbb4-c9d0afdbbcaa tempest-VolumesTransfersV357Test-1597628400 None] Flow 'volume_create_manager' (00d18cfd-00cc-4b6a-b0fb-cdb9dc5bdefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:39:07 devstack sudo[105667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0887b9d3-87b4-49cb-9e09-4239c820f3b7_gqanxlju Jun 23 16:39:07 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:07 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-03737783-d061-4928-bbb4-c9d0afdbbcaa tempest-VolumesTransfersV357Test-1597628400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9ec0536-d5bd-463f-aebb-f5c96850d059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-17dc2963-621c-48d3-b2c9-dcc053bdb19e tempest-VolumesListAdminTestJSON-1302367810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c7b53ebc-3caa-4fd6-9608-170cf30a8e00 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:07 devstack sudo[105669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c7b53ebc-3caa-4fd6-9608-170cf30a8e00 Jun 23 16:39:07 devstack sudo[105669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:07 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-03737783-d061-4928-bbb4-c9d0afdbbcaa tempest-VolumesTransfersV357Test-1597628400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9ec0536-d5bd-463f-aebb-f5c96850d059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:39:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1241797284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5467ec8-da8a-44cc-9af0-bd90bd97bc1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6524116848ad4226a057859049ffea9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:39:08Z,use_quota=True,user_id='c36528ab948348ca88f1b900cfc88103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:07 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-03737783-d061-4928-bbb4-c9d0afdbbcaa tempest-VolumesTransfersV357Test-1597628400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de337cf6-ccde-471f-8e29-eddfada7937a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:07 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-03737783-d061-4928-bbb4-c9d0afdbbcaa tempest-VolumesTransfersV357Test-1597628400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de337cf6-ccde-471f-8e29-eddfada7937a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:07 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-03737783-d061-4928-bbb4-c9d0afdbbcaa tempest-VolumesTransfersV357Test-1597628400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5faef34d-b030-4bdc-a2e0-ae63de9055b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:07 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-03737783-d061-4928-bbb4-c9d0afdbbcaa tempest-VolumesTransfersV357Test-1597628400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5faef34d-b030-4bdc-a2e0-ae63de9055b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5467ec8-da8a-44cc-9af0-bd90bd97bc1e', 'volume_name': 'volume-e5467ec8-da8a-44cc-9af0-bd90bd97bc1e', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:07 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-03737783-d061-4928-bbb4-c9d0afdbbcaa tempest-VolumesTransfersV357Test-1597628400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91e949ad-6ff2-45c7-8699-6a3940a60dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:07 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-03737783-d061-4928-bbb4-c9d0afdbbcaa tempest-VolumesTransfersV357Test-1597628400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91e949ad-6ff2-45c7-8699-6a3940a60dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:07 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-03737783-d061-4928-bbb4-c9d0afdbbcaa tempest-VolumesTransfersV357Test-1597628400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (129e9307-20e8-4b1e-8f86-10d156acfa6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:07 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-03737783-d061-4928-bbb4-c9d0afdbbcaa tempest-VolumesTransfersV357Test-1597628400 None] Volume e5467ec8-da8a-44cc-9af0-bd90bd97bc1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5467ec8-da8a-44cc-9af0-bd90bd97bc1e', 'volume_size': 1} Jun 23 16:39:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-03737783-d061-4928-bbb4-c9d0afdbbcaa tempest-VolumesTransfersV357Test-1597628400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:39:08 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0887b9d3-87b4-49cb-9e09-4239c820f3b7_gqanxlju" returned: 1 in 0.744s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0887b9d3-87b4-49cb-9e09-4239c820f3b7_gqanxlju' failed. Not Retrying. {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:39:08 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd45531-c842-4769-a970-a60afc6c46f1]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:39:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0887b9d3-87b4-49cb-9e09-4239c820f3b7_zew0dm83devstack@QuobyteHD {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:08 devstack sudo[105669]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-17dc2963-621c-48d3-b2c9-dcc053bdb19e tempest-VolumesListAdminTestJSON-1302367810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c7b53ebc-3caa-4fd6-9608-170cf30a8e00" returned: 0 in 0.663s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:08 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-17dc2963-621c-48d3-b2c9-dcc053bdb19e tempest-VolumesListAdminTestJSON-1302367810 None] <== create_volume: return (1825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:39:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-17dc2963-621c-48d3-b2c9-dcc053bdb19e tempest-VolumesListAdminTestJSON-1302367810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.830s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:39:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-03737783-d061-4928-bbb4-c9d0afdbbcaa tempest-VolumesTransfersV357Test-1597628400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.600s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:39:08 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-03737783-d061-4928-bbb4-c9d0afdbbcaa tempest-VolumesTransfersV357Test-1597628400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:39:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1241797284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5467ec8-da8a-44cc-9af0-bd90bd97bc1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6524116848ad4226a057859049ffea9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:39:08Z,use_quota=True,user_id='c36528ab948348ca88f1b900cfc88103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:39:08 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-03737783-d061-4928-bbb4-c9d0afdbbcaa tempest-VolumesTransfersV357Test-1597628400 None] Creating volume e5467ec8-da8a-44cc-9af0-bd90bd97bc1e {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:39:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-03737783-d061-4928-bbb4-c9d0afdbbcaa tempest-VolumesTransfersV357Test-1597628400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:39:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-03737783-d061-4928-bbb4-c9d0afdbbcaa tempest-VolumesTransfersV357Test-1597628400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:39:08 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-03737783-d061-4928-bbb4-c9d0afdbbcaa tempest-VolumesTransfersV357Test-1597628400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:39:08 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-03737783-d061-4928-bbb4-c9d0afdbbcaa tempest-VolumesTransfersV357Test-1597628400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:39:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-03737783-d061-4928-bbb4-c9d0afdbbcaa tempest-VolumesTransfersV357Test-1597628400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:39:08 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-03737783-d061-4928-bbb4-c9d0afdbbcaa tempest-VolumesTransfersV357Test-1597628400 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:39:08 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-03737783-d061-4928-bbb4-c9d0afdbbcaa tempest-VolumesTransfersV357Test-1597628400 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:39:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-03737783-d061-4928-bbb4-c9d0afdbbcaa tempest-VolumesTransfersV357Test-1597628400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e5467ec8-da8a-44cc-9af0-bd90bd97bc1e 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:08 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-17dc2963-621c-48d3-b2c9-dcc053bdb19e tempest-VolumesListAdminTestJSON-1302367810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a065c49-a037-4189-9356-18017ad4c04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7b53ebc-3caa-4fd6-9608-170cf30a8e00', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:08 devstack sudo[105675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e5467ec8-da8a-44cc-9af0-bd90bd97bc1e 1073741824 Jun 23 16:39:08 devstack sudo[105675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:08 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-17dc2963-621c-48d3-b2c9-dcc053bdb19e tempest-VolumesListAdminTestJSON-1302367810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e916e887-5e90-4a3a-8966-1014b15459a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:08 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-17dc2963-621c-48d3-b2c9-dcc053bdb19e tempest-VolumesListAdminTestJSON-1302367810 None] Volume volume-c7b53ebc-3caa-4fd6-9608-170cf30a8e00 (c7b53ebc-3caa-4fd6-9608-170cf30a8e00): created successfully Jun 23 16:39:08 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-17dc2963-621c-48d3-b2c9-dcc053bdb19e tempest-VolumesListAdminTestJSON-1302367810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e916e887-5e90-4a3a-8966-1014b15459a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:08 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0887b9d3-87b4-49cb-9e09-4239c820f3b7_zew0dm83devstack@QuobyteHD Jun 23 16:39:08 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:08 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-17dc2963-621c-48d3-b2c9-dcc053bdb19e tempest-VolumesListAdminTestJSON-1302367810 None] Flow 'volume_create_manager' (0755b9e8-1b24-42a4-8bb6-4a365e4e4e65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:39:08 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-17dc2963-621c-48d3-b2c9-dcc053bdb19e tempest-VolumesListAdminTestJSON-1302367810 None] Created volume successfully. Jun 23 16:39:08 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-97dba8cd-9f7a-4420-b04e-5db46c808749 tempest-GroupsV320Test-889167702 None] Created reservations ['5bbf3a20-e4e1-4a66-a07a-0e92fca9dcd9'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:39:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-97dba8cd-9f7a-4420-b04e-5db46c808749 tempest-GroupsV320Test-889167702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:39:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-97dba8cd-9f7a-4420-b04e-5db46c808749 tempest-GroupsV320Test-889167702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:39:08 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-97dba8cd-9f7a-4420-b04e-5db46c808749 tempest-GroupsV320Test-889167702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:39:08 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-97dba8cd-9f7a-4420-b04e-5db46c808749 tempest-GroupsV320Test-889167702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:39:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-97dba8cd-9f7a-4420-b04e-5db46c808749 tempest-GroupsV320Test-889167702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:39:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-97dba8cd-9f7a-4420-b04e-5db46c808749 tempest-GroupsV320Test-889167702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:08 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:39:08 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:09 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0887b9d3-87b4-49cb-9e09-4239c820f3b7_zew0dm83devstack@QuobyteHD" returned: 0 in 0.760s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:09 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] 0887b9d3-87b4-49cb-9e09-4239c820f3b7 was qcow2, converting to raw {{(pid=93788) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 16:39:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0887b9d3-87b4-49cb-9e09-4239c820f3b7_zew0dm83devstack@QuobyteHD /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d607b6f6-a013-44e8-bd80-e8a3d6356a83 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:09 devstack sudo[105687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0887b9d3-87b4-49cb-9e09-4239c820f3b7_zew0dm83devstack@QuobyteHD /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d607b6f6-a013-44e8-bd80-e8a3d6356a83 Jun 23 16:39:09 devstack sudo[105687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:09 devstack sudo[105675]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-03737783-d061-4928-bbb4-c9d0afdbbcaa tempest-VolumesTransfersV357Test-1597628400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e5467ec8-da8a-44cc-9af0-bd90bd97bc1e 1073741824" returned: 0 in 0.968s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-03737783-d061-4928-bbb4-c9d0afdbbcaa tempest-VolumesTransfersV357Test-1597628400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e5467ec8-da8a-44cc-9af0-bd90bd97bc1e {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:09 devstack sudo[105690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e5467ec8-da8a-44cc-9af0-bd90bd97bc1e Jun 23 16:39:09 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:09 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-97dba8cd-9f7a-4420-b04e-5db46c808749 tempest-GroupsV320Test-889167702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.694s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:09 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-97dba8cd-9f7a-4420-b04e-5db46c808749 tempest-GroupsV320Test-889167702 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:39:09 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-97dba8cd-9f7a-4420-b04e-5db46c808749 tempest-GroupsV320Test-889167702 None] Delete group completed successfully. Jun 23 16:39:10 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebed314e-092b-4d2a-b141-8b7c33e6320c tempest-VolumesListAdminTestJSON-1302367810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:39:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ebed314e-092b-4d2a-b141-8b7c33e6320c tempest-VolumesListAdminTestJSON-1302367810 None] Flow 'volume_create_manager' (2cbd5559-a6ea-4f39-9422-7f762d9f3a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:39:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ebed314e-092b-4d2a-b141-8b7c33e6320c tempest-VolumesListAdminTestJSON-1302367810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d87eb1c-c9dc-4e0f-9c0e-da63870dd4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ebed314e-092b-4d2a-b141-8b7c33e6320c tempest-VolumesListAdminTestJSON-1302367810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d87eb1c-c9dc-4e0f-9c0e-da63870dd4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-934906325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=474bb062-202b-46a2-998a-d49393c46182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c84e996bd5b64daca37c0ede5157dc5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:39:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:39:10Z,use_quota=True,user_id='b4d4247d39d74c4fa28213045976b390',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ebed314e-092b-4d2a-b141-8b7c33e6320c tempest-VolumesListAdminTestJSON-1302367810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55e473fe-db11-4df2-b3c6-2f49d8329d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ebed314e-092b-4d2a-b141-8b7c33e6320c tempest-VolumesListAdminTestJSON-1302367810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55e473fe-db11-4df2-b3c6-2f49d8329d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ebed314e-092b-4d2a-b141-8b7c33e6320c tempest-VolumesListAdminTestJSON-1302367810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c4232bb-06bf-40b4-939d-bbf5ecead77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ebed314e-092b-4d2a-b141-8b7c33e6320c tempest-VolumesListAdminTestJSON-1302367810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c4232bb-06bf-40b4-939d-bbf5ecead77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '474bb062-202b-46a2-998a-d49393c46182', 'volume_name': 'volume-474bb062-202b-46a2-998a-d49393c46182', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ebed314e-092b-4d2a-b141-8b7c33e6320c tempest-VolumesListAdminTestJSON-1302367810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23849dd0-ab63-4831-ba80-c7a2971ddfb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ebed314e-092b-4d2a-b141-8b7c33e6320c tempest-VolumesListAdminTestJSON-1302367810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23849dd0-ab63-4831-ba80-c7a2971ddfb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ebed314e-092b-4d2a-b141-8b7c33e6320c tempest-VolumesListAdminTestJSON-1302367810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e4e354c-5f4f-4817-af6c-0ae4c2ac312f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:10 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:10 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-ebed314e-092b-4d2a-b141-8b7c33e6320c tempest-VolumesListAdminTestJSON-1302367810 None] Volume 474bb062-202b-46a2-998a-d49393c46182: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-474bb062-202b-46a2-998a-d49393c46182', 'volume_size': 1} Jun 23 16:39:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ebed314e-092b-4d2a-b141-8b7c33e6320c tempest-VolumesListAdminTestJSON-1302367810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:39:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-03737783-d061-4928-bbb4-c9d0afdbbcaa tempest-VolumesTransfersV357Test-1597628400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e5467ec8-da8a-44cc-9af0-bd90bd97bc1e" returned: 0 in 0.947s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:10 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-03737783-d061-4928-bbb4-c9d0afdbbcaa tempest-VolumesTransfersV357Test-1597628400 None] <== create_volume: return (1970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:39:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-03737783-d061-4928-bbb4-c9d0afdbbcaa tempest-VolumesTransfersV357Test-1597628400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.974s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:39:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ebed314e-092b-4d2a-b141-8b7c33e6320c tempest-VolumesListAdminTestJSON-1302367810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.012s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:39:10 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-ebed314e-092b-4d2a-b141-8b7c33e6320c tempest-VolumesListAdminTestJSON-1302367810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-934906325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=474bb062-202b-46a2-998a-d49393c46182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c84e996bd5b64daca37c0ede5157dc5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:39:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:39:10Z,use_quota=True,user_id='b4d4247d39d74c4fa28213045976b390',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:39:10 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-ebed314e-092b-4d2a-b141-8b7c33e6320c tempest-VolumesListAdminTestJSON-1302367810 None] Creating volume 474bb062-202b-46a2-998a-d49393c46182 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:39:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ebed314e-092b-4d2a-b141-8b7c33e6320c tempest-VolumesListAdminTestJSON-1302367810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:39:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ebed314e-092b-4d2a-b141-8b7c33e6320c tempest-VolumesListAdminTestJSON-1302367810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:39:10 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-ebed314e-092b-4d2a-b141-8b7c33e6320c tempest-VolumesListAdminTestJSON-1302367810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:39:10 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-ebed314e-092b-4d2a-b141-8b7c33e6320c tempest-VolumesListAdminTestJSON-1302367810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:39:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ebed314e-092b-4d2a-b141-8b7c33e6320c tempest-VolumesListAdminTestJSON-1302367810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:39:10 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-ebed314e-092b-4d2a-b141-8b7c33e6320c tempest-VolumesListAdminTestJSON-1302367810 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:39:10 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-ebed314e-092b-4d2a-b141-8b7c33e6320c tempest-VolumesListAdminTestJSON-1302367810 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:39:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ebed314e-092b-4d2a-b141-8b7c33e6320c tempest-VolumesListAdminTestJSON-1302367810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-474bb062-202b-46a2-998a-d49393c46182 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:10 devstack sudo[105699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-474bb062-202b-46a2-998a-d49393c46182 1073741824 Jun 23 16:39:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-03737783-d061-4928-bbb4-c9d0afdbbcaa tempest-VolumesTransfersV357Test-1597628400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (129e9307-20e8-4b1e-8f86-10d156acfa6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5467ec8-da8a-44cc-9af0-bd90bd97bc1e', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:10 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-03737783-d061-4928-bbb4-c9d0afdbbcaa tempest-VolumesTransfersV357Test-1597628400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f88bd284-a470-4ef5-9653-f1959d171901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:10 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-03737783-d061-4928-bbb4-c9d0afdbbcaa tempest-VolumesTransfersV357Test-1597628400 None] Volume volume-e5467ec8-da8a-44cc-9af0-bd90bd97bc1e (e5467ec8-da8a-44cc-9af0-bd90bd97bc1e): created successfully Jun 23 16:39:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-03737783-d061-4928-bbb4-c9d0afdbbcaa tempest-VolumesTransfersV357Test-1597628400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f88bd284-a470-4ef5-9653-f1959d171901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-03737783-d061-4928-bbb4-c9d0afdbbcaa tempest-VolumesTransfersV357Test-1597628400 None] Flow 'volume_create_manager' (00d18cfd-00cc-4b6a-b0fb-cdb9dc5bdefe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:39:10 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-03737783-d061-4928-bbb4-c9d0afdbbcaa tempest-VolumesTransfersV357Test-1597628400 None] Created volume successfully. Jun 23 16:39:11 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ebed314e-092b-4d2a-b141-8b7c33e6320c tempest-VolumesListAdminTestJSON-1302367810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-474bb062-202b-46a2-998a-d49393c46182 1073741824" returned: 0 in 1.137s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ebed314e-092b-4d2a-b141-8b7c33e6320c tempest-VolumesListAdminTestJSON-1302367810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-474bb062-202b-46a2-998a-d49393c46182 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:11 devstack sudo[105687]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0887b9d3-87b4-49cb-9e09-4239c820f3b7_zew0dm83devstack@QuobyteHD /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d607b6f6-a013-44e8-bd80-e8a3d6356a83" returned: 0 in 2.472s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:11 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0887b9d3-87b4-49cb-9e09-4239c820f3b7_zew0dm83devstack@QuobyteHD, size 112.00 MB, duration 2.48 sec, destination /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d607b6f6-a013-44e8-bd80-e8a3d6356a83 {{(pid=93788) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 16:39:11 devstack cinder-volume[93788]: INFO cinder.image.image_utils [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] Converted 112.00 MB image at 45.25 MB/s Jun 23 16:39:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d607b6f6-a013-44e8-bd80-e8a3d6356a83 1G {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:11 devstack sudo[105706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-474bb062-202b-46a2-998a-d49393c46182 Jun 23 16:39:11 devstack sudo[105706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:11 devstack sudo[105707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d607b6f6-a013-44e8-bd80-e8a3d6356a83 1G Jun 23 16:39:11 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:12 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-82c6cf74-6a07-4172-a332-ccda7d3f7da7 tempest-VolumesTransfersV357Test-1575054452 None] Transfer volume completed successfully. Jun 23 16:39:12 devstack sudo[105706]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ebed314e-092b-4d2a-b141-8b7c33e6320c tempest-VolumesListAdminTestJSON-1302367810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-474bb062-202b-46a2-998a-d49393c46182" returned: 0 in 0.853s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:12 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-ebed314e-092b-4d2a-b141-8b7c33e6320c tempest-VolumesListAdminTestJSON-1302367810 None] <== create_volume: return (2041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:39:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ebed314e-092b-4d2a-b141-8b7c33e6320c tempest-VolumesListAdminTestJSON-1302367810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.046s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:39:12 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ebed314e-092b-4d2a-b141-8b7c33e6320c tempest-VolumesListAdminTestJSON-1302367810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e4e354c-5f4f-4817-af6c-0ae4c2ac312f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-474bb062-202b-46a2-998a-d49393c46182', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:12 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ebed314e-092b-4d2a-b141-8b7c33e6320c tempest-VolumesListAdminTestJSON-1302367810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09de7433-e0ac-4b64-b3f5-38d52c2c422f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:12 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-ebed314e-092b-4d2a-b141-8b7c33e6320c tempest-VolumesListAdminTestJSON-1302367810 None] Volume volume-474bb062-202b-46a2-998a-d49393c46182 (474bb062-202b-46a2-998a-d49393c46182): created successfully Jun 23 16:39:12 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ebed314e-092b-4d2a-b141-8b7c33e6320c tempest-VolumesListAdminTestJSON-1302367810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09de7433-e0ac-4b64-b3f5-38d52c2c422f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:12 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ebed314e-092b-4d2a-b141-8b7c33e6320c tempest-VolumesListAdminTestJSON-1302367810 None] Flow 'volume_create_manager' (2cbd5559-a6ea-4f39-9422-7f762d9f3a01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:39:12 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-ebed314e-092b-4d2a-b141-8b7c33e6320c tempest-VolumesListAdminTestJSON-1302367810 None] Created volume successfully. Jun 23 16:39:12 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d607b6f6-a013-44e8-bd80-e8a3d6356a83 1G" returned: 0 in 1.026s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:12 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f1c550-a948-45d5-bc40-2d3c9fafaa9f]: (4, 'raw') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:39:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d607b6f6-a013-44e8-bd80-e8a3d6356a83 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:12 devstack sudo[105716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d607b6f6-a013-44e8-bd80-e8a3d6356a83 Jun 23 16:39:12 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:13 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-8916637f-58dc-4b40-a236-c207c616d72d tempest-VolumesTransfersV357Test-1916803659 None] Acquiring lock "cinder-e5467ec8-da8a-44cc-9af0-bd90bd97bc1e-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:39:13 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-8916637f-58dc-4b40-a236-c207c616d72d tempest-VolumesTransfersV357Test-1916803659 None] Lock "cinder-e5467ec8-da8a-44cc-9af0-bd90bd97bc1e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:39:13 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-8916637f-58dc-4b40-a236-c207c616d72d tempest-VolumesTransfersV357Test-1916803659 None] Acquiring lock "cinder-quobyte-e5467ec8-da8a-44cc-9af0-bd90bd97bc1e" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:39:13 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-8916637f-58dc-4b40-a236-c207c616d72d tempest-VolumesTransfersV357Test-1916803659 None] Lock "cinder-quobyte-e5467ec8-da8a-44cc-9af0-bd90bd97bc1e" acquired by "delete_volume" :: waited 0.026s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:39:13 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[754e4463-e57a-42c3-b0d8-bdf0dc2a1f47]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:39:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8916637f-58dc-4b40-a236-c207c616d72d tempest-VolumesTransfersV357Test-1916803659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e5467ec8-da8a-44cc-9af0-bd90bd97bc1e {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:13 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d607b6f6-a013-44e8-bd80-e8a3d6356a83" returned: 0 in 0.952s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d607b6f6-a013-44e8-bd80-e8a3d6356a83 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:13 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e5467ec8-da8a-44cc-9af0-bd90bd97bc1e Jun 23 16:39:13 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:13 devstack sudo[105721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d607b6f6-a013-44e8-bd80-e8a3d6356a83 Jun 23 16:39:13 devstack sudo[105721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:14 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2da761f-e101-4cae-8ba2-915956f444a7 tempest-VolumesListAdminTestJSON-823656331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:39:14 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a2da761f-e101-4cae-8ba2-915956f444a7 tempest-VolumesListAdminTestJSON-823656331 None] Flow 'volume_create_manager' (449ee9be-337f-4a5a-b02b-ac17f090f147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:39:14 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a2da761f-e101-4cae-8ba2-915956f444a7 tempest-VolumesListAdminTestJSON-823656331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7a08be4-12bc-4e85-830c-a74930756d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:14 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a2da761f-e101-4cae-8ba2-915956f444a7 tempest-VolumesListAdminTestJSON-823656331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7a08be4-12bc-4e85-830c-a74930756d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9b4cf35-cbc9-40b0-86f3-eb87767e121b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25dcf24ea3384319877eb3521113a34c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:39:14Z,use_quota=True,user_id='a7a85ff9add649e9b90358d98085cbaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:14 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a2da761f-e101-4cae-8ba2-915956f444a7 tempest-VolumesListAdminTestJSON-823656331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f7e1166-cd50-4cd5-9da0-64485dcad514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:14 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a2da761f-e101-4cae-8ba2-915956f444a7 tempest-VolumesListAdminTestJSON-823656331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f7e1166-cd50-4cd5-9da0-64485dcad514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:14 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a2da761f-e101-4cae-8ba2-915956f444a7 tempest-VolumesListAdminTestJSON-823656331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4ba141c-00f2-44d0-9432-d7bbe8df29b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:14 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a2da761f-e101-4cae-8ba2-915956f444a7 tempest-VolumesListAdminTestJSON-823656331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4ba141c-00f2-44d0-9432-d7bbe8df29b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9b4cf35-cbc9-40b0-86f3-eb87767e121b', 'volume_name': 'volume-d9b4cf35-cbc9-40b0-86f3-eb87767e121b', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:14 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a2da761f-e101-4cae-8ba2-915956f444a7 tempest-VolumesListAdminTestJSON-823656331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7abe751c-5152-465e-bd4b-2e733a056791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:14 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a2da761f-e101-4cae-8ba2-915956f444a7 tempest-VolumesListAdminTestJSON-823656331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7abe751c-5152-465e-bd4b-2e733a056791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:14 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a2da761f-e101-4cae-8ba2-915956f444a7 tempest-VolumesListAdminTestJSON-823656331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e49c487c-154d-471f-80a6-4e9cde0a1043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:14 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-a2da761f-e101-4cae-8ba2-915956f444a7 tempest-VolumesListAdminTestJSON-823656331 None] Volume d9b4cf35-cbc9-40b0-86f3-eb87767e121b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9b4cf35-cbc9-40b0-86f3-eb87767e121b', 'volume_size': 1} Jun 23 16:39:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a2da761f-e101-4cae-8ba2-915956f444a7 tempest-VolumesListAdminTestJSON-823656331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:39:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a2da761f-e101-4cae-8ba2-915956f444a7 tempest-VolumesListAdminTestJSON-823656331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:39:14 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-a2da761f-e101-4cae-8ba2-915956f444a7 tempest-VolumesListAdminTestJSON-823656331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9b4cf35-cbc9-40b0-86f3-eb87767e121b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25dcf24ea3384319877eb3521113a34c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:39:14Z,use_quota=True,user_id='a7a85ff9add649e9b90358d98085cbaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:39:14 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-a2da761f-e101-4cae-8ba2-915956f444a7 tempest-VolumesListAdminTestJSON-823656331 None] Creating volume d9b4cf35-cbc9-40b0-86f3-eb87767e121b {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:39:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a2da761f-e101-4cae-8ba2-915956f444a7 tempest-VolumesListAdminTestJSON-823656331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:39:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a2da761f-e101-4cae-8ba2-915956f444a7 tempest-VolumesListAdminTestJSON-823656331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:39:14 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-a2da761f-e101-4cae-8ba2-915956f444a7 tempest-VolumesListAdminTestJSON-823656331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:39:14 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:14 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-a2da761f-e101-4cae-8ba2-915956f444a7 tempest-VolumesListAdminTestJSON-823656331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:39:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a2da761f-e101-4cae-8ba2-915956f444a7 tempest-VolumesListAdminTestJSON-823656331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:39:14 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-a2da761f-e101-4cae-8ba2-915956f444a7 tempest-VolumesListAdminTestJSON-823656331 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:39:14 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-a2da761f-e101-4cae-8ba2-915956f444a7 tempest-VolumesListAdminTestJSON-823656331 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:39:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a2da761f-e101-4cae-8ba2-915956f444a7 tempest-VolumesListAdminTestJSON-823656331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d9b4cf35-cbc9-40b0-86f3-eb87767e121b 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8916637f-58dc-4b40-a236-c207c616d72d tempest-VolumesTransfersV357Test-1916803659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e5467ec8-da8a-44cc-9af0-bd90bd97bc1e" returned: 0 in 1.051s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8916637f-58dc-4b40-a236-c207c616d72d tempest-VolumesTransfersV357Test-1916803659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e5467ec8-da8a-44cc-9af0-bd90bd97bc1e {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:14 devstack sudo[105732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d9b4cf35-cbc9-40b0-86f3-eb87767e121b 1073741824 Jun 23 16:39:14 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:14 devstack sudo[105733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e5467ec8-da8a-44cc-9af0-bd90bd97bc1e Jun 23 16:39:14 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:14 devstack sudo[105721]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d607b6f6-a013-44e8-bd80-e8a3d6356a83" returned: 1 in 1.002s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d607b6f6-a013-44e8-bd80-e8a3d6356a83' failed. Not Retrying. {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:39:14 devstack cinder-volume[93788]: DEBUG cinder.volume.volume_utils [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] Downloaded image 0887b9d3-87b4-49cb-9e09-4239c820f3b7 ((None, [{'url': 'file:///opt/stack/data/glance/images/0887b9d3-87b4-49cb-9e09-4239c820f3b7', 'metadata': {}}])) to volume d607b6f6-a013-44e8-bd80-e8a3d6356a83 successfully. {{(pid=93788) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 16:39:14 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] Temporary image 0887b9d3-87b4-49cb-9e09-4239c820f3b7 for user b484b0ba25a94c438d3fbb4b472e6d2c is deleted. {{(pid=93788) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 16:39:14 devstack cinder-volume[93788]: DEBUG cinder.volume.volume_utils [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] Marking volume d607b6f6-a013-44e8-bd80-e8a3d6356a83 as bootable. {{(pid=93788) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 16:39:14 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] Copying metadata from image 0887b9d3-87b4-49cb-9e09-4239c820f3b7 to d607b6f6-a013-44e8-bd80-e8a3d6356a83. {{(pid=93788) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 16:39:14 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] Creating volume glance metadata for volume d607b6f6-a013-44e8-bd80-e8a3d6356a83 backed by image 0887b9d3-87b4-49cb-9e09-4239c820f3b7 with: {'image_id': '0887b9d3-87b4-49cb-9e09-4239c820f3b7', 'image_name': 'tempest-scenario-img--1961885506', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93788) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 16:39:14 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c758837-2d26-4cf2-be1d-9232659cb937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d607b6f6-a013-44e8-bd80-e8a3d6356a83', 'volume_size': 1, 'image_id': '0887b9d3-87b4-49cb-9e09-4239c820f3b7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0887b9d3-87b4-49cb-9e09-4239c820f3b7', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1961885506', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b5eb69099bd4622b5be7b1cfb9d80bb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0887b9d3-87b4-49cb-9e09-4239c820f3b7', 'created_at': datetime.datetime(2026, 6, 23, 14, 38, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 14, 38, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0887b9d3-87b4-49cb-9e09-4239c820f3b7/file', 'properties': {}}, 'image_service': }' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:14 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82a82d4f-bf2a-49ec-8505-c010ea534afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:14 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] Volume volume-d607b6f6-a013-44e8-bd80-e8a3d6356a83 (d607b6f6-a013-44e8-bd80-e8a3d6356a83): created successfully Jun 23 16:39:14 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82a82d4f-bf2a-49ec-8505-c010ea534afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:14 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] Flow 'volume_create_manager' (6bf9842b-2c8d-46fb-805b-bf0597d6a9b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:39:14 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-e0d0f1b4-49ae-43f1-a638-bb2ff8c4ea3f tempest-TestInstancesWithCinderVolumes-865228744 None] Created volume successfully. Jun 23 16:39:15 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8916637f-58dc-4b40-a236-c207c616d72d tempest-VolumesTransfersV357Test-1916803659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e5467ec8-da8a-44cc-9af0-bd90bd97bc1e" returned: 0 in 0.858s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:15 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-8916637f-58dc-4b40-a236-c207c616d72d tempest-VolumesTransfersV357Test-1916803659 None] Lock "cinder-quobyte-e5467ec8-da8a-44cc-9af0-bd90bd97bc1e" released by "delete_volume" :: held 1.964s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:39:15 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-8916637f-58dc-4b40-a236-c207c616d72d tempest-VolumesTransfersV357Test-1916803659 None] Created reservations ['2b5e372f-55d3-41ba-ba50-73b136b7b554', '9077ae1b-01cf-4640-8817-221fb4cbc521', '738d5d30-13a3-4ec4-85f7-b3883130bea6', '0d525658-9e67-4908-a8e5-7d89be2cd8f6'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:39:15 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a2da761f-e101-4cae-8ba2-915956f444a7 tempest-VolumesListAdminTestJSON-823656331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d9b4cf35-cbc9-40b0-86f3-eb87767e121b 1073741824" returned: 0 in 1.043s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8916637f-58dc-4b40-a236-c207c616d72d tempest-VolumesTransfersV357Test-1916803659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:39:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8916637f-58dc-4b40-a236-c207c616d72d tempest-VolumesTransfersV357Test-1916803659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:39:15 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-8916637f-58dc-4b40-a236-c207c616d72d tempest-VolumesTransfersV357Test-1916803659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:39:15 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-8916637f-58dc-4b40-a236-c207c616d72d tempest-VolumesTransfersV357Test-1916803659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:39:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8916637f-58dc-4b40-a236-c207c616d72d tempest-VolumesTransfersV357Test-1916803659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:39:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8916637f-58dc-4b40-a236-c207c616d72d tempest-VolumesTransfersV357Test-1916803659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:15 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:39:15 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a2da761f-e101-4cae-8ba2-915956f444a7 tempest-VolumesListAdminTestJSON-823656331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d9b4cf35-cbc9-40b0-86f3-eb87767e121b {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:15 devstack sudo[105742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d9b4cf35-cbc9-40b0-86f3-eb87767e121b Jun 23 16:39:15 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:16 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5f98af8-de1e-4a7e-a52f-6f4907357413 tempest-VolumesTransfersV357Test-1597628400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:39:16 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5f98af8-de1e-4a7e-a52f-6f4907357413 tempest-VolumesTransfersV357Test-1597628400 None] Flow 'volume_create_manager' (b1610509-661f-453b-9bbf-e08985b720e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:39:16 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5f98af8-de1e-4a7e-a52f-6f4907357413 tempest-VolumesTransfersV357Test-1597628400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (234eda97-db52-46a9-a95c-317785ffeacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:16 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5f98af8-de1e-4a7e-a52f-6f4907357413 tempest-VolumesTransfersV357Test-1597628400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (234eda97-db52-46a9-a95c-317785ffeacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-877169829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64ebd6b9-f0de-4eb0-aa47-940c2eedb4a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6524116848ad4226a057859049ffea9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:39:16Z,use_quota=True,user_id='c36528ab948348ca88f1b900cfc88103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:16 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5f98af8-de1e-4a7e-a52f-6f4907357413 tempest-VolumesTransfersV357Test-1597628400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c751ac57-782b-4e6c-be41-bdf14bc401ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:16 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5f98af8-de1e-4a7e-a52f-6f4907357413 tempest-VolumesTransfersV357Test-1597628400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c751ac57-782b-4e6c-be41-bdf14bc401ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:16 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5f98af8-de1e-4a7e-a52f-6f4907357413 tempest-VolumesTransfersV357Test-1597628400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (621453f3-0fdd-4db7-9ce1-d71a3c0fab14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:16 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5f98af8-de1e-4a7e-a52f-6f4907357413 tempest-VolumesTransfersV357Test-1597628400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (621453f3-0fdd-4db7-9ce1-d71a3c0fab14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64ebd6b9-f0de-4eb0-aa47-940c2eedb4a6', 'volume_name': 'volume-64ebd6b9-f0de-4eb0-aa47-940c2eedb4a6', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:16 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5f98af8-de1e-4a7e-a52f-6f4907357413 tempest-VolumesTransfersV357Test-1597628400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a7317f2-c9d1-4aae-8c10-ba38d9d90259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:16 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:16 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5f98af8-de1e-4a7e-a52f-6f4907357413 tempest-VolumesTransfersV357Test-1597628400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a7317f2-c9d1-4aae-8c10-ba38d9d90259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:16 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5f98af8-de1e-4a7e-a52f-6f4907357413 tempest-VolumesTransfersV357Test-1597628400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e25b9178-66a9-419f-a4f2-41da71abafbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:16 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-c5f98af8-de1e-4a7e-a52f-6f4907357413 tempest-VolumesTransfersV357Test-1597628400 None] Volume 64ebd6b9-f0de-4eb0-aa47-940c2eedb4a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64ebd6b9-f0de-4eb0-aa47-940c2eedb4a6', 'volume_size': 1} Jun 23 16:39:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-c5f98af8-de1e-4a7e-a52f-6f4907357413 tempest-VolumesTransfersV357Test-1597628400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:39:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a2da761f-e101-4cae-8ba2-915956f444a7 tempest-VolumesListAdminTestJSON-823656331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d9b4cf35-cbc9-40b0-86f3-eb87767e121b" returned: 0 in 1.007s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:16 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-a2da761f-e101-4cae-8ba2-915956f444a7 tempest-VolumesListAdminTestJSON-823656331 None] <== create_volume: return (2165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:39:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a2da761f-e101-4cae-8ba2-915956f444a7 tempest-VolumesListAdminTestJSON-823656331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.167s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:39:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-c5f98af8-de1e-4a7e-a52f-6f4907357413 tempest-VolumesTransfersV357Test-1597628400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:39:16 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-c5f98af8-de1e-4a7e-a52f-6f4907357413 tempest-VolumesTransfersV357Test-1597628400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-877169829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64ebd6b9-f0de-4eb0-aa47-940c2eedb4a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6524116848ad4226a057859049ffea9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:39:16Z,use_quota=True,user_id='c36528ab948348ca88f1b900cfc88103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:39:16 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-c5f98af8-de1e-4a7e-a52f-6f4907357413 tempest-VolumesTransfersV357Test-1597628400 None] Creating volume 64ebd6b9-f0de-4eb0-aa47-940c2eedb4a6 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:39:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-c5f98af8-de1e-4a7e-a52f-6f4907357413 tempest-VolumesTransfersV357Test-1597628400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:39:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-c5f98af8-de1e-4a7e-a52f-6f4907357413 tempest-VolumesTransfersV357Test-1597628400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:39:16 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-c5f98af8-de1e-4a7e-a52f-6f4907357413 tempest-VolumesTransfersV357Test-1597628400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:39:16 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-c5f98af8-de1e-4a7e-a52f-6f4907357413 tempest-VolumesTransfersV357Test-1597628400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:39:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-c5f98af8-de1e-4a7e-a52f-6f4907357413 tempest-VolumesTransfersV357Test-1597628400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:39:16 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-c5f98af8-de1e-4a7e-a52f-6f4907357413 tempest-VolumesTransfersV357Test-1597628400 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:39:16 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-c5f98af8-de1e-4a7e-a52f-6f4907357413 tempest-VolumesTransfersV357Test-1597628400 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:39:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c5f98af8-de1e-4a7e-a52f-6f4907357413 tempest-VolumesTransfersV357Test-1597628400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-64ebd6b9-f0de-4eb0-aa47-940c2eedb4a6 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:16 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a2da761f-e101-4cae-8ba2-915956f444a7 tempest-VolumesListAdminTestJSON-823656331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e49c487c-154d-471f-80a6-4e9cde0a1043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9b4cf35-cbc9-40b0-86f3-eb87767e121b', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:16 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:16 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a2da761f-e101-4cae-8ba2-915956f444a7 tempest-VolumesListAdminTestJSON-823656331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fa3f5f5-aa6e-4be3-ab71-730bcff14760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:16 devstack sudo[105746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-64ebd6b9-f0de-4eb0-aa47-940c2eedb4a6 1073741824 Jun 23 16:39:16 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8916637f-58dc-4b40-a236-c207c616d72d tempest-VolumesTransfersV357Test-1916803659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.144s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:16 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-8916637f-58dc-4b40-a236-c207c616d72d tempest-VolumesTransfersV357Test-1916803659 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:39:16 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-8916637f-58dc-4b40-a236-c207c616d72d tempest-VolumesTransfersV357Test-1916803659 None] Deleted volume successfully. Jun 23 16:39:16 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-a2da761f-e101-4cae-8ba2-915956f444a7 tempest-VolumesListAdminTestJSON-823656331 None] Volume volume-d9b4cf35-cbc9-40b0-86f3-eb87767e121b (d9b4cf35-cbc9-40b0-86f3-eb87767e121b): created successfully Jun 23 16:39:16 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a2da761f-e101-4cae-8ba2-915956f444a7 tempest-VolumesListAdminTestJSON-823656331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fa3f5f5-aa6e-4be3-ab71-730bcff14760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:16 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a2da761f-e101-4cae-8ba2-915956f444a7 tempest-VolumesListAdminTestJSON-823656331 None] Flow 'volume_create_manager' (449ee9be-337f-4a5a-b02b-ac17f090f147) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:39:16 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-a2da761f-e101-4cae-8ba2-915956f444a7 tempest-VolumesListAdminTestJSON-823656331 None] Created volume successfully. Jun 23 16:39:16 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-8916637f-58dc-4b40-a236-c207c616d72d tempest-VolumesTransfersV357Test-1916803659 None] Lock "cinder-e5467ec8-da8a-44cc-9af0-bd90bd97bc1e-delete_volume" released by "delete_volume" :: held 3.521s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:39:17 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-1dd4a115-4e8d-4959-8054-697df382d1b0 tempest-VolumesListAdminTestJSON-823656331 None] Acquiring lock "cinder-d9b4cf35-cbc9-40b0-86f3-eb87767e121b-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:39:17 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-1dd4a115-4e8d-4959-8054-697df382d1b0 tempest-VolumesListAdminTestJSON-823656331 None] Lock "cinder-d9b4cf35-cbc9-40b0-86f3-eb87767e121b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:39:17 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c5f98af8-de1e-4a7e-a52f-6f4907357413 tempest-VolumesTransfersV357Test-1597628400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-64ebd6b9-f0de-4eb0-aa47-940c2eedb4a6 1073741824" returned: 0 in 1.122s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:17 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-1dd4a115-4e8d-4959-8054-697df382d1b0 tempest-VolumesListAdminTestJSON-823656331 None] Acquiring lock "cinder-quobyte-d9b4cf35-cbc9-40b0-86f3-eb87767e121b" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:39:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c5f98af8-de1e-4a7e-a52f-6f4907357413 tempest-VolumesTransfersV357Test-1597628400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-64ebd6b9-f0de-4eb0-aa47-940c2eedb4a6 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:17 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-1dd4a115-4e8d-4959-8054-697df382d1b0 tempest-VolumesListAdminTestJSON-823656331 None] Lock "cinder-quobyte-d9b4cf35-cbc9-40b0-86f3-eb87767e121b" acquired by "delete_volume" :: waited 0.033s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:39:17 devstack sudo[105755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-64ebd6b9-f0de-4eb0-aa47-940c2eedb4a6 Jun 23 16:39:17 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:18 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f26688-0c59-4bdc-bd3c-7fc31a4afd19]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:39:18 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1dd4a115-4e8d-4959-8054-697df382d1b0 tempest-VolumesListAdminTestJSON-823656331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d9b4cf35-cbc9-40b0-86f3-eb87767e121b {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:18 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-a7f13d00-9a1e-4db2-a772-3ffcb5169128 tempest-VolumesListAdminTestJSON-1302367810 None] Acquiring lock "cinder-474bb062-202b-46a2-998a-d49393c46182-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:39:18 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-a7f13d00-9a1e-4db2-a772-3ffcb5169128 tempest-VolumesListAdminTestJSON-1302367810 None] Lock "cinder-474bb062-202b-46a2-998a-d49393c46182-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:39:18 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-a7f13d00-9a1e-4db2-a772-3ffcb5169128 tempest-VolumesListAdminTestJSON-1302367810 None] Acquiring lock "cinder-quobyte-474bb062-202b-46a2-998a-d49393c46182" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:39:18 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-a7f13d00-9a1e-4db2-a772-3ffcb5169128 tempest-VolumesListAdminTestJSON-1302367810 None] Lock "cinder-quobyte-474bb062-202b-46a2-998a-d49393c46182" acquired by "delete_volume" :: waited 0.027s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:39:18 devstack sudo[105757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d9b4cf35-cbc9-40b0-86f3-eb87767e121b Jun 23 16:39:18 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:18 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40a4d67-0607-4505-a7c8-714964756ae3]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:39:18 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a7f13d00-9a1e-4db2-a772-3ffcb5169128 tempest-VolumesListAdminTestJSON-1302367810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-474bb062-202b-46a2-998a-d49393c46182 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:18 devstack sudo[105759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-474bb062-202b-46a2-998a-d49393c46182 Jun 23 16:39:18 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:18 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:18 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c5f98af8-de1e-4a7e-a52f-6f4907357413 tempest-VolumesTransfersV357Test-1597628400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-64ebd6b9-f0de-4eb0-aa47-940c2eedb4a6" returned: 0 in 0.903s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:18 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-c5f98af8-de1e-4a7e-a52f-6f4907357413 tempest-VolumesTransfersV357Test-1597628400 None] <== create_volume: return (2109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:39:18 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-c5f98af8-de1e-4a7e-a52f-6f4907357413 tempest-VolumesTransfersV357Test-1597628400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.117s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:39:18 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5f98af8-de1e-4a7e-a52f-6f4907357413 tempest-VolumesTransfersV357Test-1597628400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e25b9178-66a9-419f-a4f2-41da71abafbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64ebd6b9-f0de-4eb0-aa47-940c2eedb4a6', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:18 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5f98af8-de1e-4a7e-a52f-6f4907357413 tempest-VolumesTransfersV357Test-1597628400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b246418-edc9-46e0-b34f-13eba20dc274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:18 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-c5f98af8-de1e-4a7e-a52f-6f4907357413 tempest-VolumesTransfersV357Test-1597628400 None] Volume volume-64ebd6b9-f0de-4eb0-aa47-940c2eedb4a6 (64ebd6b9-f0de-4eb0-aa47-940c2eedb4a6): created successfully Jun 23 16:39:18 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5f98af8-de1e-4a7e-a52f-6f4907357413 tempest-VolumesTransfersV357Test-1597628400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b246418-edc9-46e0-b34f-13eba20dc274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:18 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5f98af8-de1e-4a7e-a52f-6f4907357413 tempest-VolumesTransfersV357Test-1597628400 None] Flow 'volume_create_manager' (b1610509-661f-453b-9bbf-e08985b720e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:39:18 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-c5f98af8-de1e-4a7e-a52f-6f4907357413 tempest-VolumesTransfersV357Test-1597628400 None] Created volume successfully. Jun 23 16:39:19 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:19 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1dd4a115-4e8d-4959-8054-697df382d1b0 tempest-VolumesListAdminTestJSON-823656331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d9b4cf35-cbc9-40b0-86f3-eb87767e121b" returned: 0 in 1.225s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:19 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1dd4a115-4e8d-4959-8054-697df382d1b0 tempest-VolumesListAdminTestJSON-823656331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d9b4cf35-cbc9-40b0-86f3-eb87767e121b {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:19 devstack sudo[105769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d9b4cf35-cbc9-40b0-86f3-eb87767e121b Jun 23 16:39:19 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:19 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:19 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a7f13d00-9a1e-4db2-a772-3ffcb5169128 tempest-VolumesListAdminTestJSON-1302367810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-474bb062-202b-46a2-998a-d49393c46182" returned: 0 in 1.118s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:19 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a7f13d00-9a1e-4db2-a772-3ffcb5169128 tempest-VolumesListAdminTestJSON-1302367810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-474bb062-202b-46a2-998a-d49393c46182 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:19 devstack sudo[105771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-474bb062-202b-46a2-998a-d49393c46182 Jun 23 16:39:19 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:20 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:20 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d1761eb9-7300-453c-a130-735089ee76fc tempest-VolumesTransfersV357Test-1916803659 None] Acquiring lock "cinder-64ebd6b9-f0de-4eb0-aa47-940c2eedb4a6-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:39:20 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1dd4a115-4e8d-4959-8054-697df382d1b0 tempest-VolumesListAdminTestJSON-823656331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d9b4cf35-cbc9-40b0-86f3-eb87767e121b" returned: 0 in 0.891s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:20 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-1dd4a115-4e8d-4959-8054-697df382d1b0 tempest-VolumesListAdminTestJSON-823656331 None] Lock "cinder-quobyte-d9b4cf35-cbc9-40b0-86f3-eb87767e121b" released by "delete_volume" :: held 2.185s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:39:20 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d1761eb9-7300-453c-a130-735089ee76fc tempest-VolumesTransfersV357Test-1916803659 None] Lock "cinder-64ebd6b9-f0de-4eb0-aa47-940c2eedb4a6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:39:20 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:20 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a7f13d00-9a1e-4db2-a772-3ffcb5169128 tempest-VolumesListAdminTestJSON-1302367810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-474bb062-202b-46a2-998a-d49393c46182" returned: 0 in 0.818s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:20 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-a7f13d00-9a1e-4db2-a772-3ffcb5169128 tempest-VolumesListAdminTestJSON-1302367810 None] Lock "cinder-quobyte-474bb062-202b-46a2-998a-d49393c46182" released by "delete_volume" :: held 2.023s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:39:20 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d1761eb9-7300-453c-a130-735089ee76fc tempest-VolumesTransfersV357Test-1916803659 None] Acquiring lock "cinder-quobyte-64ebd6b9-f0de-4eb0-aa47-940c2eedb4a6" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:39:20 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d1761eb9-7300-453c-a130-735089ee76fc tempest-VolumesTransfersV357Test-1916803659 None] Lock "cinder-quobyte-64ebd6b9-f0de-4eb0-aa47-940c2eedb4a6" acquired by "delete_volume" :: waited 0.033s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:39:20 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-1dd4a115-4e8d-4959-8054-697df382d1b0 tempest-VolumesListAdminTestJSON-823656331 None] Created reservations ['b31949a4-6c0d-4a96-ab2a-8bf454fba0f8', 'ca6b5650-dec4-45c5-9e41-9ce451ccbe44', 'abc8aff5-0605-4e17-b7af-4b66b192de20', '4307a9a6-abb0-40d6-89a2-2defbcac7a56'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:39:20 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4007069-4b22-4314-b7bb-9cba91d80a18]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:39:20 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d1761eb9-7300-453c-a130-735089ee76fc tempest-VolumesTransfersV357Test-1916803659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-64ebd6b9-f0de-4eb0-aa47-940c2eedb4a6 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:20 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-a7f13d00-9a1e-4db2-a772-3ffcb5169128 tempest-VolumesListAdminTestJSON-1302367810 None] Created reservations ['af9407ba-f421-4fda-b562-e3aefebb2800', 'be874009-5ecd-4f15-a098-0e7fe7927612', 'b5f7e6e0-b078-4542-88c4-8454f3fd46b2', 'c35f7814-95f3-4e60-b11b-1ccff930a708'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:39:20 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-1dd4a115-4e8d-4959-8054-697df382d1b0 tempest-VolumesListAdminTestJSON-823656331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:39:20 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-1dd4a115-4e8d-4959-8054-697df382d1b0 tempest-VolumesListAdminTestJSON-823656331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:39:20 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-1dd4a115-4e8d-4959-8054-697df382d1b0 tempest-VolumesListAdminTestJSON-823656331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:39:20 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-1dd4a115-4e8d-4959-8054-697df382d1b0 tempest-VolumesListAdminTestJSON-823656331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:39:20 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-1dd4a115-4e8d-4959-8054-697df382d1b0 tempest-VolumesListAdminTestJSON-823656331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:39:20 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1dd4a115-4e8d-4959-8054-697df382d1b0 tempest-VolumesListAdminTestJSON-823656331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:20 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-64ebd6b9-f0de-4eb0-aa47-940c2eedb4a6 Jun 23 16:39:20 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:20 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:39:20 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:20 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a7f13d00-9a1e-4db2-a772-3ffcb5169128 tempest-VolumesListAdminTestJSON-1302367810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:39:20 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a7f13d00-9a1e-4db2-a772-3ffcb5169128 tempest-VolumesListAdminTestJSON-1302367810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:39:20 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-a7f13d00-9a1e-4db2-a772-3ffcb5169128 tempest-VolumesListAdminTestJSON-1302367810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:39:20 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-a7f13d00-9a1e-4db2-a772-3ffcb5169128 tempest-VolumesListAdminTestJSON-1302367810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:39:20 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a7f13d00-9a1e-4db2-a772-3ffcb5169128 tempest-VolumesListAdminTestJSON-1302367810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:39:20 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a7f13d00-9a1e-4db2-a772-3ffcb5169128 tempest-VolumesListAdminTestJSON-1302367810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:20 devstack sudo[105779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:39:20 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:21 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d1761eb9-7300-453c-a130-735089ee76fc tempest-VolumesTransfersV357Test-1916803659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-64ebd6b9-f0de-4eb0-aa47-940c2eedb4a6" returned: 0 in 0.949s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d1761eb9-7300-453c-a130-735089ee76fc tempest-VolumesTransfersV357Test-1916803659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-64ebd6b9-f0de-4eb0-aa47-940c2eedb4a6 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:21 devstack sudo[105786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-64ebd6b9-f0de-4eb0-aa47-940c2eedb4a6 Jun 23 16:39:21 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:21 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1dd4a115-4e8d-4959-8054-697df382d1b0 tempest-VolumesListAdminTestJSON-823656331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.914s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:21 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-1dd4a115-4e8d-4959-8054-697df382d1b0 tempest-VolumesListAdminTestJSON-823656331 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:39:21 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-1dd4a115-4e8d-4959-8054-697df382d1b0 tempest-VolumesListAdminTestJSON-823656331 None] Deleted volume successfully. Jun 23 16:39:21 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a7f13d00-9a1e-4db2-a772-3ffcb5169128 tempest-VolumesListAdminTestJSON-1302367810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.890s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:21 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-a7f13d00-9a1e-4db2-a772-3ffcb5169128 tempest-VolumesListAdminTestJSON-1302367810 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:39:21 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-1dd4a115-4e8d-4959-8054-697df382d1b0 tempest-VolumesListAdminTestJSON-823656331 None] Lock "cinder-d9b4cf35-cbc9-40b0-86f3-eb87767e121b-delete_volume" released by "delete_volume" :: held 3.528s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:39:21 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-a7f13d00-9a1e-4db2-a772-3ffcb5169128 tempest-VolumesListAdminTestJSON-1302367810 None] Deleted volume successfully. Jun 23 16:39:21 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-a7f13d00-9a1e-4db2-a772-3ffcb5169128 tempest-VolumesListAdminTestJSON-1302367810 None] Lock "cinder-474bb062-202b-46a2-998a-d49393c46182-delete_volume" released by "delete_volume" :: held 3.316s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:39:21 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-27e6c589-d831-4ae7-a3d6-422f6aa0e344 tempest-VolumesListAdminTestJSON-1302367810 None] Acquiring lock "cinder-c7b53ebc-3caa-4fd6-9608-170cf30a8e00-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:39:21 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-27e6c589-d831-4ae7-a3d6-422f6aa0e344 tempest-VolumesListAdminTestJSON-1302367810 None] Lock "cinder-c7b53ebc-3caa-4fd6-9608-170cf30a8e00-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:39:21 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-27e6c589-d831-4ae7-a3d6-422f6aa0e344 tempest-VolumesListAdminTestJSON-1302367810 None] Acquiring lock "cinder-quobyte-c7b53ebc-3caa-4fd6-9608-170cf30a8e00" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:39:21 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-27e6c589-d831-4ae7-a3d6-422f6aa0e344 tempest-VolumesListAdminTestJSON-1302367810 None] Lock "cinder-quobyte-c7b53ebc-3caa-4fd6-9608-170cf30a8e00" acquired by "delete_volume" :: waited 0.020s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:39:21 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a68f139-a172-41f1-b933-3c19c025f320]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:39:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-27e6c589-d831-4ae7-a3d6-422f6aa0e344 tempest-VolumesListAdminTestJSON-1302367810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c7b53ebc-3caa-4fd6-9608-170cf30a8e00 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:21 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c7b53ebc-3caa-4fd6-9608-170cf30a8e00 Jun 23 16:39:21 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:22 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d1761eb9-7300-453c-a130-735089ee76fc tempest-VolumesTransfersV357Test-1916803659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-64ebd6b9-f0de-4eb0-aa47-940c2eedb4a6" returned: 0 in 0.818s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:22 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d1761eb9-7300-453c-a130-735089ee76fc tempest-VolumesTransfersV357Test-1916803659 None] Lock "cinder-quobyte-64ebd6b9-f0de-4eb0-aa47-940c2eedb4a6" released by "delete_volume" :: held 1.826s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:39:22 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-d1761eb9-7300-453c-a130-735089ee76fc tempest-VolumesTransfersV357Test-1916803659 None] Created reservations ['4b9d0104-65d4-41d3-afae-810ccaf62fb1', 'c6a4fff6-1fbb-450c-98fd-98c747ae41bc', '13ab8303-9e04-4606-931f-d0a73bce8059', '79ee1103-e628-4cb9-a42c-d9d14d9f15f7'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:39:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d1761eb9-7300-453c-a130-735089ee76fc tempest-VolumesTransfersV357Test-1916803659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:39:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d1761eb9-7300-453c-a130-735089ee76fc tempest-VolumesTransfersV357Test-1916803659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:39:22 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-d1761eb9-7300-453c-a130-735089ee76fc tempest-VolumesTransfersV357Test-1916803659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:39:22 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-d1761eb9-7300-453c-a130-735089ee76fc tempest-VolumesTransfersV357Test-1916803659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:39:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d1761eb9-7300-453c-a130-735089ee76fc tempest-VolumesTransfersV357Test-1916803659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:39:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d1761eb9-7300-453c-a130-735089ee76fc tempest-VolumesTransfersV357Test-1916803659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:22 devstack sudo[105791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:39:22 devstack sudo[105791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:22 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-27e6c589-d831-4ae7-a3d6-422f6aa0e344 tempest-VolumesListAdminTestJSON-1302367810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c7b53ebc-3caa-4fd6-9608-170cf30a8e00" returned: 0 in 1.240s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-27e6c589-d831-4ae7-a3d6-422f6aa0e344 tempest-VolumesListAdminTestJSON-1302367810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c7b53ebc-3caa-4fd6-9608-170cf30a8e00 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:23 devstack sudo[105797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c7b53ebc-3caa-4fd6-9608-170cf30a8e00 Jun 23 16:39:23 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:23 devstack sudo[105791]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d1761eb9-7300-453c-a130-735089ee76fc tempest-VolumesTransfersV357Test-1916803659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.827s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:23 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-d1761eb9-7300-453c-a130-735089ee76fc tempest-VolumesTransfersV357Test-1916803659 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:39:23 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-d1761eb9-7300-453c-a130-735089ee76fc tempest-VolumesTransfersV357Test-1916803659 None] Deleted volume successfully. Jun 23 16:39:23 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d1761eb9-7300-453c-a130-735089ee76fc tempest-VolumesTransfersV357Test-1916803659 None] Lock "cinder-64ebd6b9-f0de-4eb0-aa47-940c2eedb4a6-delete_volume" released by "delete_volume" :: held 2.956s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:39:23 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-27e6c589-d831-4ae7-a3d6-422f6aa0e344 tempest-VolumesListAdminTestJSON-1302367810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c7b53ebc-3caa-4fd6-9608-170cf30a8e00" returned: 0 in 0.954s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:23 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-27e6c589-d831-4ae7-a3d6-422f6aa0e344 tempest-VolumesListAdminTestJSON-1302367810 None] Lock "cinder-quobyte-c7b53ebc-3caa-4fd6-9608-170cf30a8e00" released by "delete_volume" :: held 2.242s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:39:24 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-27e6c589-d831-4ae7-a3d6-422f6aa0e344 tempest-VolumesListAdminTestJSON-1302367810 None] Created reservations ['f2445293-f6d7-4055-83ac-89df19633b75', 'fb497fe4-6be2-4195-8e3b-c466ae2dfeab', '13ddf390-7537-4281-a567-14872c12e8f6', '4c5e71af-38f4-4d10-9b49-ff84b910fb40'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:39:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-27e6c589-d831-4ae7-a3d6-422f6aa0e344 tempest-VolumesListAdminTestJSON-1302367810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:39:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-27e6c589-d831-4ae7-a3d6-422f6aa0e344 tempest-VolumesListAdminTestJSON-1302367810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:39:24 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-27e6c589-d831-4ae7-a3d6-422f6aa0e344 tempest-VolumesListAdminTestJSON-1302367810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:39:24 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-27e6c589-d831-4ae7-a3d6-422f6aa0e344 tempest-VolumesListAdminTestJSON-1302367810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:39:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-27e6c589-d831-4ae7-a3d6-422f6aa0e344 tempest-VolumesListAdminTestJSON-1302367810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:39:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-27e6c589-d831-4ae7-a3d6-422f6aa0e344 tempest-VolumesListAdminTestJSON-1302367810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:24 devstack sudo[105800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:39:24 devstack sudo[105800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-02356900-17f0-42b4-b117-0925db3484b4 req-c530c66d-c268-4581-884e-f62647b5999d tempest-TestInstancesWithCinderVolumes-865228744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:39:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-02356900-17f0-42b4-b117-0925db3484b4 req-c530c66d-c268-4581-884e-f62647b5999d tempest-TestInstancesWithCinderVolumes-865228744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:39:25 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2762191d-ee10-463b-8da3-3df3b32ee862]: (4, 'raw') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:39:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-02356900-17f0-42b4-b117-0925db3484b4 req-c530c66d-c268-4581-884e-f62647b5999d tempest-TestInstancesWithCinderVolumes-865228744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d607b6f6-a013-44e8-bd80-e8a3d6356a83 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:25 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b330696e-4648-41cf-b0cf-002da16d0071 tempest-VolumesListAdminTestJSON-1302367810 None] Acquiring lock "cinder-41d163ea-1796-47e0-a657-1b740c57ffb2-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:39:25 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b330696e-4648-41cf-b0cf-002da16d0071 tempest-VolumesListAdminTestJSON-1302367810 None] Lock "cinder-41d163ea-1796-47e0-a657-1b740c57ffb2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:39:25 devstack sudo[105800]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:25 devstack sudo[105811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d607b6f6-a013-44e8-bd80-e8a3d6356a83 Jun 23 16:39:25 devstack sudo[105811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-27e6c589-d831-4ae7-a3d6-422f6aa0e344 tempest-VolumesListAdminTestJSON-1302367810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.171s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:25 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-27e6c589-d831-4ae7-a3d6-422f6aa0e344 tempest-VolumesListAdminTestJSON-1302367810 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:39:25 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-27e6c589-d831-4ae7-a3d6-422f6aa0e344 tempest-VolumesListAdminTestJSON-1302367810 None] Deleted volume successfully. Jun 23 16:39:25 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b330696e-4648-41cf-b0cf-002da16d0071 tempest-VolumesListAdminTestJSON-1302367810 None] Acquiring lock "cinder-quobyte-41d163ea-1796-47e0-a657-1b740c57ffb2" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:39:25 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b330696e-4648-41cf-b0cf-002da16d0071 tempest-VolumesListAdminTestJSON-1302367810 None] Lock "cinder-quobyte-41d163ea-1796-47e0-a657-1b740c57ffb2" acquired by "delete_volume" :: waited 0.036s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:39:25 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf8d7bd-7705-403f-9ff8-b59e7c5aa5d5]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:39:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b330696e-4648-41cf-b0cf-002da16d0071 tempest-VolumesListAdminTestJSON-1302367810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-41d163ea-1796-47e0-a657-1b740c57ffb2 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:25 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-27e6c589-d831-4ae7-a3d6-422f6aa0e344 tempest-VolumesListAdminTestJSON-1302367810 None] Lock "cinder-c7b53ebc-3caa-4fd6-9608-170cf30a8e00-delete_volume" released by "delete_volume" :: held 3.829s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:39:25 devstack sudo[105813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-41d163ea-1796-47e0-a657-1b740c57ffb2 Jun 23 16:39:25 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:26 devstack sudo[105811]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-02356900-17f0-42b4-b117-0925db3484b4 req-c530c66d-c268-4581-884e-f62647b5999d tempest-TestInstancesWithCinderVolumes-865228744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d607b6f6-a013-44e8-bd80-e8a3d6356a83" returned: 0 in 1.134s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-02356900-17f0-42b4-b117-0925db3484b4 req-c530c66d-c268-4581-884e-f62647b5999d tempest-TestInstancesWithCinderVolumes-865228744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d607b6f6-a013-44e8-bd80-e8a3d6356a83 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:26 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d607b6f6-a013-44e8-bd80-e8a3d6356a83 Jun 23 16:39:26 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:26 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b330696e-4648-41cf-b0cf-002da16d0071 tempest-VolumesListAdminTestJSON-1302367810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-41d163ea-1796-47e0-a657-1b740c57ffb2" returned: 0 in 1.283s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b330696e-4648-41cf-b0cf-002da16d0071 tempest-VolumesListAdminTestJSON-1302367810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-41d163ea-1796-47e0-a657-1b740c57ffb2 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:26 devstack sudo[105823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-41d163ea-1796-47e0-a657-1b740c57ffb2 Jun 23 16:39:26 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:27 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-02356900-17f0-42b4-b117-0925db3484b4 req-c530c66d-c268-4581-884e-f62647b5999d tempest-TestInstancesWithCinderVolumes-865228744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d607b6f6-a013-44e8-bd80-e8a3d6356a83" returned: 1 in 1.182s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-02356900-17f0-42b4-b117-0925db3484b4 req-c530c66d-c268-4581-884e-f62647b5999d tempest-TestInstancesWithCinderVolumes-865228744 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d607b6f6-a013-44e8-bd80-e8a3d6356a83' failed. Not Retrying. {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:39:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-02356900-17f0-42b4-b117-0925db3484b4 req-c530c66d-c268-4581-884e-f62647b5999d tempest-TestInstancesWithCinderVolumes-865228744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.385s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:39:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-02356900-17f0-42b4-b117-0925db3484b4 req-c530c66d-c268-4581-884e-f62647b5999d tempest-TestInstancesWithCinderVolumes-865228744 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e', 'name': 'volume-d607b6f6-a013-44e8-bd80-e8a3d6356a83', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5de03bd9-d280-4dc9-98d6-823f74c5e04b', 'enforce_multipath': True} {{(pid=93788) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 16:39:27 devstack cinder-volume[93788]: INFO cinder.volume.manager [req-02356900-17f0-42b4-b117-0925db3484b4 req-c530c66d-c268-4581-884e-f62647b5999d tempest-TestInstancesWithCinderVolumes-865228744 None] attachment_update completed successfully. Jun 23 16:39:27 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b330696e-4648-41cf-b0cf-002da16d0071 tempest-VolumesListAdminTestJSON-1302367810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-41d163ea-1796-47e0-a657-1b740c57ffb2" returned: 0 in 1.115s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:27 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b330696e-4648-41cf-b0cf-002da16d0071 tempest-VolumesListAdminTestJSON-1302367810 None] Lock "cinder-quobyte-41d163ea-1796-47e0-a657-1b740c57ffb2" released by "delete_volume" :: held 2.473s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:39:27 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-b330696e-4648-41cf-b0cf-002da16d0071 tempest-VolumesListAdminTestJSON-1302367810 None] Created reservations ['a8152531-15b5-4910-8f24-2de8c5989ed8', 'bc958a8d-1551-472c-9956-a1564d6662d7', '983f0c29-eab6-4694-b316-c8549eebcb6f', '4f8fde23-e1de-42d8-8a8f-26410e14461b'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:39:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b330696e-4648-41cf-b0cf-002da16d0071 tempest-VolumesListAdminTestJSON-1302367810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:39:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b330696e-4648-41cf-b0cf-002da16d0071 tempest-VolumesListAdminTestJSON-1302367810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:39:28 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b330696e-4648-41cf-b0cf-002da16d0071 tempest-VolumesListAdminTestJSON-1302367810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:39:28 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b330696e-4648-41cf-b0cf-002da16d0071 tempest-VolumesListAdminTestJSON-1302367810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:39:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b330696e-4648-41cf-b0cf-002da16d0071 tempest-VolumesListAdminTestJSON-1302367810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:39:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b330696e-4648-41cf-b0cf-002da16d0071 tempest-VolumesListAdminTestJSON-1302367810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:28 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:39:28 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:29 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b330696e-4648-41cf-b0cf-002da16d0071 tempest-VolumesListAdminTestJSON-1302367810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.056s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:29 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-b330696e-4648-41cf-b0cf-002da16d0071 tempest-VolumesListAdminTestJSON-1302367810 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:39:29 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-b330696e-4648-41cf-b0cf-002da16d0071 tempest-VolumesListAdminTestJSON-1302367810 None] Deleted volume successfully. Jun 23 16:39:29 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b330696e-4648-41cf-b0cf-002da16d0071 tempest-VolumesListAdminTestJSON-1302367810 None] Lock "cinder-41d163ea-1796-47e0-a657-1b740c57ffb2-delete_volume" released by "delete_volume" :: held 3.957s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:39:30 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-6284aef4-74dc-4a62-a404-3b298afafff6 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:39:30 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6284aef4-74dc-4a62-a404-3b298afafff6 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Flow 'volume_create_manager' (a8a09542-fced-40a9-b07d-3945c0cbe252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:39:30 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6284aef4-74dc-4a62-a404-3b298afafff6 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e9633ff-7f10-48ea-a1b7-3d3fd4359a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:30 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6284aef4-74dc-4a62-a404-3b298afafff6 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e9633ff-7f10-48ea-a1b7-3d3fd4359a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1089857519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e21d9366-def3-4e19-a793-090dfe8d6a18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b713c20df04b4de4bc5dd95d06dbf831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:39:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:39:30Z,use_quota=True,user_id='bac694bdd31e47a0a66d669c3acfa7b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db04ab18-b5a2-4fcf-b7e8-541a311062fe),volume_type_id=db04ab18-b5a2-4fcf-b7e8-541a311062fe)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:30 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6284aef4-74dc-4a62-a404-3b298afafff6 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8072a945-7788-48c3-b95d-67537b6055b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:30 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6284aef4-74dc-4a62-a404-3b298afafff6 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8072a945-7788-48c3-b95d-67537b6055b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:30 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6284aef4-74dc-4a62-a404-3b298afafff6 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4bb3a9f-ea5f-4af3-909b-2dcedc7b7fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:30 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6284aef4-74dc-4a62-a404-3b298afafff6 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4bb3a9f-ea5f-4af3-909b-2dcedc7b7fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e21d9366-def3-4e19-a793-090dfe8d6a18', 'volume_name': 'volume-e21d9366-def3-4e19-a793-090dfe8d6a18', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:30 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6284aef4-74dc-4a62-a404-3b298afafff6 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1519cef-9ffd-486a-8bfe-9ddccc8bbc8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:30 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6284aef4-74dc-4a62-a404-3b298afafff6 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1519cef-9ffd-486a-8bfe-9ddccc8bbc8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:30 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6284aef4-74dc-4a62-a404-3b298afafff6 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42a45681-ae91-4b36-916b-cd3362753d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:30 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-6284aef4-74dc-4a62-a404-3b298afafff6 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Volume e21d9366-def3-4e19-a793-090dfe8d6a18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e21d9366-def3-4e19-a793-090dfe8d6a18', 'volume_size': 1} Jun 23 16:39:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-6284aef4-74dc-4a62-a404-3b298afafff6 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:39:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-6284aef4-74dc-4a62-a404-3b298afafff6 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:39:30 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-6284aef4-74dc-4a62-a404-3b298afafff6 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1089857519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e21d9366-def3-4e19-a793-090dfe8d6a18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b713c20df04b4de4bc5dd95d06dbf831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:39:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:39:30Z,use_quota=True,user_id='bac694bdd31e47a0a66d669c3acfa7b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db04ab18-b5a2-4fcf-b7e8-541a311062fe),volume_type_id=db04ab18-b5a2-4fcf-b7e8-541a311062fe)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:39:30 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-6284aef4-74dc-4a62-a404-3b298afafff6 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Creating volume e21d9366-def3-4e19-a793-090dfe8d6a18 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:39:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-6284aef4-74dc-4a62-a404-3b298afafff6 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:39:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-6284aef4-74dc-4a62-a404-3b298afafff6 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:39:30 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-6284aef4-74dc-4a62-a404-3b298afafff6 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:39:30 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-6284aef4-74dc-4a62-a404-3b298afafff6 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:39:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-6284aef4-74dc-4a62-a404-3b298afafff6 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:39:30 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-6284aef4-74dc-4a62-a404-3b298afafff6 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:39:30 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-6284aef4-74dc-4a62-a404-3b298afafff6 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:39:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-6284aef4-74dc-4a62-a404-3b298afafff6 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e21d9366-def3-4e19-a793-090dfe8d6a18 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:30 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e21d9366-def3-4e19-a793-090dfe8d6a18 1073741824 Jun 23 16:39:30 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:31 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:31 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-6284aef4-74dc-4a62-a404-3b298afafff6 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e21d9366-def3-4e19-a793-090dfe8d6a18 1073741824" returned: 0 in 1.116s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:31 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-6284aef4-74dc-4a62-a404-3b298afafff6 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e21d9366-def3-4e19-a793-090dfe8d6a18 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:31 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e21d9366-def3-4e19-a793-090dfe8d6a18 Jun 23 16:39:31 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:32 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-97dcb4a7-d5f1-48a5-9e30-dfa40a8477bd tempest-VolumesCloneNegativeTest-1731743577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:39:32 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-97dcb4a7-d5f1-48a5-9e30-dfa40a8477bd tempest-VolumesCloneNegativeTest-1731743577 None] Flow 'volume_create_manager' (e54c7c20-b31d-4887-8461-c379041cf4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:39:32 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-97dcb4a7-d5f1-48a5-9e30-dfa40a8477bd tempest-VolumesCloneNegativeTest-1731743577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1453e54e-2e9c-4834-b67c-0368d6726331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:32 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-97dcb4a7-d5f1-48a5-9e30-dfa40a8477bd tempest-VolumesCloneNegativeTest-1731743577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1453e54e-2e9c-4834-b67c-0368d6726331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2076132682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a8b5b7c-3d3e-4016-8eca-4321af7b98a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97321417564147c0934f48a299d3d71d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:39:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:39:32Z,use_quota=True,user_id='11c87e99e6834054a5d2ca64fec5004f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:32 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-97dcb4a7-d5f1-48a5-9e30-dfa40a8477bd tempest-VolumesCloneNegativeTest-1731743577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (460a4ae2-a9b0-478e-ae8b-5999f31833a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:32 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-97dcb4a7-d5f1-48a5-9e30-dfa40a8477bd tempest-VolumesCloneNegativeTest-1731743577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (460a4ae2-a9b0-478e-ae8b-5999f31833a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:32 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-97dcb4a7-d5f1-48a5-9e30-dfa40a8477bd tempest-VolumesCloneNegativeTest-1731743577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fb0312c-b758-48c5-89f3-b8e60365ce13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:32 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-97dcb4a7-d5f1-48a5-9e30-dfa40a8477bd tempest-VolumesCloneNegativeTest-1731743577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fb0312c-b758-48c5-89f3-b8e60365ce13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a8b5b7c-3d3e-4016-8eca-4321af7b98a0', 'volume_name': 'volume-4a8b5b7c-3d3e-4016-8eca-4321af7b98a0', 'volume_size': 2}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:32 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-97dcb4a7-d5f1-48a5-9e30-dfa40a8477bd tempest-VolumesCloneNegativeTest-1731743577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a7cdefb-cb72-4d59-bb77-9e39083614cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:32 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-97dcb4a7-d5f1-48a5-9e30-dfa40a8477bd tempest-VolumesCloneNegativeTest-1731743577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a7cdefb-cb72-4d59-bb77-9e39083614cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:32 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-97dcb4a7-d5f1-48a5-9e30-dfa40a8477bd tempest-VolumesCloneNegativeTest-1731743577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4a74af1-acf4-4223-b4cc-6fb77245817f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:32 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-97dcb4a7-d5f1-48a5-9e30-dfa40a8477bd tempest-VolumesCloneNegativeTest-1731743577 None] Volume 4a8b5b7c-3d3e-4016-8eca-4321af7b98a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a8b5b7c-3d3e-4016-8eca-4321af7b98a0', 'volume_size': 2} Jun 23 16:39:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-97dcb4a7-d5f1-48a5-9e30-dfa40a8477bd tempest-VolumesCloneNegativeTest-1731743577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:39:32 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-6284aef4-74dc-4a62-a404-3b298afafff6 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e21d9366-def3-4e19-a793-090dfe8d6a18" returned: 0 in 0.892s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:32 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-6284aef4-74dc-4a62-a404-3b298afafff6 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] <== create_volume: return (2076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:39:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-6284aef4-74dc-4a62-a404-3b298afafff6 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.079s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:39:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-97dcb4a7-d5f1-48a5-9e30-dfa40a8477bd tempest-VolumesCloneNegativeTest-1731743577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.253s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:39:32 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-97dcb4a7-d5f1-48a5-9e30-dfa40a8477bd tempest-VolumesCloneNegativeTest-1731743577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2076132682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a8b5b7c-3d3e-4016-8eca-4321af7b98a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97321417564147c0934f48a299d3d71d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:39:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:39:32Z,use_quota=True,user_id='11c87e99e6834054a5d2ca64fec5004f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:39:32 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-97dcb4a7-d5f1-48a5-9e30-dfa40a8477bd tempest-VolumesCloneNegativeTest-1731743577 None] Creating volume 4a8b5b7c-3d3e-4016-8eca-4321af7b98a0 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:39:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-97dcb4a7-d5f1-48a5-9e30-dfa40a8477bd tempest-VolumesCloneNegativeTest-1731743577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:39:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-97dcb4a7-d5f1-48a5-9e30-dfa40a8477bd tempest-VolumesCloneNegativeTest-1731743577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:39:32 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-97dcb4a7-d5f1-48a5-9e30-dfa40a8477bd tempest-VolumesCloneNegativeTest-1731743577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:39:32 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-97dcb4a7-d5f1-48a5-9e30-dfa40a8477bd tempest-VolumesCloneNegativeTest-1731743577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:39:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-97dcb4a7-d5f1-48a5-9e30-dfa40a8477bd tempest-VolumesCloneNegativeTest-1731743577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:39:32 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-97dcb4a7-d5f1-48a5-9e30-dfa40a8477bd tempest-VolumesCloneNegativeTest-1731743577 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:39:32 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-97dcb4a7-d5f1-48a5-9e30-dfa40a8477bd tempest-VolumesCloneNegativeTest-1731743577 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:39:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-97dcb4a7-d5f1-48a5-9e30-dfa40a8477bd tempest-VolumesCloneNegativeTest-1731743577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4a8b5b7c-3d3e-4016-8eca-4321af7b98a0 2147483648 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:32 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6284aef4-74dc-4a62-a404-3b298afafff6 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42a45681-ae91-4b36-916b-cd3362753d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e21d9366-def3-4e19-a793-090dfe8d6a18', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:32 devstack sudo[105911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4a8b5b7c-3d3e-4016-8eca-4321af7b98a0 2147483648 Jun 23 16:39:32 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:32 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6284aef4-74dc-4a62-a404-3b298afafff6 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb2dabbc-ffbf-4fc7-875a-ed671e7e0bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:32 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-6284aef4-74dc-4a62-a404-3b298afafff6 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Volume volume-e21d9366-def3-4e19-a793-090dfe8d6a18 (e21d9366-def3-4e19-a793-090dfe8d6a18): created successfully Jun 23 16:39:32 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6284aef4-74dc-4a62-a404-3b298afafff6 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb2dabbc-ffbf-4fc7-875a-ed671e7e0bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:32 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6284aef4-74dc-4a62-a404-3b298afafff6 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Flow 'volume_create_manager' (a8a09542-fced-40a9-b07d-3945c0cbe252) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:39:32 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-6284aef4-74dc-4a62-a404-3b298afafff6 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Created volume successfully. Jun 23 16:39:33 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:33 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-97dcb4a7-d5f1-48a5-9e30-dfa40a8477bd tempest-VolumesCloneNegativeTest-1731743577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4a8b5b7c-3d3e-4016-8eca-4321af7b98a0 2147483648" returned: 0 in 1.013s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:33 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-97dcb4a7-d5f1-48a5-9e30-dfa40a8477bd tempest-VolumesCloneNegativeTest-1731743577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4a8b5b7c-3d3e-4016-8eca-4321af7b98a0 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:33 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4a8b5b7c-3d3e-4016-8eca-4321af7b98a0 Jun 23 16:39:33 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:33 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-1f1731d5-6ea2-46a6-8cef-5c977e0a915b tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:39:33 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-1f1731d5-6ea2-46a6-8cef-5c977e0a915b tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:39:33 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-1f1731d5-6ea2-46a6-8cef-5c977e0a915b tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:39:33 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-1f1731d5-6ea2-46a6-8cef-5c977e0a915b tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:39:33 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-1f1731d5-6ea2-46a6-8cef-5c977e0a915b tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:39:33 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1f1731d5-6ea2-46a6-8cef-5c977e0a915b tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:34 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:39:34 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:34 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-97dcb4a7-d5f1-48a5-9e30-dfa40a8477bd tempest-VolumesCloneNegativeTest-1731743577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4a8b5b7c-3d3e-4016-8eca-4321af7b98a0" returned: 0 in 0.926s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:34 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-97dcb4a7-d5f1-48a5-9e30-dfa40a8477bd tempest-VolumesCloneNegativeTest-1731743577 None] <== create_volume: return (1994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:39:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-97dcb4a7-d5f1-48a5-9e30-dfa40a8477bd tempest-VolumesCloneNegativeTest-1731743577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.997s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:39:34 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-97dcb4a7-d5f1-48a5-9e30-dfa40a8477bd tempest-VolumesCloneNegativeTest-1731743577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4a74af1-acf4-4223-b4cc-6fb77245817f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a8b5b7c-3d3e-4016-8eca-4321af7b98a0', 'volume_size': 2}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:34 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-97dcb4a7-d5f1-48a5-9e30-dfa40a8477bd tempest-VolumesCloneNegativeTest-1731743577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e048dff-5237-427e-a1b1-a097476d8efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:34 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-97dcb4a7-d5f1-48a5-9e30-dfa40a8477bd tempest-VolumesCloneNegativeTest-1731743577 None] Volume volume-4a8b5b7c-3d3e-4016-8eca-4321af7b98a0 (4a8b5b7c-3d3e-4016-8eca-4321af7b98a0): created successfully Jun 23 16:39:34 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-97dcb4a7-d5f1-48a5-9e30-dfa40a8477bd tempest-VolumesCloneNegativeTest-1731743577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e048dff-5237-427e-a1b1-a097476d8efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:34 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-97dcb4a7-d5f1-48a5-9e30-dfa40a8477bd tempest-VolumesCloneNegativeTest-1731743577 None] Flow 'volume_create_manager' (e54c7c20-b31d-4887-8461-c379041cf4ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:39:34 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-97dcb4a7-d5f1-48a5-9e30-dfa40a8477bd tempest-VolumesCloneNegativeTest-1731743577 None] Created volume successfully. Jun 23 16:39:34 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1f1731d5-6ea2-46a6-8cef-5c977e0a915b tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.886s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:34 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-1f1731d5-6ea2-46a6-8cef-5c977e0a915b tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:39:34 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-1f1731d5-6ea2-46a6-8cef-5c977e0a915b tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Retype volume completed successfully. Jun 23 16:39:34 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:39:34 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] Flow 'volume_create_manager' (70bb2c9a-e22e-477a-bf1f-898173bc6d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:39:34 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a5f4243-6c11-457f-9a71-3113a7cc56ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:34 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a5f4243-6c11-457f-9a71-3113a7cc56ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:39:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-87436990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cabb9b24-46fc-4e7d-bcd3-af0989aa4029,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='704ab66ae56a42be8760d0ac786c255d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:39:35Z,use_quota=True,user_id='3298be154bb24c2cbee0f3694ba44b26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:34 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71b04a01-2aae-4d68-975b-f2f25c048d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:34 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71b04a01-2aae-4d68-975b-f2f25c048d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:34 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec169c27-4aa1-471c-ab12-661c13ff56c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:34 devstack cinder-volume[93788]: DEBUG cinder.image.glance [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] Creating Keystone auth plugin from conf {{(pid=93788) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 16:39:35 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec169c27-4aa1-471c-ab12-661c13ff56c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cabb9b24-46fc-4e7d-bcd3-af0989aa4029', 'volume_name': 'volume-cabb9b24-46fc-4e7d-bcd3-af0989aa4029', 'volume_size': 1, 'image_id': '36d19347-ef32-4018-a0b0-67c4eb356ff0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/36d19347-ef32-4018-a0b0-67c4eb356ff0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '96f86ae628444b53b4eb7231789566de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '36d19347-ef32-4018-a0b0-67c4eb356ff0', 'created_at': datetime.datetime(2026, 6, 23, 14, 20, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 14, 20, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36d19347-ef32-4018-a0b0-67c4eb356ff0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:35 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58da4443-7b97-4485-a1af-f84a3954a9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:35 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58da4443-7b97-4485-a1af-f84a3954a9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:35 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (317a29d2-df6b-40d7-847f-cb4799277d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:35 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] Volume cabb9b24-46fc-4e7d-bcd3-af0989aa4029: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cabb9b24-46fc-4e7d-bcd3-af0989aa4029', 'volume_size': 1, 'image_id': '36d19347-ef32-4018-a0b0-67c4eb356ff0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/36d19347-ef32-4018-a0b0-67c4eb356ff0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '96f86ae628444b53b4eb7231789566de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '36d19347-ef32-4018-a0b0-67c4eb356ff0', 'created_at': datetime.datetime(2026, 6, 23, 14, 20, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 14, 20, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36d19347-ef32-4018-a0b0-67c4eb356ff0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 23 16:39:35 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] Trying to clone cabb9b24-46fc-4e7d-bcd3-af0989aa4029 from image 36d19347-ef32-4018-a0b0-67c4eb356ff0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/36d19347-ef32-4018-a0b0-67c4eb356ff0', 'metadata': {}}]). {{(pid=93788) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 16:39:35 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-8ec330da-d67b-4ca8-9230-dba498364ae7 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Acquiring lock "cinder-e21d9366-def3-4e19-a793-090dfe8d6a18-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:39:35 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-8ec330da-d67b-4ca8-9230-dba498364ae7 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Lock "cinder-e21d9366-def3-4e19-a793-090dfe8d6a18-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:39:35 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-8ec330da-d67b-4ca8-9230-dba498364ae7 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Acquiring lock "cinder-quobyte-e21d9366-def3-4e19-a793-090dfe8d6a18" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:39:35 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-fa44770c-e72d-4dc1-af1f-7a309532c44d tempest-VolumesCloneNegativeTest-1731743577 None] Acquiring lock "cinder-4a8b5b7c-3d3e-4016-8eca-4321af7b98a0-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:39:35 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-8ec330da-d67b-4ca8-9230-dba498364ae7 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Lock "cinder-quobyte-e21d9366-def3-4e19-a793-090dfe8d6a18" acquired by "delete_volume" :: waited 0.067s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:39:35 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c5e666-0805-40fc-bb3b-76cc6d82495a]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:39:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8ec330da-d67b-4ca8-9230-dba498364ae7 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e21d9366-def3-4e19-a793-090dfe8d6a18 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:35 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-fa44770c-e72d-4dc1-af1f-7a309532c44d tempest-VolumesCloneNegativeTest-1731743577 None] Lock "cinder-4a8b5b7c-3d3e-4016-8eca-4321af7b98a0-delete_volume" acquired by "delete_volume" :: waited 0.165s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:39:35 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-fa44770c-e72d-4dc1-af1f-7a309532c44d tempest-VolumesCloneNegativeTest-1731743577 None] Acquiring lock "cinder-quobyte-4a8b5b7c-3d3e-4016-8eca-4321af7b98a0" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:39:35 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e21d9366-def3-4e19-a793-090dfe8d6a18 Jun 23 16:39:35 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-fa44770c-e72d-4dc1-af1f-7a309532c44d tempest-VolumesCloneNegativeTest-1731743577 None] Lock "cinder-quobyte-4a8b5b7c-3d3e-4016-8eca-4321af7b98a0" acquired by "delete_volume" :: waited 0.051s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:39:35 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:36 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56c2b1d-8845-4ad8-ad54-aef560151a6c]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:39:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-fa44770c-e72d-4dc1-af1f-7a309532c44d tempest-VolumesCloneNegativeTest-1731743577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4a8b5b7c-3d3e-4016-8eca-4321af7b98a0 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:36 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_q8fy83hodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93788) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 16:39:36 devstack cinder-volume[93788]: INFO cinder.image.image_utils [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] Image download 20.69 MB at 20.69 MB/s Jun 23 16:39:36 devstack sudo[106342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4a8b5b7c-3d3e-4016-8eca-4321af7b98a0 Jun 23 16:39:36 devstack sudo[106342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:36 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c6810f-4203-4f52-91fd-20a8d33b08e2]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:39:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_q8fy83hodevstack@QuobyteHD {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:36 devstack sudo[106355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_q8fy83hodevstack@QuobyteHD Jun 23 16:39:36 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:37 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8ec330da-d67b-4ca8-9230-dba498364ae7 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e21d9366-def3-4e19-a793-090dfe8d6a18" returned: 0 in 1.387s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8ec330da-d67b-4ca8-9230-dba498364ae7 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e21d9366-def3-4e19-a793-090dfe8d6a18 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:37 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e21d9366-def3-4e19-a793-090dfe8d6a18 Jun 23 16:39:37 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:37 devstack sudo[106342]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-fa44770c-e72d-4dc1-af1f-7a309532c44d tempest-VolumesCloneNegativeTest-1731743577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4a8b5b7c-3d3e-4016-8eca-4321af7b98a0" returned: 0 in 1.405s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-fa44770c-e72d-4dc1-af1f-7a309532c44d tempest-VolumesCloneNegativeTest-1731743577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4a8b5b7c-3d3e-4016-8eca-4321af7b98a0 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:37 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4a8b5b7c-3d3e-4016-8eca-4321af7b98a0 Jun 23 16:39:37 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:37 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_q8fy83hodevstack@QuobyteHD" returned: 0 in 1.265s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:37 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] Temporary image 36d19347-ef32-4018-a0b0-67c4eb356ff0 is fetched for user 3298be154bb24c2cbee0f3694ba44b26. {{(pid=93788) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 16:39:37 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:SELECT=124,cinder:UPDATE=161,cinder:INSERT=32,cinder:DELETE=13 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:39:37 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae16dd27-fc0a-4761-a221-837f827cbf08]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:39:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_q8fy83hodevstack@QuobyteHD {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:37 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8ec330da-d67b-4ca8-9230-dba498364ae7 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e21d9366-def3-4e19-a793-090dfe8d6a18" returned: 0 in 0.812s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:37 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-8ec330da-d67b-4ca8-9230-dba498364ae7 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Lock "cinder-quobyte-e21d9366-def3-4e19-a793-090dfe8d6a18" released by "delete_volume" :: held 2.336s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:39:37 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_q8fy83hodevstack@QuobyteHD Jun 23 16:39:37 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:37 devstack cinder-volume[93788]: WARNING cinder.quota [None req-8ec330da-d67b-4ca8-9230-dba498364ae7 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:39:37 devstack cinder-volume[93788]: WARNING cinder.quota [None req-8ec330da-d67b-4ca8-9230-dba498364ae7 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:39:38 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-8ec330da-d67b-4ca8-9230-dba498364ae7 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Created reservations ['569d8bdd-66e8-4b43-a736-d147e013dffb', 'a79a728e-c493-4e21-8ed2-406893b06c80', 'a9676d66-05e5-497e-a321-4563ad051c03', 'd9f8cf17-488e-4214-a637-9ba648e1c270'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:39:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8ec330da-d67b-4ca8-9230-dba498364ae7 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:39:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8ec330da-d67b-4ca8-9230-dba498364ae7 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:39:38 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-8ec330da-d67b-4ca8-9230-dba498364ae7 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:39:38 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-8ec330da-d67b-4ca8-9230-dba498364ae7 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:39:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8ec330da-d67b-4ca8-9230-dba498364ae7 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:39:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8ec330da-d67b-4ca8-9230-dba498364ae7 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:38 devstack sudo[106383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:39:38 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:38 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-fa44770c-e72d-4dc1-af1f-7a309532c44d tempest-VolumesCloneNegativeTest-1731743577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4a8b5b7c-3d3e-4016-8eca-4321af7b98a0" returned: 0 in 1.271s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:38 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-fa44770c-e72d-4dc1-af1f-7a309532c44d tempest-VolumesCloneNegativeTest-1731743577 None] Lock "cinder-quobyte-4a8b5b7c-3d3e-4016-8eca-4321af7b98a0" released by "delete_volume" :: held 2.792s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:39:38 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-fa44770c-e72d-4dc1-af1f-7a309532c44d tempest-VolumesCloneNegativeTest-1731743577 None] Created reservations ['d93d52e0-4eac-45fa-a88d-6089cbeed2b2', '8c5329a4-15fe-4f2b-b66f-97c1050cab99', '05b00165-ea23-4e9d-96f7-01834490f23e', 'c5fb5436-ac8f-4610-b7e2-1bd301029ba5'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:39:38 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_q8fy83hodevstack@QuobyteHD" returned: 0 in 1.281s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:39:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:39:38 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:39:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-87436990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cabb9b24-46fc-4e7d-bcd3-af0989aa4029,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='704ab66ae56a42be8760d0ac786c255d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:39:35Z,use_quota=True,user_id='3298be154bb24c2cbee0f3694ba44b26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:39:38 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] Creating volume cabb9b24-46fc-4e7d-bcd3-af0989aa4029 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:39:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:39:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:39:38 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:39:38 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:39:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:39:38 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:39:38 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:39:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cabb9b24-46fc-4e7d-bcd3-af0989aa4029 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:38 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cabb9b24-46fc-4e7d-bcd3-af0989aa4029 1073741824 Jun 23 16:39:38 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-fa44770c-e72d-4dc1-af1f-7a309532c44d tempest-VolumesCloneNegativeTest-1731743577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:39:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-fa44770c-e72d-4dc1-af1f-7a309532c44d tempest-VolumesCloneNegativeTest-1731743577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:39:39 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-fa44770c-e72d-4dc1-af1f-7a309532c44d tempest-VolumesCloneNegativeTest-1731743577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:39:39 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-fa44770c-e72d-4dc1-af1f-7a309532c44d tempest-VolumesCloneNegativeTest-1731743577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:39:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-fa44770c-e72d-4dc1-af1f-7a309532c44d tempest-VolumesCloneNegativeTest-1731743577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:39:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-fa44770c-e72d-4dc1-af1f-7a309532c44d tempest-VolumesCloneNegativeTest-1731743577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:39 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:39:39 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:39 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8ec330da-d67b-4ca8-9230-dba498364ae7 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.224s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:39 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-8ec330da-d67b-4ca8-9230-dba498364ae7 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:39:39 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-8ec330da-d67b-4ca8-9230-dba498364ae7 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Deleted volume successfully. Jun 23 16:39:39 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-8ec330da-d67b-4ca8-9230-dba498364ae7 tempest-VolumeRetypeWithoutMigrationTest-1954731042 None] Lock "cinder-e21d9366-def3-4e19-a793-090dfe8d6a18-delete_volume" released by "delete_volume" :: held 4.066s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:39:40 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-fa44770c-e72d-4dc1-af1f-7a309532c44d tempest-VolumesCloneNegativeTest-1731743577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.647s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:40 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-fa44770c-e72d-4dc1-af1f-7a309532c44d tempest-VolumesCloneNegativeTest-1731743577 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:39:40 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-fa44770c-e72d-4dc1-af1f-7a309532c44d tempest-VolumesCloneNegativeTest-1731743577 None] Deleted volume successfully. Jun 23 16:39:40 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cabb9b24-46fc-4e7d-bcd3-af0989aa4029 1073741824" returned: 0 in 1.823s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:40 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-fa44770c-e72d-4dc1-af1f-7a309532c44d tempest-VolumesCloneNegativeTest-1731743577 None] Lock "cinder-4a8b5b7c-3d3e-4016-8eca-4321af7b98a0-delete_volume" released by "delete_volume" :: held 5.082s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:39:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cabb9b24-46fc-4e7d-bcd3-af0989aa4029 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:40 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cabb9b24-46fc-4e7d-bcd3-af0989aa4029 Jun 23 16:39:40 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:41 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cabb9b24-46fc-4e7d-bcd3-af0989aa4029" returned: 0 in 1.008s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:41 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] <== create_volume: return (2921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:39:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.928s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:39:41 devstack cinder-volume[93788]: DEBUG cinder.volume.volume_utils [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] Attempting download of 36d19347-ef32-4018-a0b0-67c4eb356ff0 ((None, [{'url': 'file:///opt/stack/data/glance/images/36d19347-ef32-4018-a0b0-67c4eb356ff0', 'metadata': {}}])) to volume cabb9b24-46fc-4e7d-bcd3-af0989aa4029. {{(pid=93788) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 16:39:41 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfe8563-3d58-44a5-9b61-5d19c4b433b1]: (4, 'raw') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:39:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36d19347-ef32-4018-a0b0-67c4eb356ff0_wjjr043b {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:42 devstack sudo[106405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36d19347-ef32-4018-a0b0-67c4eb356ff0_wjjr043b Jun 23 16:39:42 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:43 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36d19347-ef32-4018-a0b0-67c4eb356ff0_wjjr043b" returned: 0 in 1.157s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36d19347-ef32-4018-a0b0-67c4eb356ff0_wjjr043b {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:43 devstack sudo[106410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36d19347-ef32-4018-a0b0-67c4eb356ff0_wjjr043b Jun 23 16:39:43 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:44 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36d19347-ef32-4018-a0b0-67c4eb356ff0_wjjr043b" returned: 1 in 1.321s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36d19347-ef32-4018-a0b0-67c4eb356ff0_wjjr043b' failed. Not Retrying. {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:39:44 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[88db5d82-e86c-4f00-bbd5-bd6772d5fcf4]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:39:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_q8fy83hodevstack@QuobyteHD {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:44 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_q8fy83hodevstack@QuobyteHD Jun 23 16:39:44 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:46 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_q8fy83hodevstack@QuobyteHD" returned: 0 in 1.595s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:46 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] 36d19347-ef32-4018-a0b0-67c4eb356ff0 was qcow2, converting to raw {{(pid=93788) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 16:39:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_q8fy83hodevstack@QuobyteHD /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cabb9b24-46fc-4e7d-bcd3-af0989aa4029 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:46 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_q8fy83hodevstack@QuobyteHD /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cabb9b24-46fc-4e7d-bcd3-af0989aa4029 Jun 23 16:39:46 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:46 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d40cd36-7aab-42a7-9e40-d892b60c4b15 tempest-VolumesGetTest-1550830579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:39:46 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4d40cd36-7aab-42a7-9e40-d892b60c4b15 tempest-VolumesGetTest-1550830579 None] Flow 'volume_create_manager' (8d40daac-78c9-49bc-8c85-2a333c214697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:39:46 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4d40cd36-7aab-42a7-9e40-d892b60c4b15 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (209aba56-67b5-4739-b6cd-3de8326897a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:46 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4d40cd36-7aab-42a7-9e40-d892b60c4b15 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (209aba56-67b5-4739-b6cd-3de8326897a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:39:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-400844633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d71c2ff-047e-4252-a1fa-0e8400310399,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7e0c6765fc6c450aa7d0be9b768dc1f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:39:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:39:46Z,use_quota=True,user_id='a0eda2b8c0f54a9cb23869514ffecda4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:46 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4d40cd36-7aab-42a7-9e40-d892b60c4b15 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (493b8a64-b744-4d8f-9e10-2fc16b9a329f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:46 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4d40cd36-7aab-42a7-9e40-d892b60c4b15 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (493b8a64-b744-4d8f-9e10-2fc16b9a329f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:46 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4d40cd36-7aab-42a7-9e40-d892b60c4b15 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (030dc247-061b-482d-aba8-748b1b4285c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:46 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4d40cd36-7aab-42a7-9e40-d892b60c4b15 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (030dc247-061b-482d-aba8-748b1b4285c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d71c2ff-047e-4252-a1fa-0e8400310399', 'volume_name': 'volume-6d71c2ff-047e-4252-a1fa-0e8400310399', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:46 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4d40cd36-7aab-42a7-9e40-d892b60c4b15 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c41d2e2-f0c9-4a4a-b76e-eed25297994e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:46 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4d40cd36-7aab-42a7-9e40-d892b60c4b15 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c41d2e2-f0c9-4a4a-b76e-eed25297994e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:46 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4d40cd36-7aab-42a7-9e40-d892b60c4b15 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b1392d6-bd68-4a36-b0f5-f1a05fd990f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:46 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-4d40cd36-7aab-42a7-9e40-d892b60c4b15 tempest-VolumesGetTest-1550830579 None] Volume 6d71c2ff-047e-4252-a1fa-0e8400310399: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d71c2ff-047e-4252-a1fa-0e8400310399', 'volume_size': 1} Jun 23 16:39:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-4d40cd36-7aab-42a7-9e40-d892b60c4b15 tempest-VolumesGetTest-1550830579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:39:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-4d40cd36-7aab-42a7-9e40-d892b60c4b15 tempest-VolumesGetTest-1550830579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:39:46 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-4d40cd36-7aab-42a7-9e40-d892b60c4b15 tempest-VolumesGetTest-1550830579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:39:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-400844633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d71c2ff-047e-4252-a1fa-0e8400310399,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7e0c6765fc6c450aa7d0be9b768dc1f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:39:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:39:46Z,use_quota=True,user_id='a0eda2b8c0f54a9cb23869514ffecda4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:39:46 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-4d40cd36-7aab-42a7-9e40-d892b60c4b15 tempest-VolumesGetTest-1550830579 None] Creating volume 6d71c2ff-047e-4252-a1fa-0e8400310399 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:39:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-4d40cd36-7aab-42a7-9e40-d892b60c4b15 tempest-VolumesGetTest-1550830579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:39:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-4d40cd36-7aab-42a7-9e40-d892b60c4b15 tempest-VolumesGetTest-1550830579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:39:46 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-4d40cd36-7aab-42a7-9e40-d892b60c4b15 tempest-VolumesGetTest-1550830579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:39:46 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-4d40cd36-7aab-42a7-9e40-d892b60c4b15 tempest-VolumesGetTest-1550830579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:39:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-4d40cd36-7aab-42a7-9e40-d892b60c4b15 tempest-VolumesGetTest-1550830579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:39:46 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-4d40cd36-7aab-42a7-9e40-d892b60c4b15 tempest-VolumesGetTest-1550830579 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:39:46 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-4d40cd36-7aab-42a7-9e40-d892b60c4b15 tempest-VolumesGetTest-1550830579 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:39:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4d40cd36-7aab-42a7-9e40-d892b60c4b15 tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6d71c2ff-047e-4252-a1fa-0e8400310399 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:46 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6d71c2ff-047e-4252-a1fa-0e8400310399 1073741824 Jun 23 16:39:46 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:48 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4d40cd36-7aab-42a7-9e40-d892b60c4b15 tempest-VolumesGetTest-1550830579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6d71c2ff-047e-4252-a1fa-0e8400310399 1073741824" returned: 0 in 1.705s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:48 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:SELECT=124,cinder:UPDATE=145,cinder:INSERT=40,cinder:DELETE=11 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:39:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4d40cd36-7aab-42a7-9e40-d892b60c4b15 tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6d71c2ff-047e-4252-a1fa-0e8400310399 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:48 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6d71c2ff-047e-4252-a1fa-0e8400310399 Jun 23 16:39:48 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:49 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_q8fy83hodevstack@QuobyteHD /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cabb9b24-46fc-4e7d-bcd3-af0989aa4029" returned: 0 in 3.202s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:49 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_q8fy83hodevstack@QuobyteHD, size 112.00 MB, duration 3.21 sec, destination /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cabb9b24-46fc-4e7d-bcd3-af0989aa4029 {{(pid=93788) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 16:39:49 devstack cinder-volume[93788]: INFO cinder.image.image_utils [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] Converted 112.00 MB image at 34.90 MB/s Jun 23 16:39:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cabb9b24-46fc-4e7d-bcd3-af0989aa4029 1G {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:49 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cabb9b24-46fc-4e7d-bcd3-af0989aa4029 1G Jun 23 16:39:49 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:49 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4d40cd36-7aab-42a7-9e40-d892b60c4b15 tempest-VolumesGetTest-1550830579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6d71c2ff-047e-4252-a1fa-0e8400310399" returned: 0 in 1.298s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:49 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-4d40cd36-7aab-42a7-9e40-d892b60c4b15 tempest-VolumesGetTest-1550830579 None] <== create_volume: return (3130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:39:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-4d40cd36-7aab-42a7-9e40-d892b60c4b15 tempest-VolumesGetTest-1550830579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.132s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:39:49 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4d40cd36-7aab-42a7-9e40-d892b60c4b15 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b1392d6-bd68-4a36-b0f5-f1a05fd990f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d71c2ff-047e-4252-a1fa-0e8400310399', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:49 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4d40cd36-7aab-42a7-9e40-d892b60c4b15 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9523dd96-98dc-46bb-a46b-65ca2fe01141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:49 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-4d40cd36-7aab-42a7-9e40-d892b60c4b15 tempest-VolumesGetTest-1550830579 None] Volume volume-6d71c2ff-047e-4252-a1fa-0e8400310399 (6d71c2ff-047e-4252-a1fa-0e8400310399): created successfully Jun 23 16:39:49 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4d40cd36-7aab-42a7-9e40-d892b60c4b15 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9523dd96-98dc-46bb-a46b-65ca2fe01141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:49 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4d40cd36-7aab-42a7-9e40-d892b60c4b15 tempest-VolumesGetTest-1550830579 None] Flow 'volume_create_manager' (8d40daac-78c9-49bc-8c85-2a333c214697) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:39:49 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-4d40cd36-7aab-42a7-9e40-d892b60c4b15 tempest-VolumesGetTest-1550830579 None] Created volume successfully. Jun 23 16:39:50 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cabb9b24-46fc-4e7d-bcd3-af0989aa4029 1G" returned: 0 in 1.184s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:50 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2be4ef7-8e9a-4a0f-9508-6b3dc90cd413]: (4, 'raw') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:39:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cabb9b24-46fc-4e7d-bcd3-af0989aa4029 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:50 devstack sudo[106451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cabb9b24-46fc-4e7d-bcd3-af0989aa4029 Jun 23 16:39:50 devstack sudo[106451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:50 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-337620a7-9357-4c60-849f-e6d1daa3aca7 tempest-VolumesServicesTestJSON-36464369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:39:50 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-337620a7-9357-4c60-849f-e6d1daa3aca7 tempest-VolumesServicesTestJSON-36464369 None] Flow 'volume_create_manager' (b99752b4-ecb2-4a00-86a6-1bdc4458948e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:39:50 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-337620a7-9357-4c60-849f-e6d1daa3aca7 tempest-VolumesServicesTestJSON-36464369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3961c65a-7988-4055-969b-302f69285663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:50 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-337620a7-9357-4c60-849f-e6d1daa3aca7 tempest-VolumesServicesTestJSON-36464369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3961c65a-7988-4055-969b-302f69285663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2078256523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=153ed5d7-e11b-46ba-a25f-6a6d238c3f0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edfd0e60c7a04f54bf751d1c09ac4b10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:39:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:39:51Z,use_quota=True,user_id='091b37d1c381469b833ad57c23e26ac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:50 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-337620a7-9357-4c60-849f-e6d1daa3aca7 tempest-VolumesServicesTestJSON-36464369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ca3efbd-394b-4505-b95b-ff9b9f4a1810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:50 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-337620a7-9357-4c60-849f-e6d1daa3aca7 tempest-VolumesServicesTestJSON-36464369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ca3efbd-394b-4505-b95b-ff9b9f4a1810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:50 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-337620a7-9357-4c60-849f-e6d1daa3aca7 tempest-VolumesServicesTestJSON-36464369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cec65f64-d9c6-4dbe-a0e2-68332c28711d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:51 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-337620a7-9357-4c60-849f-e6d1daa3aca7 tempest-VolumesServicesTestJSON-36464369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cec65f64-d9c6-4dbe-a0e2-68332c28711d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '153ed5d7-e11b-46ba-a25f-6a6d238c3f0d', 'volume_name': 'volume-153ed5d7-e11b-46ba-a25f-6a6d238c3f0d', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:51 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-337620a7-9357-4c60-849f-e6d1daa3aca7 tempest-VolumesServicesTestJSON-36464369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (983e6167-dfb7-45e2-b039-7a99f6a44bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:51 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-337620a7-9357-4c60-849f-e6d1daa3aca7 tempest-VolumesServicesTestJSON-36464369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (983e6167-dfb7-45e2-b039-7a99f6a44bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:51 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-337620a7-9357-4c60-849f-e6d1daa3aca7 tempest-VolumesServicesTestJSON-36464369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c22537c-db87-4215-bd3b-0d01fb29c758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:51 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-337620a7-9357-4c60-849f-e6d1daa3aca7 tempest-VolumesServicesTestJSON-36464369 None] Volume 153ed5d7-e11b-46ba-a25f-6a6d238c3f0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-153ed5d7-e11b-46ba-a25f-6a6d238c3f0d', 'volume_size': 1} Jun 23 16:39:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-337620a7-9357-4c60-849f-e6d1daa3aca7 tempest-VolumesServicesTestJSON-36464369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:39:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-337620a7-9357-4c60-849f-e6d1daa3aca7 tempest-VolumesServicesTestJSON-36464369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:39:51 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-337620a7-9357-4c60-849f-e6d1daa3aca7 tempest-VolumesServicesTestJSON-36464369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2078256523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=153ed5d7-e11b-46ba-a25f-6a6d238c3f0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edfd0e60c7a04f54bf751d1c09ac4b10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:39:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:39:51Z,use_quota=True,user_id='091b37d1c381469b833ad57c23e26ac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:39:51 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-337620a7-9357-4c60-849f-e6d1daa3aca7 tempest-VolumesServicesTestJSON-36464369 None] Creating volume 153ed5d7-e11b-46ba-a25f-6a6d238c3f0d {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:39:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-337620a7-9357-4c60-849f-e6d1daa3aca7 tempest-VolumesServicesTestJSON-36464369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:39:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-337620a7-9357-4c60-849f-e6d1daa3aca7 tempest-VolumesServicesTestJSON-36464369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:39:51 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-337620a7-9357-4c60-849f-e6d1daa3aca7 tempest-VolumesServicesTestJSON-36464369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:39:51 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-337620a7-9357-4c60-849f-e6d1daa3aca7 tempest-VolumesServicesTestJSON-36464369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:39:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-337620a7-9357-4c60-849f-e6d1daa3aca7 tempest-VolumesServicesTestJSON-36464369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:39:51 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-337620a7-9357-4c60-849f-e6d1daa3aca7 tempest-VolumesServicesTestJSON-36464369 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:39:51 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-337620a7-9357-4c60-849f-e6d1daa3aca7 tempest-VolumesServicesTestJSON-36464369 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:39:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-337620a7-9357-4c60-849f-e6d1daa3aca7 tempest-VolumesServicesTestJSON-36464369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-153ed5d7-e11b-46ba-a25f-6a6d238c3f0d 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:51 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-153ed5d7-e11b-46ba-a25f-6a6d238c3f0d 1073741824 Jun 23 16:39:51 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:51 devstack sudo[106451]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cabb9b24-46fc-4e7d-bcd3-af0989aa4029" returned: 0 in 1.239s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cabb9b24-46fc-4e7d-bcd3-af0989aa4029 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:51 devstack sudo[106481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cabb9b24-46fc-4e7d-bcd3-af0989aa4029 Jun 23 16:39:51 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:52 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1fa83c1-1e4a-473d-acb4-a167313b3dda tempest-VolumesGetTest-1550830579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:39:52 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b1fa83c1-1e4a-473d-acb4-a167313b3dda tempest-VolumesGetTest-1550830579 None] Flow 'volume_create_manager' (ad9b2708-cc2a-4957-a179-0a83d8981612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:39:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b1fa83c1-1e4a-473d-acb4-a167313b3dda tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce4b25c2-4887-4986-92ba-618476c410f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-337620a7-9357-4c60-849f-e6d1daa3aca7 tempest-VolumesServicesTestJSON-36464369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-153ed5d7-e11b-46ba-a25f-6a6d238c3f0d 1073741824" returned: 0 in 1.223s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b1fa83c1-1e4a-473d-acb4-a167313b3dda tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce4b25c2-4887-4986-92ba-618476c410f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:39:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1379619387',display_name='tempest-VolumesGetTest-Volume-351085389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7c3d521-ca3a-493a-87a0-1d909bba4fd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e0c6765fc6c450aa7d0be9b768dc1f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:39:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:39:52Z,use_quota=True,user_id='a0eda2b8c0f54a9cb23869514ffecda4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b1fa83c1-1e4a-473d-acb4-a167313b3dda tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d327bfc5-ca2f-44fc-a1d5-17ce2a15e6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b1fa83c1-1e4a-473d-acb4-a167313b3dda tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d327bfc5-ca2f-44fc-a1d5-17ce2a15e6ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b1fa83c1-1e4a-473d-acb4-a167313b3dda tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36969781-4803-4769-8473-af66f7f5a0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b1fa83c1-1e4a-473d-acb4-a167313b3dda tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36969781-4803-4769-8473-af66f7f5a0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7c3d521-ca3a-493a-87a0-1d909bba4fd0', 'volume_name': 'volume-e7c3d521-ca3a-493a-87a0-1d909bba4fd0', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b1fa83c1-1e4a-473d-acb4-a167313b3dda tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93f37df1-75d5-4d79-be93-044b8e6d7593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b1fa83c1-1e4a-473d-acb4-a167313b3dda tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93f37df1-75d5-4d79-be93-044b8e6d7593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b1fa83c1-1e4a-473d-acb4-a167313b3dda tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa34520d-a43d-4fac-932c-0ff79d5f16ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:52 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-b1fa83c1-1e4a-473d-acb4-a167313b3dda tempest-VolumesGetTest-1550830579 None] Volume e7c3d521-ca3a-493a-87a0-1d909bba4fd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7c3d521-ca3a-493a-87a0-1d909bba4fd0', 'volume_size': 1} Jun 23 16:39:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b1fa83c1-1e4a-473d-acb4-a167313b3dda tempest-VolumesGetTest-1550830579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:39:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-337620a7-9357-4c60-849f-e6d1daa3aca7 tempest-VolumesServicesTestJSON-36464369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-153ed5d7-e11b-46ba-a25f-6a6d238c3f0d {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:52 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-153ed5d7-e11b-46ba-a25f-6a6d238c3f0d Jun 23 16:39:52 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:52 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cabb9b24-46fc-4e7d-bcd3-af0989aa4029" returned: 1 in 0.974s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cabb9b24-46fc-4e7d-bcd3-af0989aa4029' failed. Not Retrying. {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:39:52 devstack cinder-volume[93788]: DEBUG cinder.volume.volume_utils [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] Downloaded image 36d19347-ef32-4018-a0b0-67c4eb356ff0 ((None, [{'url': 'file:///opt/stack/data/glance/images/36d19347-ef32-4018-a0b0-67c4eb356ff0', 'metadata': {}}])) to volume cabb9b24-46fc-4e7d-bcd3-af0989aa4029 successfully. {{(pid=93788) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 16:39:52 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] Temporary image 36d19347-ef32-4018-a0b0-67c4eb356ff0 for user 3298be154bb24c2cbee0f3694ba44b26 is deleted. {{(pid=93788) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 16:39:52 devstack cinder-volume[93788]: DEBUG cinder.volume.volume_utils [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] Marking volume cabb9b24-46fc-4e7d-bcd3-af0989aa4029 as bootable. {{(pid=93788) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 16:39:52 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] Copying metadata from image 36d19347-ef32-4018-a0b0-67c4eb356ff0 to cabb9b24-46fc-4e7d-bcd3-af0989aa4029. {{(pid=93788) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 16:39:52 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] Creating volume glance metadata for volume cabb9b24-46fc-4e7d-bcd3-af0989aa4029 backed by image 36d19347-ef32-4018-a0b0-67c4eb356ff0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '36d19347-ef32-4018-a0b0-67c4eb356ff0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93788) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 16:39:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (317a29d2-df6b-40d7-847f-cb4799277d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cabb9b24-46fc-4e7d-bcd3-af0989aa4029', 'volume_size': 1, 'image_id': '36d19347-ef32-4018-a0b0-67c4eb356ff0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/36d19347-ef32-4018-a0b0-67c4eb356ff0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '96f86ae628444b53b4eb7231789566de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '36d19347-ef32-4018-a0b0-67c4eb356ff0', 'created_at': datetime.datetime(2026, 6, 23, 14, 20, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 14, 20, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36d19347-ef32-4018-a0b0-67c4eb356ff0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ad8439b-8275-4a58-9623-a5c09219ee65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:52 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] Volume volume-cabb9b24-46fc-4e7d-bcd3-af0989aa4029 (cabb9b24-46fc-4e7d-bcd3-af0989aa4029): created successfully Jun 23 16:39:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ad8439b-8275-4a58-9623-a5c09219ee65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] Flow 'volume_create_manager' (70bb2c9a-e22e-477a-bf1f-898173bc6d85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:39:52 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-c2e0a363-4ed0-4e33-9188-7667d8bcc2c2 tempest-VolumesImageMetadata-365656573 None] Created volume successfully. Jun 23 16:39:53 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:53 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-337620a7-9357-4c60-849f-e6d1daa3aca7 tempest-VolumesServicesTestJSON-36464369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-153ed5d7-e11b-46ba-a25f-6a6d238c3f0d" returned: 0 in 0.747s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:53 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-337620a7-9357-4c60-849f-e6d1daa3aca7 tempest-VolumesServicesTestJSON-36464369 None] <== create_volume: return (2070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:39:53 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-337620a7-9357-4c60-849f-e6d1daa3aca7 tempest-VolumesServicesTestJSON-36464369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.073s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:39:53 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b1fa83c1-1e4a-473d-acb4-a167313b3dda tempest-VolumesGetTest-1550830579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.777s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:39:53 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b1fa83c1-1e4a-473d-acb4-a167313b3dda tempest-VolumesGetTest-1550830579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:39:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1379619387',display_name='tempest-VolumesGetTest-Volume-351085389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7c3d521-ca3a-493a-87a0-1d909bba4fd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e0c6765fc6c450aa7d0be9b768dc1f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:39:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:39:52Z,use_quota=True,user_id='a0eda2b8c0f54a9cb23869514ffecda4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:39:53 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-b1fa83c1-1e4a-473d-acb4-a167313b3dda tempest-VolumesGetTest-1550830579 None] Creating volume e7c3d521-ca3a-493a-87a0-1d909bba4fd0 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:39:53 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b1fa83c1-1e4a-473d-acb4-a167313b3dda tempest-VolumesGetTest-1550830579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:39:53 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b1fa83c1-1e4a-473d-acb4-a167313b3dda tempest-VolumesGetTest-1550830579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:39:53 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b1fa83c1-1e4a-473d-acb4-a167313b3dda tempest-VolumesGetTest-1550830579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:39:53 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b1fa83c1-1e4a-473d-acb4-a167313b3dda tempest-VolumesGetTest-1550830579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:39:53 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b1fa83c1-1e4a-473d-acb4-a167313b3dda tempest-VolumesGetTest-1550830579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:39:53 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b1fa83c1-1e4a-473d-acb4-a167313b3dda tempest-VolumesGetTest-1550830579 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:39:53 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-b1fa83c1-1e4a-473d-acb4-a167313b3dda tempest-VolumesGetTest-1550830579 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:39:53 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b1fa83c1-1e4a-473d-acb4-a167313b3dda tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e7c3d521-ca3a-493a-87a0-1d909bba4fd0 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:53 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e7c3d521-ca3a-493a-87a0-1d909bba4fd0 1073741824 Jun 23 16:39:53 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:53 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-337620a7-9357-4c60-849f-e6d1daa3aca7 tempest-VolumesServicesTestJSON-36464369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c22537c-db87-4215-bd3b-0d01fb29c758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-153ed5d7-e11b-46ba-a25f-6a6d238c3f0d', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:53 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-337620a7-9357-4c60-849f-e6d1daa3aca7 tempest-VolumesServicesTestJSON-36464369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fce3876-194c-44fc-8133-e9a6c329adbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:53 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-337620a7-9357-4c60-849f-e6d1daa3aca7 tempest-VolumesServicesTestJSON-36464369 None] Volume volume-153ed5d7-e11b-46ba-a25f-6a6d238c3f0d (153ed5d7-e11b-46ba-a25f-6a6d238c3f0d): created successfully Jun 23 16:39:53 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-337620a7-9357-4c60-849f-e6d1daa3aca7 tempest-VolumesServicesTestJSON-36464369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fce3876-194c-44fc-8133-e9a6c329adbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:53 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-337620a7-9357-4c60-849f-e6d1daa3aca7 tempest-VolumesServicesTestJSON-36464369 None] Flow 'volume_create_manager' (b99752b4-ecb2-4a00-86a6-1bdc4458948e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:39:53 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-337620a7-9357-4c60-849f-e6d1daa3aca7 tempest-VolumesServicesTestJSON-36464369 None] Created volume successfully. Jun 23 16:39:53 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-985e4dcb-78d8-4ffd-ac8f-9a0e60def250 tempest-VolumesImageMetadata-365656573 None] Acquiring lock "cinder-cabb9b24-46fc-4e7d-bcd3-af0989aa4029-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:39:53 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-985e4dcb-78d8-4ffd-ac8f-9a0e60def250 tempest-VolumesImageMetadata-365656573 None] Lock "cinder-cabb9b24-46fc-4e7d-bcd3-af0989aa4029-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:39:53 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-985e4dcb-78d8-4ffd-ac8f-9a0e60def250 tempest-VolumesImageMetadata-365656573 None] Acquiring lock "cinder-quobyte-cabb9b24-46fc-4e7d-bcd3-af0989aa4029" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:39:53 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-985e4dcb-78d8-4ffd-ac8f-9a0e60def250 tempest-VolumesImageMetadata-365656573 None] Lock "cinder-quobyte-cabb9b24-46fc-4e7d-bcd3-af0989aa4029" acquired by "delete_volume" :: waited 0.019s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:39:54 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3561a2a2-2c0b-4b53-a426-7582505155e9]: (4, 'raw') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:39:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-985e4dcb-78d8-4ffd-ac8f-9a0e60def250 tempest-VolumesImageMetadata-365656573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cabb9b24-46fc-4e7d-bcd3-af0989aa4029 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:54 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-dc06eca2-9278-4986-b552-d83b484887fb tempest-VolumesServicesTestJSON-36464369 None] Acquiring lock "cinder-153ed5d7-e11b-46ba-a25f-6a6d238c3f0d-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:39:54 devstack sudo[106573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cabb9b24-46fc-4e7d-bcd3-af0989aa4029 Jun 23 16:39:54 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:54 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-dc06eca2-9278-4986-b552-d83b484887fb tempest-VolumesServicesTestJSON-36464369 None] Lock "cinder-153ed5d7-e11b-46ba-a25f-6a6d238c3f0d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:39:54 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b1fa83c1-1e4a-473d-acb4-a167313b3dda tempest-VolumesGetTest-1550830579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e7c3d521-ca3a-493a-87a0-1d909bba4fd0 1073741824" returned: 0 in 1.186s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:54 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-dc06eca2-9278-4986-b552-d83b484887fb tempest-VolumesServicesTestJSON-36464369 None] Acquiring lock "cinder-quobyte-153ed5d7-e11b-46ba-a25f-6a6d238c3f0d" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:39:54 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-dc06eca2-9278-4986-b552-d83b484887fb tempest-VolumesServicesTestJSON-36464369 None] Lock "cinder-quobyte-153ed5d7-e11b-46ba-a25f-6a6d238c3f0d" acquired by "delete_volume" :: waited 0.025s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:39:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b1fa83c1-1e4a-473d-acb4-a167313b3dda tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e7c3d521-ca3a-493a-87a0-1d909bba4fd0 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:54 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6b6c4a-4b69-4da6-ae82-d26f202539c9]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:39:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-dc06eca2-9278-4986-b552-d83b484887fb tempest-VolumesServicesTestJSON-36464369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-153ed5d7-e11b-46ba-a25f-6a6d238c3f0d {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:54 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e7c3d521-ca3a-493a-87a0-1d909bba4fd0 Jun 23 16:39:54 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:54 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-153ed5d7-e11b-46ba-a25f-6a6d238c3f0d Jun 23 16:39:54 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:55 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-985e4dcb-78d8-4ffd-ac8f-9a0e60def250 tempest-VolumesImageMetadata-365656573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cabb9b24-46fc-4e7d-bcd3-af0989aa4029" returned: 0 in 1.061s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-985e4dcb-78d8-4ffd-ac8f-9a0e60def250 tempest-VolumesImageMetadata-365656573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cabb9b24-46fc-4e7d-bcd3-af0989aa4029 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:55 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b1fa83c1-1e4a-473d-acb4-a167313b3dda tempest-VolumesGetTest-1550830579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e7c3d521-ca3a-493a-87a0-1d909bba4fd0" returned: 0 in 0.798s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:55 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b1fa83c1-1e4a-473d-acb4-a167313b3dda tempest-VolumesGetTest-1550830579 None] <== create_volume: return (2100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:39:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b1fa83c1-1e4a-473d-acb4-a167313b3dda tempest-VolumesGetTest-1550830579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.104s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:39:55 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b1fa83c1-1e4a-473d-acb4-a167313b3dda tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa34520d-a43d-4fac-932c-0ff79d5f16ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7c3d521-ca3a-493a-87a0-1d909bba4fd0', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:55 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:55 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b1fa83c1-1e4a-473d-acb4-a167313b3dda tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (688942ca-06e4-40ef-a048-15bfe2add709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:39:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-dc06eca2-9278-4986-b552-d83b484887fb tempest-VolumesServicesTestJSON-36464369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-153ed5d7-e11b-46ba-a25f-6a6d238c3f0d" returned: 0 in 0.812s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-dc06eca2-9278-4986-b552-d83b484887fb tempest-VolumesServicesTestJSON-36464369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-153ed5d7-e11b-46ba-a25f-6a6d238c3f0d {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:55 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-b1fa83c1-1e4a-473d-acb4-a167313b3dda tempest-VolumesGetTest-1550830579 None] Volume volume-e7c3d521-ca3a-493a-87a0-1d909bba4fd0 (e7c3d521-ca3a-493a-87a0-1d909bba4fd0): created successfully Jun 23 16:39:55 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b1fa83c1-1e4a-473d-acb4-a167313b3dda tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (688942ca-06e4-40ef-a048-15bfe2add709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:39:55 devstack sudo[106586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-153ed5d7-e11b-46ba-a25f-6a6d238c3f0d Jun 23 16:39:55 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:55 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b1fa83c1-1e4a-473d-acb4-a167313b3dda tempest-VolumesGetTest-1550830579 None] Flow 'volume_create_manager' (ad9b2708-cc2a-4957-a179-0a83d8981612) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:39:55 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cabb9b24-46fc-4e7d-bcd3-af0989aa4029 Jun 23 16:39:55 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:55 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-b1fa83c1-1e4a-473d-acb4-a167313b3dda tempest-VolumesGetTest-1550830579 None] Created volume successfully. Jun 23 16:39:55 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-dc06eca2-9278-4986-b552-d83b484887fb tempest-VolumesServicesTestJSON-36464369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-153ed5d7-e11b-46ba-a25f-6a6d238c3f0d" returned: 0 in 0.640s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:55 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-dc06eca2-9278-4986-b552-d83b484887fb tempest-VolumesServicesTestJSON-36464369 None] Lock "cinder-quobyte-153ed5d7-e11b-46ba-a25f-6a6d238c3f0d" released by "delete_volume" :: held 1.523s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:39:55 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-985e4dcb-78d8-4ffd-ac8f-9a0e60def250 tempest-VolumesImageMetadata-365656573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cabb9b24-46fc-4e7d-bcd3-af0989aa4029" returned: 1 in 0.777s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-985e4dcb-78d8-4ffd-ac8f-9a0e60def250 tempest-VolumesImageMetadata-365656573 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cabb9b24-46fc-4e7d-bcd3-af0989aa4029' failed. Not Retrying. {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:39:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-985e4dcb-78d8-4ffd-ac8f-9a0e60def250 tempest-VolumesImageMetadata-365656573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cabb9b24-46fc-4e7d-bcd3-af0989aa4029 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:55 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cabb9b24-46fc-4e7d-bcd3-af0989aa4029 Jun 23 16:39:55 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:55 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-dc06eca2-9278-4986-b552-d83b484887fb tempest-VolumesServicesTestJSON-36464369 None] Created reservations ['c58a8f89-25d6-44a4-a521-510c6183ac5c', '485e3620-1d6b-46a5-8d22-3a908791a3d4', '9cb0a8f3-c2b5-4a07-939b-69706eafdfae', 'a6158ca1-e8f3-4f88-908f-5702fb55019d'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:39:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-dc06eca2-9278-4986-b552-d83b484887fb tempest-VolumesServicesTestJSON-36464369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:39:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-dc06eca2-9278-4986-b552-d83b484887fb tempest-VolumesServicesTestJSON-36464369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:39:56 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-dc06eca2-9278-4986-b552-d83b484887fb tempest-VolumesServicesTestJSON-36464369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:39:56 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-dc06eca2-9278-4986-b552-d83b484887fb tempest-VolumesServicesTestJSON-36464369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:39:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-dc06eca2-9278-4986-b552-d83b484887fb tempest-VolumesServicesTestJSON-36464369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:39:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-dc06eca2-9278-4986-b552-d83b484887fb tempest-VolumesServicesTestJSON-36464369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:56 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:39:56 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:56 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-63dab203-3f03-45b1-87b2-329f4d5da246 tempest-VolumesGetTest-1550830579 None] Acquiring lock "cinder-e7c3d521-ca3a-493a-87a0-1d909bba4fd0-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:39:56 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-63dab203-3f03-45b1-87b2-329f4d5da246 tempest-VolumesGetTest-1550830579 None] Lock "cinder-e7c3d521-ca3a-493a-87a0-1d909bba4fd0-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:39:56 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-63dab203-3f03-45b1-87b2-329f4d5da246 tempest-VolumesGetTest-1550830579 None] Acquiring lock "cinder-quobyte-e7c3d521-ca3a-493a-87a0-1d909bba4fd0" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:39:56 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-63dab203-3f03-45b1-87b2-329f4d5da246 tempest-VolumesGetTest-1550830579 None] Lock "cinder-quobyte-e7c3d521-ca3a-493a-87a0-1d909bba4fd0" acquired by "delete_volume" :: waited 0.024s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:39:56 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a54227-0b8b-4297-b70f-90ffccccbac1]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:39:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-63dab203-3f03-45b1-87b2-329f4d5da246 tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e7c3d521-ca3a-493a-87a0-1d909bba4fd0 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:56 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-985e4dcb-78d8-4ffd-ac8f-9a0e60def250 tempest-VolumesImageMetadata-365656573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-cabb9b24-46fc-4e7d-bcd3-af0989aa4029" returned: 0 in 0.744s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:56 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-985e4dcb-78d8-4ffd-ac8f-9a0e60def250 tempest-VolumesImageMetadata-365656573 None] Lock "cinder-quobyte-cabb9b24-46fc-4e7d-bcd3-af0989aa4029" released by "delete_volume" :: held 2.697s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:39:56 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e7c3d521-ca3a-493a-87a0-1d909bba4fd0 Jun 23 16:39:56 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:56 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-985e4dcb-78d8-4ffd-ac8f-9a0e60def250 tempest-VolumesImageMetadata-365656573 None] Created reservations ['3133c7f8-1f85-47f5-8654-fa1166bb1b0c', 'c69c1a6d-caf7-4f09-9ecd-93c68b77e64a', '984089d8-5487-4bf5-a480-8752d0a20118', '9ad57154-d5b1-494b-9781-58986a0f502b'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:39:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-985e4dcb-78d8-4ffd-ac8f-9a0e60def250 tempest-VolumesImageMetadata-365656573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:39:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-985e4dcb-78d8-4ffd-ac8f-9a0e60def250 tempest-VolumesImageMetadata-365656573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:39:56 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-985e4dcb-78d8-4ffd-ac8f-9a0e60def250 tempest-VolumesImageMetadata-365656573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:39:56 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-985e4dcb-78d8-4ffd-ac8f-9a0e60def250 tempest-VolumesImageMetadata-365656573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:39:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-985e4dcb-78d8-4ffd-ac8f-9a0e60def250 tempest-VolumesImageMetadata-365656573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:39:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-985e4dcb-78d8-4ffd-ac8f-9a0e60def250 tempest-VolumesImageMetadata-365656573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:56 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-dc06eca2-9278-4986-b552-d83b484887fb tempest-VolumesServicesTestJSON-36464369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.924s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:56 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-dc06eca2-9278-4986-b552-d83b484887fb tempest-VolumesServicesTestJSON-36464369 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:39:56 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-dc06eca2-9278-4986-b552-d83b484887fb tempest-VolumesServicesTestJSON-36464369 None] Deleted volume successfully. Jun 23 16:39:56 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:39:56 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:57 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-dc06eca2-9278-4986-b552-d83b484887fb tempest-VolumesServicesTestJSON-36464369 None] Lock "cinder-153ed5d7-e11b-46ba-a25f-6a6d238c3f0d-delete_volume" released by "delete_volume" :: held 2.745s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:39:57 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-63dab203-3f03-45b1-87b2-329f4d5da246 tempest-VolumesGetTest-1550830579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e7c3d521-ca3a-493a-87a0-1d909bba4fd0" returned: 0 in 0.988s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-63dab203-3f03-45b1-87b2-329f4d5da246 tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e7c3d521-ca3a-493a-87a0-1d909bba4fd0 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:57 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e7c3d521-ca3a-493a-87a0-1d909bba4fd0 Jun 23 16:39:57 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:57 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-985e4dcb-78d8-4ffd-ac8f-9a0e60def250 tempest-VolumesImageMetadata-365656573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.833s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:57 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-985e4dcb-78d8-4ffd-ac8f-9a0e60def250 tempest-VolumesImageMetadata-365656573 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:39:57 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-985e4dcb-78d8-4ffd-ac8f-9a0e60def250 tempest-VolumesImageMetadata-365656573 None] Deleted volume successfully. Jun 23 16:39:57 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-985e4dcb-78d8-4ffd-ac8f-9a0e60def250 tempest-VolumesImageMetadata-365656573 None] Lock "cinder-cabb9b24-46fc-4e7d-bcd3-af0989aa4029-delete_volume" released by "delete_volume" :: held 3.952s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:39:58 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-63dab203-3f03-45b1-87b2-329f4d5da246 tempest-VolumesGetTest-1550830579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e7c3d521-ca3a-493a-87a0-1d909bba4fd0" returned: 0 in 0.773s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:58 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-63dab203-3f03-45b1-87b2-329f4d5da246 tempest-VolumesGetTest-1550830579 None] Lock "cinder-quobyte-e7c3d521-ca3a-493a-87a0-1d909bba4fd0" released by "delete_volume" :: held 1.820s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:39:58 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-63dab203-3f03-45b1-87b2-329f4d5da246 tempest-VolumesGetTest-1550830579 None] Created reservations ['f7b2890b-2879-4105-9410-755437b544a5', 'd67404b7-a163-4865-9ec9-a1bd5cd158e7', 'f5dea9ad-db9d-4ac2-9837-c2140ac0711e', '8b03e01d-d865-437e-9029-d414e0904ab0'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:39:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-63dab203-3f03-45b1-87b2-329f4d5da246 tempest-VolumesGetTest-1550830579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:39:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-63dab203-3f03-45b1-87b2-329f4d5da246 tempest-VolumesGetTest-1550830579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:39:58 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-63dab203-3f03-45b1-87b2-329f4d5da246 tempest-VolumesGetTest-1550830579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:39:58 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-63dab203-3f03-45b1-87b2-329f4d5da246 tempest-VolumesGetTest-1550830579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:39:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-63dab203-3f03-45b1-87b2-329f4d5da246 tempest-VolumesGetTest-1550830579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:39:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-63dab203-3f03-45b1-87b2-329f4d5da246 tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:58 devstack sudo[106611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:39:58 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:58 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-80d7bc92-1bd3-4d9c-a028-8d1bfedae25b tempest-VolumesGetTest-1550830579 None] Acquiring lock "cinder-6d71c2ff-047e-4252-a1fa-0e8400310399-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:39:58 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-80d7bc92-1bd3-4d9c-a028-8d1bfedae25b tempest-VolumesGetTest-1550830579 None] Lock "cinder-6d71c2ff-047e-4252-a1fa-0e8400310399-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:39:58 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-80d7bc92-1bd3-4d9c-a028-8d1bfedae25b tempest-VolumesGetTest-1550830579 None] Acquiring lock "cinder-quobyte-6d71c2ff-047e-4252-a1fa-0e8400310399" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:39:59 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-80d7bc92-1bd3-4d9c-a028-8d1bfedae25b tempest-VolumesGetTest-1550830579 None] Lock "cinder-quobyte-6d71c2ff-047e-4252-a1fa-0e8400310399" acquired by "delete_volume" :: waited 0.027s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:39:59 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[81496277-df95-450e-a50f-6591abd1c250]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:39:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-80d7bc92-1bd3-4d9c-a028-8d1bfedae25b tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6d71c2ff-047e-4252-a1fa-0e8400310399 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:39:59 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6d71c2ff-047e-4252-a1fa-0e8400310399 Jun 23 16:39:59 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:39:59 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root Jun 23 16:39:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-63dab203-3f03-45b1-87b2-329f4d5da246 tempest-VolumesGetTest-1550830579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.908s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:39:59 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-63dab203-3f03-45b1-87b2-329f4d5da246 tempest-VolumesGetTest-1550830579 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:39:59 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-63dab203-3f03-45b1-87b2-329f4d5da246 tempest-VolumesGetTest-1550830579 None] Deleted volume successfully. Jun 23 16:39:59 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-63dab203-3f03-45b1-87b2-329f4d5da246 tempest-VolumesGetTest-1550830579 None] Lock "cinder-e7c3d521-ca3a-493a-87a0-1d909bba4fd0-delete_volume" released by "delete_volume" :: held 3.009s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:40:00 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-80d7bc92-1bd3-4d9c-a028-8d1bfedae25b tempest-VolumesGetTest-1550830579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6d71c2ff-047e-4252-a1fa-0e8400310399" returned: 0 in 1.018s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-80d7bc92-1bd3-4d9c-a028-8d1bfedae25b tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6d71c2ff-047e-4252-a1fa-0e8400310399 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:00 devstack sudo[106621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6d71c2ff-047e-4252-a1fa-0e8400310399 Jun 23 16:40:00 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:00 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-80d7bc92-1bd3-4d9c-a028-8d1bfedae25b tempest-VolumesGetTest-1550830579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6d71c2ff-047e-4252-a1fa-0e8400310399" returned: 0 in 0.778s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:00 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-80d7bc92-1bd3-4d9c-a028-8d1bfedae25b tempest-VolumesGetTest-1550830579 None] Lock "cinder-quobyte-6d71c2ff-047e-4252-a1fa-0e8400310399" released by "delete_volume" :: held 1.880s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:40:00 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-80d7bc92-1bd3-4d9c-a028-8d1bfedae25b tempest-VolumesGetTest-1550830579 None] Created reservations ['976c87bd-b2b9-49bc-b9b3-c6d4162a3aa2', 'e0a31b67-d11c-4520-94c8-7f7de28457e1', '50a5ecc2-848a-4c19-a973-bf2455c50bd3', '342c7775-b1ec-46b1-9569-78e1422aaced'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:40:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-80d7bc92-1bd3-4d9c-a028-8d1bfedae25b tempest-VolumesGetTest-1550830579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:40:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-80d7bc92-1bd3-4d9c-a028-8d1bfedae25b tempest-VolumesGetTest-1550830579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:40:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-80d7bc92-1bd3-4d9c-a028-8d1bfedae25b tempest-VolumesGetTest-1550830579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:40:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-80d7bc92-1bd3-4d9c-a028-8d1bfedae25b tempest-VolumesGetTest-1550830579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:40:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-80d7bc92-1bd3-4d9c-a028-8d1bfedae25b tempest-VolumesGetTest-1550830579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:40:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-80d7bc92-1bd3-4d9c-a028-8d1bfedae25b tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:01 devstack sudo[106624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:40:01 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:01 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:40:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:40:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:40:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:40:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:40:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:40:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:01 devstack sudo[106626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:40:01 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:01 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-faa1c5f9-f469-462c-a201-25020d5fe09d tempest-VolumesCloneTest-1443706569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:40:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-faa1c5f9-f469-462c-a201-25020d5fe09d tempest-VolumesCloneTest-1443706569 None] Flow 'volume_create_manager' (effdb466-9d84-4b5f-9d54-df62e17b323c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:40:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-faa1c5f9-f469-462c-a201-25020d5fe09d tempest-VolumesCloneTest-1443706569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ca5dd42-5d46-4326-8f1d-028c423634db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:40:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-faa1c5f9-f469-462c-a201-25020d5fe09d tempest-VolumesCloneTest-1443706569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ca5dd42-5d46-4326-8f1d-028c423634db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:40:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1670520484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff3369635ae64594b5099e0205b95006',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:40:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:40:01Z,use_quota=True,user_id='6a316b12374442d9a3a82209f0c6515e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:40:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-faa1c5f9-f469-462c-a201-25020d5fe09d tempest-VolumesCloneTest-1443706569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (050c0610-f703-47af-9701-c9b873046944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:40:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-faa1c5f9-f469-462c-a201-25020d5fe09d tempest-VolumesCloneTest-1443706569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (050c0610-f703-47af-9701-c9b873046944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:40:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-faa1c5f9-f469-462c-a201-25020d5fe09d tempest-VolumesCloneTest-1443706569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f336ff8-13ae-476a-9a2e-ecb76bc19ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:40:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-faa1c5f9-f469-462c-a201-25020d5fe09d tempest-VolumesCloneTest-1443706569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f336ff8-13ae-476a-9a2e-ecb76bc19ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae', 'volume_name': 'volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:40:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-faa1c5f9-f469-462c-a201-25020d5fe09d tempest-VolumesCloneTest-1443706569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fef25e83-49a4-45d1-8d80-54dea4c39299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:40:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-faa1c5f9-f469-462c-a201-25020d5fe09d tempest-VolumesCloneTest-1443706569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fef25e83-49a4-45d1-8d80-54dea4c39299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:40:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-faa1c5f9-f469-462c-a201-25020d5fe09d tempest-VolumesCloneTest-1443706569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c5469cb-4a9b-4219-96d1-c6aa6ad469b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:40:01 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-faa1c5f9-f469-462c-a201-25020d5fe09d tempest-VolumesCloneTest-1443706569 None] Volume b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae', 'volume_size': 1} Jun 23 16:40:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-faa1c5f9-f469-462c-a201-25020d5fe09d tempest-VolumesCloneTest-1443706569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:40:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-faa1c5f9-f469-462c-a201-25020d5fe09d tempest-VolumesCloneTest-1443706569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:40:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-faa1c5f9-f469-462c-a201-25020d5fe09d tempest-VolumesCloneTest-1443706569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:40:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1670520484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff3369635ae64594b5099e0205b95006',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:40:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:40:01Z,use_quota=True,user_id='6a316b12374442d9a3a82209f0c6515e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:40:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-faa1c5f9-f469-462c-a201-25020d5fe09d tempest-VolumesCloneTest-1443706569 None] Creating volume b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:40:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-faa1c5f9-f469-462c-a201-25020d5fe09d tempest-VolumesCloneTest-1443706569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:40:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-faa1c5f9-f469-462c-a201-25020d5fe09d tempest-VolumesCloneTest-1443706569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:40:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-faa1c5f9-f469-462c-a201-25020d5fe09d tempest-VolumesCloneTest-1443706569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:40:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-faa1c5f9-f469-462c-a201-25020d5fe09d tempest-VolumesCloneTest-1443706569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:40:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-faa1c5f9-f469-462c-a201-25020d5fe09d tempest-VolumesCloneTest-1443706569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:40:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-faa1c5f9-f469-462c-a201-25020d5fe09d tempest-VolumesCloneTest-1443706569 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:40:01 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-faa1c5f9-f469-462c-a201-25020d5fe09d tempest-VolumesCloneTest-1443706569 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:40:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-faa1c5f9-f469-462c-a201-25020d5fe09d tempest-VolumesCloneTest-1443706569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:01 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae 1073741824 Jun 23 16:40:01 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:02 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-433ef1cb-509a-4014-9334-93f2e52c5719 tempest-VolumesGetTest-1550830579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:40:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-433ef1cb-509a-4014-9334-93f2e52c5719 tempest-VolumesGetTest-1550830579 None] Flow 'volume_create_manager' (7b290754-c83b-4cc4-a4a3-0327a47fe549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:40:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-433ef1cb-509a-4014-9334-93f2e52c5719 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (401c137e-5636-4059-965b-40a35bd2facb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:40:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-433ef1cb-509a-4014-9334-93f2e52c5719 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (401c137e-5636-4059-965b-40a35bd2facb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:40:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1485849404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a0ceb4c-c364-40aa-b2f9-dd870f611cac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e0c6765fc6c450aa7d0be9b768dc1f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:40:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:40:02Z,use_quota=True,user_id='a0eda2b8c0f54a9cb23869514ffecda4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:40:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-433ef1cb-509a-4014-9334-93f2e52c5719 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08e766f7-24d1-47da-ad02-d39cbd0b4ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:40:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-433ef1cb-509a-4014-9334-93f2e52c5719 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08e766f7-24d1-47da-ad02-d39cbd0b4ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:40:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-433ef1cb-509a-4014-9334-93f2e52c5719 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8fdbd55-3136-463d-b639-b97464b7dd72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:40:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-433ef1cb-509a-4014-9334-93f2e52c5719 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8fdbd55-3136-463d-b639-b97464b7dd72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a0ceb4c-c364-40aa-b2f9-dd870f611cac', 'volume_name': 'volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:40:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-433ef1cb-509a-4014-9334-93f2e52c5719 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c516b61a-4fa5-4f52-a92b-521df4074707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:40:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-433ef1cb-509a-4014-9334-93f2e52c5719 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c516b61a-4fa5-4f52-a92b-521df4074707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:40:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-433ef1cb-509a-4014-9334-93f2e52c5719 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e3acb3a-b142-4fb4-aebd-5d7d247c5669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:40:02 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-433ef1cb-509a-4014-9334-93f2e52c5719 tempest-VolumesGetTest-1550830579 None] Volume 9a0ceb4c-c364-40aa-b2f9-dd870f611cac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac', 'volume_size': 1} Jun 23 16:40:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-433ef1cb-509a-4014-9334-93f2e52c5719 tempest-VolumesGetTest-1550830579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:40:02 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-80d7bc92-1bd3-4d9c-a028-8d1bfedae25b tempest-VolumesGetTest-1550830579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.279s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:02 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-80d7bc92-1bd3-4d9c-a028-8d1bfedae25b tempest-VolumesGetTest-1550830579 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:40:02 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-80d7bc92-1bd3-4d9c-a028-8d1bfedae25b tempest-VolumesGetTest-1550830579 None] Deleted volume successfully. Jun 23 16:40:02 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-80d7bc92-1bd3-4d9c-a028-8d1bfedae25b tempest-VolumesGetTest-1550830579 None] Lock "cinder-6d71c2ff-047e-4252-a1fa-0e8400310399-delete_volume" released by "delete_volume" :: held 3.510s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:40:02 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.264s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:02 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:40:02 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager._thread_info {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:40:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread count: 28 {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 16:40:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread info: [<_MainThread(MainThread, started 126303828988032)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 16:40:02 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-faa1c5f9-f469-462c-a201-25020d5fe09d tempest-VolumesCloneTest-1443706569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae 1073741824" returned: 0 in 1.260s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-faa1c5f9-f469-462c-a201-25020d5fe09d tempest-VolumesCloneTest-1443706569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:03 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae Jun 23 16:40:03 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:03 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-faa1c5f9-f469-462c-a201-25020d5fe09d tempest-VolumesCloneTest-1443706569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae" returned: 0 in 0.704s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:03 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-faa1c5f9-f469-462c-a201-25020d5fe09d tempest-VolumesCloneTest-1443706569 None] <== create_volume: return (2031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:40:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-faa1c5f9-f469-462c-a201-25020d5fe09d tempest-VolumesCloneTest-1443706569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.037s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:40:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-433ef1cb-509a-4014-9334-93f2e52c5719 tempest-VolumesGetTest-1550830579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.438s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:40:03 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-433ef1cb-509a-4014-9334-93f2e52c5719 tempest-VolumesGetTest-1550830579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:40:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1485849404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a0ceb4c-c364-40aa-b2f9-dd870f611cac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e0c6765fc6c450aa7d0be9b768dc1f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:40:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:40:02Z,use_quota=True,user_id='a0eda2b8c0f54a9cb23869514ffecda4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:40:03 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-433ef1cb-509a-4014-9334-93f2e52c5719 tempest-VolumesGetTest-1550830579 None] Creating volume 9a0ceb4c-c364-40aa-b2f9-dd870f611cac {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:40:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-433ef1cb-509a-4014-9334-93f2e52c5719 tempest-VolumesGetTest-1550830579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:40:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-433ef1cb-509a-4014-9334-93f2e52c5719 tempest-VolumesGetTest-1550830579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:40:03 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-433ef1cb-509a-4014-9334-93f2e52c5719 tempest-VolumesGetTest-1550830579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:40:03 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-433ef1cb-509a-4014-9334-93f2e52c5719 tempest-VolumesGetTest-1550830579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:40:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-433ef1cb-509a-4014-9334-93f2e52c5719 tempest-VolumesGetTest-1550830579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:40:03 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-433ef1cb-509a-4014-9334-93f2e52c5719 tempest-VolumesGetTest-1550830579 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:40:03 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-433ef1cb-509a-4014-9334-93f2e52c5719 tempest-VolumesGetTest-1550830579 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:40:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-433ef1cb-509a-4014-9334-93f2e52c5719 tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-faa1c5f9-f469-462c-a201-25020d5fe09d tempest-VolumesCloneTest-1443706569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c5469cb-4a9b-4219-96d1-c6aa6ad469b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:40:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-faa1c5f9-f469-462c-a201-25020d5fe09d tempest-VolumesCloneTest-1443706569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9726b4e5-3d56-49a7-ac5a-a3511f941b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:40:03 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac 1073741824 Jun 23 16:40:03 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:03 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-faa1c5f9-f469-462c-a201-25020d5fe09d tempest-VolumesCloneTest-1443706569 None] Volume volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae (b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae): created successfully Jun 23 16:40:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-faa1c5f9-f469-462c-a201-25020d5fe09d tempest-VolumesCloneTest-1443706569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9726b4e5-3d56-49a7-ac5a-a3511f941b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:40:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-faa1c5f9-f469-462c-a201-25020d5fe09d tempest-VolumesCloneTest-1443706569 None] Flow 'volume_create_manager' (effdb466-9d84-4b5f-9d54-df62e17b323c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:40:03 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-faa1c5f9-f469-462c-a201-25020d5fe09d tempest-VolumesCloneTest-1443706569 None] Created volume successfully. Jun 23 16:40:04 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcffda89-7ea8-471c-9827-493ee9c55ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:40:04 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-dcffda89-7ea8-471c-9827-493ee9c55ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Flow 'volume_create_manager' (822b25ea-ca9a-4c34-abf1-77653568e18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:40:04 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-dcffda89-7ea8-471c-9827-493ee9c55ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (885b0f01-c1af-4097-82cc-4c2a61e92ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:40:04 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-dcffda89-7ea8-471c-9827-493ee9c55ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (885b0f01-c1af-4097-82cc-4c2a61e92ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:40:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1765680697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25fd90a3-6f4f-4292-8319-fc9d4925af24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee713714c3f04f24ac3c50025a53965b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:40:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:40:04Z,use_quota=True,user_id='906e960de80a4a31ac50f80c180e3166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:40:04 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-dcffda89-7ea8-471c-9827-493ee9c55ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca92dd30-5914-475a-9ed8-d86a0b599780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:40:04 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-dcffda89-7ea8-471c-9827-493ee9c55ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca92dd30-5914-475a-9ed8-d86a0b599780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:40:04 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-dcffda89-7ea8-471c-9827-493ee9c55ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f12ce38-c19b-4a69-988b-5d89c6cc3a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:40:04 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-dcffda89-7ea8-471c-9827-493ee9c55ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f12ce38-c19b-4a69-988b-5d89c6cc3a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25fd90a3-6f4f-4292-8319-fc9d4925af24', 'volume_name': 'volume-25fd90a3-6f4f-4292-8319-fc9d4925af24', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:40:04 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-dcffda89-7ea8-471c-9827-493ee9c55ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14a664ab-b474-45d6-bc75-4d7e0c4ef960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:40:04 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-dcffda89-7ea8-471c-9827-493ee9c55ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14a664ab-b474-45d6-bc75-4d7e0c4ef960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:40:04 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-dcffda89-7ea8-471c-9827-493ee9c55ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02649a54-9dac-4397-a05c-b0ceabd022ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:40:04 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-dcffda89-7ea8-471c-9827-493ee9c55ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Volume 25fd90a3-6f4f-4292-8319-fc9d4925af24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25fd90a3-6f4f-4292-8319-fc9d4925af24', 'volume_size': 1} Jun 23 16:40:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-dcffda89-7ea8-471c-9827-493ee9c55ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:40:04 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-433ef1cb-509a-4014-9334-93f2e52c5719 tempest-VolumesGetTest-1550830579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac 1073741824" returned: 0 in 1.023s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-433ef1cb-509a-4014-9334-93f2e52c5719 tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:04 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac Jun 23 16:40:04 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:04 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:40:05 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Flow 'volume_create_manager' (b9ae99cf-8fe1-48f7-a1fa-6d6b50a44628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:40:05 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3b0bef7-eafd-43b9-9779-212e3fbdf857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:40:05 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3b0bef7-eafd-43b9-9779-212e3fbdf857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:40:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-24291231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eff05b29-d70f-4553-bbb0-756183c372ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff3369635ae64594b5099e0205b95006',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:40:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae,status='creating',terminated_at=None,updated_at=2026-06-23T14:40:05Z,use_quota=True,user_id='6a316b12374442d9a3a82209f0c6515e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:40:05 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d20d96c-a892-42ed-a3f3-fa28f15f2502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:40:05 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d20d96c-a892-42ed-a3f3-fa28f15f2502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:40:05 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6206cc9-f815-4796-b01d-d334f071b18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:40:05 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6206cc9-f815-4796-b01d-d334f071b18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'eff05b29-d70f-4553-bbb0-756183c372ec', 'volume_name': 'volume-eff05b29-d70f-4553-bbb0-756183c372ec', 'volume_size': 2, 'source_volid': 'b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae', 'source_volstatus': 'available'}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:40:05 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45f4165b-86fc-4a4b-9d82-c9eca6dcffe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:40:05 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45f4165b-86fc-4a4b-9d82-c9eca6dcffe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:40:05 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef180634-5e9b-4702-9a82-e496e70bde57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:40:05 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Volume eff05b29-d70f-4553-bbb0-756183c372ec: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-eff05b29-d70f-4553-bbb0-756183c372ec', 'volume_size': 2, 'source_volid': 'b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae', 'source_volstatus': 'available'} Jun 23 16:40:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:40:05 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-433ef1cb-509a-4014-9334-93f2e52c5719 tempest-VolumesGetTest-1550830579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac" returned: 0 in 0.695s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:05 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-433ef1cb-509a-4014-9334-93f2e52c5719 tempest-VolumesGetTest-1550830579 None] <== create_volume: return (1763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:40:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-433ef1cb-509a-4014-9334-93f2e52c5719 tempest-VolumesGetTest-1550830579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.766s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:40:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-dcffda89-7ea8-471c-9827-493ee9c55ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.197s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:40:05 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-dcffda89-7ea8-471c-9827-493ee9c55ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:40:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1765680697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25fd90a3-6f4f-4292-8319-fc9d4925af24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee713714c3f04f24ac3c50025a53965b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:40:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:40:04Z,use_quota=True,user_id='906e960de80a4a31ac50f80c180e3166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:40:05 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-dcffda89-7ea8-471c-9827-493ee9c55ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Creating volume 25fd90a3-6f4f-4292-8319-fc9d4925af24 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:40:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-dcffda89-7ea8-471c-9827-493ee9c55ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:40:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-dcffda89-7ea8-471c-9827-493ee9c55ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:40:05 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-dcffda89-7ea8-471c-9827-493ee9c55ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:40:05 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-dcffda89-7ea8-471c-9827-493ee9c55ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:40:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-dcffda89-7ea8-471c-9827-493ee9c55ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:40:05 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-dcffda89-7ea8-471c-9827-493ee9c55ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:40:05 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-dcffda89-7ea8-471c-9827-493ee9c55ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:40:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-dcffda89-7ea8-471c-9827-493ee9c55ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-25fd90a3-6f4f-4292-8319-fc9d4925af24 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:05 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-433ef1cb-509a-4014-9334-93f2e52c5719 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e3acb3a-b142-4fb4-aebd-5d7d247c5669) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:40:05 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-25fd90a3-6f4f-4292-8319-fc9d4925af24 1073741824 Jun 23 16:40:05 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:05 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-433ef1cb-509a-4014-9334-93f2e52c5719 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ea0461-9601-484b-8447-7ce9b9562851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:40:05 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-433ef1cb-509a-4014-9334-93f2e52c5719 tempest-VolumesGetTest-1550830579 None] Volume volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac (9a0ceb4c-c364-40aa-b2f9-dd870f611cac): created successfully Jun 23 16:40:05 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-433ef1cb-509a-4014-9334-93f2e52c5719 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ea0461-9601-484b-8447-7ce9b9562851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:40:05 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-433ef1cb-509a-4014-9334-93f2e52c5719 tempest-VolumesGetTest-1550830579 None] Flow 'volume_create_manager' (7b290754-c83b-4cc4-a4a3-0327a47fe549) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:40:05 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-433ef1cb-509a-4014-9334-93f2e52c5719 tempest-VolumesGetTest-1550830579 None] Created volume successfully. Jun 23 16:40:06 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-dcffda89-7ea8-471c-9827-493ee9c55ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-25fd90a3-6f4f-4292-8319-fc9d4925af24 1073741824" returned: 0 in 0.915s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-dcffda89-7ea8-471c-9827-493ee9c55ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-25fd90a3-6f4f-4292-8319-fc9d4925af24 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:06 devstack sudo[106664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-25fd90a3-6f4f-4292-8319-fc9d4925af24 Jun 23 16:40:06 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:06 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:40:06 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Flow 'volume_create_manager' (fa283b78-cf6f-4efe-85fd-4d108d5f919a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:40:06 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aebfe61-f175-451b-946b-9398cd053985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:40:06 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aebfe61-f175-451b-946b-9398cd053985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-790047446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e97b470-4b13-4432-9ba9-1f72191ebeb1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7e0c6765fc6c450aa7d0be9b768dc1f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=9a0ceb4c-c364-40aa-b2f9-dd870f611cac,status='creating',terminated_at=None,updated_at=2026-06-23T14:40:07Z,use_quota=True,user_id='a0eda2b8c0f54a9cb23869514ffecda4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:40:06 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7808d875-4442-44b0-896f-68dca5af0117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:40:06 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7808d875-4442-44b0-896f-68dca5af0117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:40:06 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57f90c9c-af1d-4102-8a3d-f4382c94355e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:40:06 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57f90c9c-af1d-4102-8a3d-f4382c94355e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '1e97b470-4b13-4432-9ba9-1f72191ebeb1', 'volume_name': 'volume-1e97b470-4b13-4432-9ba9-1f72191ebeb1', 'volume_size': 1, 'source_volid': '9a0ceb4c-c364-40aa-b2f9-dd870f611cac', 'source_volstatus': 'available'}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:40:06 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2832c08b-616c-4f16-a387-08e1e6b45d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:40:06 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2832c08b-616c-4f16-a387-08e1e6b45d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:40:06 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcac952b-9f46-487a-8512-91990cc3aed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:40:06 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Volume 1e97b470-4b13-4432-9ba9-1f72191ebeb1: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-1e97b470-4b13-4432-9ba9-1f72191ebeb1', 'volume_size': 1, 'source_volid': '9a0ceb4c-c364-40aa-b2f9-dd870f611cac', 'source_volstatus': 'available'} Jun 23 16:40:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:40:07 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-dcffda89-7ea8-471c-9827-493ee9c55ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-25fd90a3-6f4f-4292-8319-fc9d4925af24" returned: 0 in 0.703s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:07 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-dcffda89-7ea8-471c-9827-493ee9c55ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] <== create_volume: return (1662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:40:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-dcffda89-7ea8-471c-9827-493ee9c55ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.665s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:40:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.993s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:40:07 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Cloning volume b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae to volume eff05b29-d70f-4553-bbb0-756183c372ec Jun 23 16:40:07 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-dcffda89-7ea8-471c-9827-493ee9c55ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02649a54-9dac-4397-a05c-b0ceabd022ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25fd90a3-6f4f-4292-8319-fc9d4925af24', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:40:07 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-dcffda89-7ea8-471c-9827-493ee9c55ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0054dd36-b368-48b4-b847-b90655ec71c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:40:07 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-dcffda89-7ea8-471c-9827-493ee9c55ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Volume volume-25fd90a3-6f4f-4292-8319-fc9d4925af24 (25fd90a3-6f4f-4292-8319-fc9d4925af24): created successfully Jun 23 16:40:07 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-dcffda89-7ea8-471c-9827-493ee9c55ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0054dd36-b368-48b4-b847-b90655ec71c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:40:07 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-dcffda89-7ea8-471c-9827-493ee9c55ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Flow 'volume_create_manager' (822b25ea-ca9a-4c34-abf1-77653568e18a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:40:07 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Creating offline snapshot ee063f91-8fc2-4d6a-bc61-b646adf19694 of volume b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae {{(pid=93788) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:40:07 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-dcffda89-7ea8-471c-9827-493ee9c55ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Created volume successfully. Jun 23 16:40:07 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99891bf-7026-4c7c-847a-f7b5f9b209a8]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:40:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:07 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae Jun 23 16:40:07 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-568eb2e5-f720-4300-ae24-91f7c222caf0 req-d1a0884b-3a13-4055-a40a-8e0c1e4dbf0f tempest-TestInstancesWithCinderVolumes-865228744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:40:08 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae" returned: 0 in 0.780s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae.ee063f91-8fc2-4d6a-bc61-b646adf19694 1G {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:08 devstack sudo[106680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae.ee063f91-8fc2-4d6a-bc61-b646adf19694 1G Jun 23 16:40:08 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8d752e24-9c51-4839-9453-2387c582a496 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:40:08 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae.ee063f91-8fc2-4d6a-bc61-b646adf19694 1G" returned: 0 in 0.838s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae.ee063f91-8fc2-4d6a-bc61-b646adf19694 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:08 devstack sudo[106687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae.ee063f91-8fc2-4d6a-bc61-b646adf19694 Jun 23 16:40:08 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:09 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae.ee063f91-8fc2-4d6a-bc61-b646adf19694" returned: 0 in 0.696s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:09 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae.ee063f91-8fc2-4d6a-bc61-b646adf19694 is being set with open permissions: ugo+rw Jun 23 16:40:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae.ee063f91-8fc2-4d6a-bc61-b646adf19694 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:09 devstack sudo[106692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae.ee063f91-8fc2-4d6a-bc61-b646adf19694 Jun 23 16:40:09 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:10 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae.ee063f91-8fc2-4d6a-bc61-b646adf19694" returned: 0 in 0.643s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:10 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae.info Jun 23 16:40:10 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:10 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae.info" returned: 0 in 0.637s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:10 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae.info is being set with open permissions: ugo+rw Jun 23 16:40:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:10 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae.info Jun 23 16:40:10 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:11 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae.info" returned: 0 in 0.634s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:11 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Acquiring lock "cinder-quobyte-eff05b29-d70f-4553-bbb0-756183c372ec" by "_copy_volume_from_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:40:11 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Lock "cinder-quobyte-eff05b29-d70f-4553-bbb0-756183c372ec" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:40:11 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] snapshot: ee063f91-8fc2-4d6a-bc61-b646adf19694, volume: eff05b29-d70f-4553-bbb0-756183c372ec, {{(pid=93788) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 16:40:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:40:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:40:11 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:40:11 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:40:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:40:11 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6992db5d-b4f6-45eb-ad06-f3da17e4db39]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:40:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae.ee063f91-8fc2-4d6a-bc61-b646adf19694 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:11 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae.ee063f91-8fc2-4d6a-bc61-b646adf19694 Jun 23 16:40:11 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:12 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae.ee063f91-8fc2-4d6a-bc61-b646adf19694" returned: 0 in 0.741s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:12 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:40:12 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae {{(pid=93788) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 16:40:12 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Creating direct copy from snapshot {{(pid=93788) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 16:40:12 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae975505-c9dc-4bf1-97b9-df3efc7c2865]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:40:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:12 devstack sudo[106707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae Jun 23 16:40:12 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:13 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae" returned: 0 in 0.737s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:13 devstack cinder-volume[93788]: DEBUG cinder.utils [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Path /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-eff05b29-d70f-4553-bbb0-756183c372ec not found in is_blk_device check {{(pid=93788) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 16:40:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-eff05b29-d70f-4553-bbb0-756183c372ec {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:13 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-eff05b29-d70f-4553-bbb0-756183c372ec Jun 23 16:40:13 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:17 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-eff05b29-d70f-4553-bbb0-756183c372ec" returned: 0 in 4.791s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:17 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fa09c8-c497-40d5-b3b5-79d8cda7b82e]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:40:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:17 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae Jun 23 16:40:17 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:18 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:18 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae" returned: 0 in 0.911s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:18 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Image conversion details: src /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae, size 1024.00 MB, duration 4.79 sec, destination /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-eff05b29-d70f-4553-bbb0-756183c372ec {{(pid=93788) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 16:40:18 devstack cinder-volume[93788]: INFO cinder.image.image_utils [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Converted 1024.00 MB image at 213.67 MB/s Jun 23 16:40:18 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-eff05b29-d70f-4553-bbb0-756183c372ec is being set with open permissions: ugo+rw Jun 23 16:40:18 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-eff05b29-d70f-4553-bbb0-756183c372ec {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:18 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-eff05b29-d70f-4553-bbb0-756183c372ec Jun 23 16:40:18 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:19 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:19 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-eff05b29-d70f-4553-bbb0-756183c372ec" returned: 0 in 0.620s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:19 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Lock "cinder-quobyte-eff05b29-d70f-4553-bbb0-756183c372ec" released by "_copy_volume_from_snapshot" :: held 7.885s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:40:19 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Acquiring lock "cinder-quobyte-ee063f91-8fc2-4d6a-bc61-b646adf19694" by "_delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:40:19 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Lock "cinder-quobyte-ee063f91-8fc2-4d6a-bc61-b646adf19694" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:40:19 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Deleting offline snapshot ee063f91-8fc2-4d6a-bc61-b646adf19694 of volume b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:40:19 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] snapshot_file for this snap is: volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae.ee063f91-8fc2-4d6a-bc61-b646adf19694 {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:40:19 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1feef91-fcb1-42f7-a3cb-10845ed87fa0]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:40:19 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae.ee063f91-8fc2-4d6a-bc61-b646adf19694 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:19 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae.ee063f91-8fc2-4d6a-bc61-b646adf19694 Jun 23 16:40:19 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:20 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:UPDATE=50,cinder:SELECT=43,cinder:INSERT=20,cinder:DELETE=8 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:40:20 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:20 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae.ee063f91-8fc2-4d6a-bc61-b646adf19694" returned: 0 in 0.802s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:20 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:40:20 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13c6378-4b27-4b03-bcd1-9b8693e27503]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:40:20 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:20 devstack sudo[106742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae Jun 23 16:40:20 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:21 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae" returned: 0 in 0.773s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae.ee063f91-8fc2-4d6a-bc61-b646adf19694 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:21 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae.ee063f91-8fc2-4d6a-bc61-b646adf19694 Jun 23 16:40:21 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:21 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae.ee063f91-8fc2-4d6a-bc61-b646adf19694" returned: 0 in 0.712s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae.ee063f91-8fc2-4d6a-bc61-b646adf19694 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:21 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae.ee063f91-8fc2-4d6a-bc61-b646adf19694 Jun 23 16:40:21 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:22 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae.ee063f91-8fc2-4d6a-bc61-b646adf19694" returned: 0 in 0.629s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:22 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Lock "cinder-quobyte-ee063f91-8fc2-4d6a-bc61-b646adf19694" released by "_delete_snapshot" :: held 2.997s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:40:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.322s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:40:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 15.468s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:40:22 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Cloning volume 9a0ceb4c-c364-40aa-b2f9-dd870f611cac to volume 1e97b470-4b13-4432-9ba9-1f72191ebeb1 Jun 23 16:40:22 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef180634-5e9b-4702-9a82-e496e70bde57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eff05b29-d70f-4553-bbb0-756183c372ec', 'volume_size': 2, 'source_volid': 'b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae', 'source_volstatus': 'available'}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:40:22 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (670513c9-afb9-4f0c-b2e6-556bb6805178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:40:22 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Volume volume-eff05b29-d70f-4553-bbb0-756183c372ec (eff05b29-d70f-4553-bbb0-756183c372ec): created successfully Jun 23 16:40:22 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (670513c9-afb9-4f0c-b2e6-556bb6805178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:40:22 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Flow 'volume_create_manager' (b9ae99cf-8fe1-48f7-a1fa-6d6b50a44628) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:40:22 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Creating offline snapshot c336872d-c487-4ef2-ba59-dcf4caae5a73 of volume 9a0ceb4c-c364-40aa-b2f9-dd870f611cac {{(pid=93788) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:40:22 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-e11b621f-5c61-4d4b-a5eb-444c7a3bbb9d tempest-VolumesCloneTest-1443706569 None] Created volume successfully. Jun 23 16:40:22 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ad7537-ad36-4d41-a9a8-adc99bcea7e1]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:40:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:22 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac Jun 23 16:40:22 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:23 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac" returned: 0 in 0.769s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac.c336872d-c487-4ef2-ba59-dcf4caae5a73 1G {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:23 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac.c336872d-c487-4ef2-ba59-dcf4caae5a73 1G Jun 23 16:40:23 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:23 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-21902e6d-45e8-4337-afe0-3cfcce2726ee tempest-VolumesCloneTest-1443706569 None] Acquiring lock "cinder-eff05b29-d70f-4553-bbb0-756183c372ec-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:40:23 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-21902e6d-45e8-4337-afe0-3cfcce2726ee tempest-VolumesCloneTest-1443706569 None] Lock "cinder-eff05b29-d70f-4553-bbb0-756183c372ec-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:40:23 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-21902e6d-45e8-4337-afe0-3cfcce2726ee tempest-VolumesCloneTest-1443706569 None] Acquiring lock "cinder-quobyte-eff05b29-d70f-4553-bbb0-756183c372ec" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:40:23 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-21902e6d-45e8-4337-afe0-3cfcce2726ee tempest-VolumesCloneTest-1443706569 None] Lock "cinder-quobyte-eff05b29-d70f-4553-bbb0-756183c372ec" acquired by "delete_volume" :: waited 0.020s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:40:23 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[75de1801-2a09-4562-ae72-6ffaf9cd6381]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:40:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-21902e6d-45e8-4337-afe0-3cfcce2726ee tempest-VolumesCloneTest-1443706569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-eff05b29-d70f-4553-bbb0-756183c372ec {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:23 devstack sudo[106762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-eff05b29-d70f-4553-bbb0-756183c372ec Jun 23 16:40:23 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:24 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac.c336872d-c487-4ef2-ba59-dcf4caae5a73 1G" returned: 0 in 0.837s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac.c336872d-c487-4ef2-ba59-dcf4caae5a73 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:24 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac.c336872d-c487-4ef2-ba59-dcf4caae5a73 Jun 23 16:40:24 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:24 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-21902e6d-45e8-4337-afe0-3cfcce2726ee tempest-VolumesCloneTest-1443706569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-eff05b29-d70f-4553-bbb0-756183c372ec" returned: 0 in 0.795s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-21902e6d-45e8-4337-afe0-3cfcce2726ee tempest-VolumesCloneTest-1443706569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-eff05b29-d70f-4553-bbb0-756183c372ec {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:24 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-eff05b29-d70f-4553-bbb0-756183c372ec Jun 23 16:40:24 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:24 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac.c336872d-c487-4ef2-ba59-dcf4caae5a73" returned: 0 in 0.740s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:24 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac.c336872d-c487-4ef2-ba59-dcf4caae5a73 is being set with open permissions: ugo+rw Jun 23 16:40:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac.c336872d-c487-4ef2-ba59-dcf4caae5a73 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:24 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac.c336872d-c487-4ef2-ba59-dcf4caae5a73 Jun 23 16:40:24 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:25 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-21902e6d-45e8-4337-afe0-3cfcce2726ee tempest-VolumesCloneTest-1443706569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-eff05b29-d70f-4553-bbb0-756183c372ec" returned: 0 in 0.701s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:25 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-21902e6d-45e8-4337-afe0-3cfcce2726ee tempest-VolumesCloneTest-1443706569 None] Lock "cinder-quobyte-eff05b29-d70f-4553-bbb0-756183c372ec" released by "delete_volume" :: held 1.554s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:40:25 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-21902e6d-45e8-4337-afe0-3cfcce2726ee tempest-VolumesCloneTest-1443706569 None] Created reservations ['7e32ce64-86e0-4e31-805d-772d77da50ed', 'cebcf082-6d50-4272-8c8f-8bf88b694a57', '247799f3-dcc1-4460-8afa-e30fa69e990f', '55ef14a2-43a5-47c4-9087-b995a9adeb55'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:40:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-21902e6d-45e8-4337-afe0-3cfcce2726ee tempest-VolumesCloneTest-1443706569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:40:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-21902e6d-45e8-4337-afe0-3cfcce2726ee tempest-VolumesCloneTest-1443706569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:40:25 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-21902e6d-45e8-4337-afe0-3cfcce2726ee tempest-VolumesCloneTest-1443706569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:40:25 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-21902e6d-45e8-4337-afe0-3cfcce2726ee tempest-VolumesCloneTest-1443706569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:40:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-21902e6d-45e8-4337-afe0-3cfcce2726ee tempest-VolumesCloneTest-1443706569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:40:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-21902e6d-45e8-4337-afe0-3cfcce2726ee tempest-VolumesCloneTest-1443706569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:25 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:40:25 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:25 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac.c336872d-c487-4ef2-ba59-dcf4caae5a73" returned: 0 in 0.696s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:25 devstack sudo[106783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac.info Jun 23 16:40:25 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:25 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-3e9b7c42-9e67-4905-8567-37e96cd56ee2 tempest-VolumesCloneTest-1443706569 None] Acquiring lock "cinder-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:40:25 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-3e9b7c42-9e67-4905-8567-37e96cd56ee2 tempest-VolumesCloneTest-1443706569 None] Lock "cinder-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:40:25 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-21902e6d-45e8-4337-afe0-3cfcce2726ee tempest-VolumesCloneTest-1443706569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.667s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:25 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-21902e6d-45e8-4337-afe0-3cfcce2726ee tempest-VolumesCloneTest-1443706569 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:40:25 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-21902e6d-45e8-4337-afe0-3cfcce2726ee tempest-VolumesCloneTest-1443706569 None] Deleted volume successfully. Jun 23 16:40:25 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-3e9b7c42-9e67-4905-8567-37e96cd56ee2 tempest-VolumesCloneTest-1443706569 None] Acquiring lock "cinder-quobyte-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:40:25 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-21902e6d-45e8-4337-afe0-3cfcce2726ee tempest-VolumesCloneTest-1443706569 None] Lock "cinder-eff05b29-d70f-4553-bbb0-756183c372ec-delete_volume" released by "delete_volume" :: held 2.463s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:40:25 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-3e9b7c42-9e67-4905-8567-37e96cd56ee2 tempest-VolumesCloneTest-1443706569 None] Lock "cinder-quobyte-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae" acquired by "delete_volume" :: waited 0.016s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:40:25 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0655efd-ca32-41da-b823-cf915faa94c9]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:40:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-3e9b7c42-9e67-4905-8567-37e96cd56ee2 tempest-VolumesCloneTest-1443706569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:26 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae Jun 23 16:40:26 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:26 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac.info" returned: 0 in 0.727s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:26 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac.info is being set with open permissions: ugo+rw Jun 23 16:40:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:26 devstack sudo[106789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac.info Jun 23 16:40:26 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:26 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-3e9b7c42-9e67-4905-8567-37e96cd56ee2 tempest-VolumesCloneTest-1443706569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae" returned: 0 in 0.769s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-3e9b7c42-9e67-4905-8567-37e96cd56ee2 tempest-VolumesCloneTest-1443706569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:26 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae Jun 23 16:40:26 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:27 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac.info" returned: 0 in 0.693s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:27 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Acquiring lock "cinder-quobyte-1e97b470-4b13-4432-9ba9-1f72191ebeb1" by "_copy_volume_from_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:40:27 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Lock "cinder-quobyte-1e97b470-4b13-4432-9ba9-1f72191ebeb1" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:40:27 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] snapshot: c336872d-c487-4ef2-ba59-dcf4caae5a73, volume: 1e97b470-4b13-4432-9ba9-1f72191ebeb1, {{(pid=93788) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 16:40:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:40:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:40:27 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:40:27 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:40:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:40:27 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c2b954-96bc-4f18-a23d-6d49930020cf]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:40:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac.c336872d-c487-4ef2-ba59-dcf4caae5a73 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:27 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac.c336872d-c487-4ef2-ba59-dcf4caae5a73 Jun 23 16:40:27 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:27 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-3e9b7c42-9e67-4905-8567-37e96cd56ee2 tempest-VolumesCloneTest-1443706569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae" returned: 0 in 0.661s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:27 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-3e9b7c42-9e67-4905-8567-37e96cd56ee2 tempest-VolumesCloneTest-1443706569 None] Lock "cinder-quobyte-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae" released by "delete_volume" :: held 1.492s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:40:27 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-3e9b7c42-9e67-4905-8567-37e96cd56ee2 tempest-VolumesCloneTest-1443706569 None] Created reservations ['3de8e5d7-88e7-4533-9e17-3e874588b72d', 'd70ea312-e9da-42fc-b183-ad971e7dd685', '329fbd02-8d66-4048-b260-e19efd900b0f', '66c7c8e5-7651-4b8e-9f7d-17cfec382c3a'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:40:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-3e9b7c42-9e67-4905-8567-37e96cd56ee2 tempest-VolumesCloneTest-1443706569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:40:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-3e9b7c42-9e67-4905-8567-37e96cd56ee2 tempest-VolumesCloneTest-1443706569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:40:27 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-3e9b7c42-9e67-4905-8567-37e96cd56ee2 tempest-VolumesCloneTest-1443706569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:40:27 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-3e9b7c42-9e67-4905-8567-37e96cd56ee2 tempest-VolumesCloneTest-1443706569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:40:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-3e9b7c42-9e67-4905-8567-37e96cd56ee2 tempest-VolumesCloneTest-1443706569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:40:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-3e9b7c42-9e67-4905-8567-37e96cd56ee2 tempest-VolumesCloneTest-1443706569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:27 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:40:27 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:27 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac.c336872d-c487-4ef2-ba59-dcf4caae5a73" returned: 0 in 0.825s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:27 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:40:27 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac {{(pid=93788) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 16:40:27 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Creating direct copy from snapshot {{(pid=93788) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 16:40:27 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[116ef89e-11ef-4396-98d1-e6403061f6bf]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:40:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:28 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac Jun 23 16:40:28 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:28 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-3e9b7c42-9e67-4905-8567-37e96cd56ee2 tempest-VolumesCloneTest-1443706569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.720s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:28 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-3e9b7c42-9e67-4905-8567-37e96cd56ee2 tempest-VolumesCloneTest-1443706569 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:40:28 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-3e9b7c42-9e67-4905-8567-37e96cd56ee2 tempest-VolumesCloneTest-1443706569 None] Deleted volume successfully. Jun 23 16:40:28 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-3e9b7c42-9e67-4905-8567-37e96cd56ee2 tempest-VolumesCloneTest-1443706569 None] Lock "cinder-b6f2ac0a-be80-4ed5-8ad8-94b5f175d6ae-delete_volume" released by "delete_volume" :: held 2.453s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:40:28 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac" returned: 0 in 0.881s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:28 devstack cinder-volume[93788]: DEBUG cinder.utils [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Path /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1e97b470-4b13-4432-9ba9-1f72191ebeb1 not found in is_blk_device check {{(pid=93788) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 16:40:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1e97b470-4b13-4432-9ba9-1f72191ebeb1 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:28 devstack sudo[106813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1e97b470-4b13-4432-9ba9-1f72191ebeb1 Jun 23 16:40:28 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:33 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:40:33 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] Flow 'volume_create_manager' (6d16ebf1-17f6-4fa7-b251-4e647377030c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:40:33 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c47360b-eff1-49c5-8254-dda8f1b71388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:40:33 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c47360b-eff1-49c5-8254-dda8f1b71388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-922046286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8f29b0b2e5a460b9c5fb6abe4779332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:40:34Z,use_quota=True,user_id='ac7a402e42d94573bc77828c02e12cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:40:33 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e084cb51-e6c6-4ea7-b4cb-555a8e6c744a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:40:33 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e084cb51-e6c6-4ea7-b4cb-555a8e6c744a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:40:33 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d193d4-02e2-4e75-b0f7-01ed4b068cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:40:33 devstack cinder-volume[93788]: DEBUG cinder.image.glance [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] Creating Keystone auth plugin from conf {{(pid=93788) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 16:40:34 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d193d4-02e2-4e75-b0f7-01ed4b068cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f', 'volume_name': 'volume-fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f', 'volume_size': 1, 'image_id': '36d19347-ef32-4018-a0b0-67c4eb356ff0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/36d19347-ef32-4018-a0b0-67c4eb356ff0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '96f86ae628444b53b4eb7231789566de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '36d19347-ef32-4018-a0b0-67c4eb356ff0', 'created_at': datetime.datetime(2026, 6, 23, 14, 20, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 14, 20, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36d19347-ef32-4018-a0b0-67c4eb356ff0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:40:34 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd6f048c-c19c-40a1-a228-7160f86f1923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:40:34 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd6f048c-c19c-40a1-a228-7160f86f1923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:40:34 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b65be59e-c69d-494e-962b-2ceae510dae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:40:34 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] Volume fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f', 'volume_size': 1, 'image_id': '36d19347-ef32-4018-a0b0-67c4eb356ff0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/36d19347-ef32-4018-a0b0-67c4eb356ff0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '96f86ae628444b53b4eb7231789566de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '36d19347-ef32-4018-a0b0-67c4eb356ff0', 'created_at': datetime.datetime(2026, 6, 23, 14, 20, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 14, 20, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36d19347-ef32-4018-a0b0-67c4eb356ff0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 23 16:40:34 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] Trying to clone fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f from image 36d19347-ef32-4018-a0b0-67c4eb356ff0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/36d19347-ef32-4018-a0b0-67c4eb356ff0', 'metadata': {}}]). {{(pid=93788) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 16:40:34 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1e97b470-4b13-4432-9ba9-1f72191ebeb1" returned: 0 in 5.613s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:34 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d2d558-9f00-4d86-bc1c-5aab9e3b41ac]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:40:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:34 devstack sudo[106842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac Jun 23 16:40:34 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:34 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_clevc_37devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93788) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 16:40:34 devstack cinder-volume[93788]: INFO cinder.image.image_utils [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] Image download 20.69 MB at 20.69 MB/s Jun 23 16:40:34 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d66b46-2a28-41a2-9ff7-5406b1e0c963]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:40:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_clevc_37devstack@QuobyteHD {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:34 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_clevc_37devstack@QuobyteHD Jun 23 16:40:34 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:35 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac" returned: 0 in 1.074s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:35 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Image conversion details: src /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac, size 1024.00 MB, duration 5.61 sec, destination /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1e97b470-4b13-4432-9ba9-1f72191ebeb1 {{(pid=93788) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 16:40:35 devstack cinder-volume[93788]: INFO cinder.image.image_utils [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Converted 1024.00 MB image at 182.41 MB/s Jun 23 16:40:35 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1e97b470-4b13-4432-9ba9-1f72191ebeb1 is being set with open permissions: ugo+rw Jun 23 16:40:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1e97b470-4b13-4432-9ba9-1f72191ebeb1 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:35 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_clevc_37devstack@QuobyteHD" returned: 0 in 0.755s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:35 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] Temporary image 36d19347-ef32-4018-a0b0-67c4eb356ff0 is fetched for user ac7a402e42d94573bc77828c02e12cb4. {{(pid=93788) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 16:40:35 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1e97b470-4b13-4432-9ba9-1f72191ebeb1 Jun 23 16:40:35 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:35 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[863540bb-2388-4cc4-931d-78ff7ada7cdb]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:40:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_clevc_37devstack@QuobyteHD {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:35 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_clevc_37devstack@QuobyteHD Jun 23 16:40:35 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:36 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1e97b470-4b13-4432-9ba9-1f72191ebeb1" returned: 0 in 0.692s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:36 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Lock "cinder-quobyte-1e97b470-4b13-4432-9ba9-1f72191ebeb1" released by "_copy_volume_from_snapshot" :: held 9.173s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:40:36 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Acquiring lock "cinder-quobyte-c336872d-c487-4ef2-ba59-dcf4caae5a73" by "_delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:40:36 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Lock "cinder-quobyte-c336872d-c487-4ef2-ba59-dcf4caae5a73" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:40:36 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Deleting offline snapshot c336872d-c487-4ef2-ba59-dcf4caae5a73 of volume 9a0ceb4c-c364-40aa-b2f9-dd870f611cac {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:40:36 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] snapshot_file for this snap is: volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac.c336872d-c487-4ef2-ba59-dcf4caae5a73 {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:40:36 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1206e6d5-44ff-4ad2-8029-e16121f187f8]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:40:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac.c336872d-c487-4ef2-ba59-dcf4caae5a73 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:36 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_clevc_37devstack@QuobyteHD" returned: 0 in 0.748s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:40:36 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac.c336872d-c487-4ef2-ba59-dcf4caae5a73 Jun 23 16:40:36 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:37 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac.c336872d-c487-4ef2-ba59-dcf4caae5a73" returned: 0 in 0.741s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:37 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:40:37 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d17b623-5d8f-4b69-bd50-2eca0139f33c]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:40:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:37 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac Jun 23 16:40:37 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:37 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac" returned: 0 in 0.723s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac.c336872d-c487-4ef2-ba59-dcf4caae5a73 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:37 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac.c336872d-c487-4ef2-ba59-dcf4caae5a73 Jun 23 16:40:37 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:38 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac.c336872d-c487-4ef2-ba59-dcf4caae5a73" returned: 0 in 0.738s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac.c336872d-c487-4ef2-ba59-dcf4caae5a73 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:38 devstack sudo[106898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac.c336872d-c487-4ef2-ba59-dcf4caae5a73 Jun 23 16:40:38 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:39 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac.c336872d-c487-4ef2-ba59-dcf4caae5a73" returned: 0 in 0.643s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:39 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Lock "cinder-quobyte-c336872d-c487-4ef2-ba59-dcf4caae5a73" released by "_delete_snapshot" :: held 2.928s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:40:39 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:SELECT=70,cinder:INSERT=27,cinder:UPDATE=98,cinder:DELETE=6 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:40:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.795s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:40:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-568eb2e5-f720-4300-ae24-91f7c222caf0 req-d1a0884b-3a13-4055-a40a-8e0c1e4dbf0f tempest-TestInstancesWithCinderVolumes-865228744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 31.482s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:40:39 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcac952b-9f46-487a-8512-91990cc3aed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e97b470-4b13-4432-9ba9-1f72191ebeb1', 'volume_size': 1, 'source_volid': '9a0ceb4c-c364-40aa-b2f9-dd870f611cac', 'source_volstatus': 'available'}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:40:39 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2d0d136-b312-423d-bc77-95edf54ed98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:40:39 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[182b5f30-3ced-4913-93db-691cc70dd9a2]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:40:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-568eb2e5-f720-4300-ae24-91f7c222caf0 req-d1a0884b-3a13-4055-a40a-8e0c1e4dbf0f tempest-TestInstancesWithCinderVolumes-865228744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f6a5072e-4d4d-4303-8a1b-ef8b7dc46562 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:39 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Volume volume-1e97b470-4b13-4432-9ba9-1f72191ebeb1 (1e97b470-4b13-4432-9ba9-1f72191ebeb1): created successfully Jun 23 16:40:39 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2d0d136-b312-423d-bc77-95edf54ed98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:40:39 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Flow 'volume_create_manager' (fa283b78-cf6f-4efe-85fd-4d108d5f919a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:40:39 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-20ec85ae-ccf1-4052-afe6-bb2c772415ad tempest-VolumesGetTest-1550830579 None] Created volume successfully. Jun 23 16:40:39 devstack sudo[106902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f6a5072e-4d4d-4303-8a1b-ef8b7dc46562 Jun 23 16:40:39 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:40 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-568eb2e5-f720-4300-ae24-91f7c222caf0 req-d1a0884b-3a13-4055-a40a-8e0c1e4dbf0f tempest-TestInstancesWithCinderVolumes-865228744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f6a5072e-4d4d-4303-8a1b-ef8b7dc46562" returned: 0 in 0.772s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-568eb2e5-f720-4300-ae24-91f7c222caf0 req-d1a0884b-3a13-4055-a40a-8e0c1e4dbf0f tempest-TestInstancesWithCinderVolumes-865228744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.802s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:40:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8d752e24-9c51-4839-9453-2387c582a496 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 31.551s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:40:40 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-8d752e24-9c51-4839-9453-2387c582a496 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Creating offline snapshot 6d928acc-70c3-4823-9e31-f3760218b243 of volume 25fd90a3-6f4f-4292-8319-fc9d4925af24 {{(pid=93788) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:40:40 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed17cd18-f53c-4260-b00d-abb842004fde]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:40:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8d752e24-9c51-4839-9453-2387c582a496 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-25fd90a3-6f4f-4292-8319-fc9d4925af24 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:40 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-568eb2e5-f720-4300-ae24-91f7c222caf0 req-d1a0884b-3a13-4055-a40a-8e0c1e4dbf0f tempest-TestInstancesWithCinderVolumes-865228744 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e', 'name': 'volume-f6a5072e-4d4d-4303-8a1b-ef8b7dc46562', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '371f4487-c68d-4cf9-9d25-5d9bc0dab7fe', 'enforce_multipath': True} {{(pid=93788) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 16:40:40 devstack cinder-volume[93788]: INFO cinder.volume.manager [req-568eb2e5-f720-4300-ae24-91f7c222caf0 req-d1a0884b-3a13-4055-a40a-8e0c1e4dbf0f tempest-TestInstancesWithCinderVolumes-865228744 None] attachment_update completed successfully. Jun 23 16:40:40 devstack sudo[106907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-25fd90a3-6f4f-4292-8319-fc9d4925af24 Jun 23 16:40:40 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:40 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8d752e24-9c51-4839-9453-2387c582a496 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-25fd90a3-6f4f-4292-8319-fc9d4925af24" returned: 0 in 0.857s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8d752e24-9c51-4839-9453-2387c582a496 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-25fd90a3-6f4f-4292-8319-fc9d4925af24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-25fd90a3-6f4f-4292-8319-fc9d4925af24.6d928acc-70c3-4823-9e31-f3760218b243 1G {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:40 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-25fd90a3-6f4f-4292-8319-fc9d4925af24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-25fd90a3-6f4f-4292-8319-fc9d4925af24.6d928acc-70c3-4823-9e31-f3760218b243 1G Jun 23 16:40:41 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:41 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-8891c457-066f-43f7-bfa3-353879c51276 tempest-VolumesGetTest-1550830579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:40:41 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8891c457-066f-43f7-bfa3-353879c51276 tempest-VolumesGetTest-1550830579 None] Flow 'volume_create_manager' (bcb4abb8-45ac-4796-bece-6d2c49cc8c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:40:41 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8891c457-066f-43f7-bfa3-353879c51276 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7ab7b77-3bb0-4766-a6ff-5d7932edfcac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:40:41 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8891c457-066f-43f7-bfa3-353879c51276 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7ab7b77-3bb0-4766-a6ff-5d7932edfcac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:40:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2066420079',display_name='tempest-VolumesGetTest-Volume-1465250141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d020ebca-9abc-4ae8-9e77-cd981b7ae50d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e0c6765fc6c450aa7d0be9b768dc1f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:40:41Z,use_quota=True,user_id='a0eda2b8c0f54a9cb23869514ffecda4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:40:41 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8891c457-066f-43f7-bfa3-353879c51276 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3d35edb-a3a1-46e6-a99d-ebb4f04eabee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:40:41 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8891c457-066f-43f7-bfa3-353879c51276 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3d35edb-a3a1-46e6-a99d-ebb4f04eabee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:40:41 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8891c457-066f-43f7-bfa3-353879c51276 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (535f4cb4-ecf2-407a-b96d-a957d5e53ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:40:41 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8891c457-066f-43f7-bfa3-353879c51276 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (535f4cb4-ecf2-407a-b96d-a957d5e53ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd020ebca-9abc-4ae8-9e77-cd981b7ae50d', 'volume_name': 'volume-d020ebca-9abc-4ae8-9e77-cd981b7ae50d', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:40:41 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8891c457-066f-43f7-bfa3-353879c51276 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82c19552-7416-44a0-b7c7-0a1e8918f623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:40:41 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8891c457-066f-43f7-bfa3-353879c51276 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82c19552-7416-44a0-b7c7-0a1e8918f623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:40:41 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8891c457-066f-43f7-bfa3-353879c51276 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (228df29c-7eb7-43e7-aefb-2fa27ffb4456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:40:41 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-8891c457-066f-43f7-bfa3-353879c51276 tempest-VolumesGetTest-1550830579 None] Volume d020ebca-9abc-4ae8-9e77-cd981b7ae50d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d020ebca-9abc-4ae8-9e77-cd981b7ae50d', 'volume_size': 1} Jun 23 16:40:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8891c457-066f-43f7-bfa3-353879c51276 tempest-VolumesGetTest-1550830579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:40:41 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8d752e24-9c51-4839-9453-2387c582a496 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-25fd90a3-6f4f-4292-8319-fc9d4925af24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-25fd90a3-6f4f-4292-8319-fc9d4925af24.6d928acc-70c3-4823-9e31-f3760218b243 1G" returned: 0 in 0.863s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8d752e24-9c51-4839-9453-2387c582a496 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25fd90a3-6f4f-4292-8319-fc9d4925af24 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-25fd90a3-6f4f-4292-8319-fc9d4925af24.6d928acc-70c3-4823-9e31-f3760218b243 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:41 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25fd90a3-6f4f-4292-8319-fc9d4925af24 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-25fd90a3-6f4f-4292-8319-fc9d4925af24.6d928acc-70c3-4823-9e31-f3760218b243 Jun 23 16:40:41 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:42 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:42 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8d752e24-9c51-4839-9453-2387c582a496 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25fd90a3-6f4f-4292-8319-fc9d4925af24 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-25fd90a3-6f4f-4292-8319-fc9d4925af24.6d928acc-70c3-4823-9e31-f3760218b243" returned: 0 in 0.684s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:42 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-8d752e24-9c51-4839-9453-2387c582a496 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-25fd90a3-6f4f-4292-8319-fc9d4925af24.6d928acc-70c3-4823-9e31-f3760218b243 is being set with open permissions: ugo+rw Jun 23 16:40:42 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8d752e24-9c51-4839-9453-2387c582a496 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-25fd90a3-6f4f-4292-8319-fc9d4925af24.6d928acc-70c3-4823-9e31-f3760218b243 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:42 devstack sudo[106928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-25fd90a3-6f4f-4292-8319-fc9d4925af24.6d928acc-70c3-4823-9e31-f3760218b243 Jun 23 16:40:42 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:43 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8d752e24-9c51-4839-9453-2387c582a496 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-25fd90a3-6f4f-4292-8319-fc9d4925af24.6d928acc-70c3-4823-9e31-f3760218b243" returned: 0 in 0.661s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8d752e24-9c51-4839-9453-2387c582a496 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-25fd90a3-6f4f-4292-8319-fc9d4925af24.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:43 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-25fd90a3-6f4f-4292-8319-fc9d4925af24.info Jun 23 16:40:43 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:43 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8d752e24-9c51-4839-9453-2387c582a496 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-25fd90a3-6f4f-4292-8319-fc9d4925af24.info" returned: 0 in 0.689s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:43 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-8d752e24-9c51-4839-9453-2387c582a496 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-25fd90a3-6f4f-4292-8319-fc9d4925af24.info is being set with open permissions: ugo+rw Jun 23 16:40:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8d752e24-9c51-4839-9453-2387c582a496 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-25fd90a3-6f4f-4292-8319-fc9d4925af24.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:43 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-25fd90a3-6f4f-4292-8319-fc9d4925af24.info Jun 23 16:40:43 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:44 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8d752e24-9c51-4839-9453-2387c582a496 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-25fd90a3-6f4f-4292-8319-fc9d4925af24.info" returned: 0 in 0.682s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8d752e24-9c51-4839-9453-2387c582a496 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.544s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:40:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.230s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:40:44 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-922046286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8f29b0b2e5a460b9c5fb6abe4779332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:40:34Z,use_quota=True,user_id='ac7a402e42d94573bc77828c02e12cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:40:44 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] Creating volume fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:40:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:40:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:40:44 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:40:44 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:40:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:40:44 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:40:44 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:40:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:44 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f 1073741824 Jun 23 16:40:44 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:44 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-8d752e24-9c51-4839-9453-2387c582a496 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Create snapshot completed successfully Jun 23 16:40:45 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:45 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f 1073741824" returned: 0 in 0.902s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:45 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:45 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f Jun 23 16:40:45 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:45 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ae8896ae-13de-452a-824f-579da7566fd4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Acquiring lock "cinder-6d928acc-70c3-4823-9e31-f3760218b243-delete_snapshot" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:40:45 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ae8896ae-13de-452a-824f-579da7566fd4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Lock "cinder-6d928acc-70c3-4823-9e31-f3760218b243-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:40:45 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ae8896ae-13de-452a-824f-579da7566fd4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Acquiring lock "cinder-quobyte-25fd90a3-6f4f-4292-8319-fc9d4925af24" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:40:45 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ae8896ae-13de-452a-824f-579da7566fd4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Lock "cinder-quobyte-25fd90a3-6f4f-4292-8319-fc9d4925af24" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:40:45 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ae8896ae-13de-452a-824f-579da7566fd4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Acquiring lock "cinder-quobyte-6d928acc-70c3-4823-9e31-f3760218b243" by "_delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:40:45 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ae8896ae-13de-452a-824f-579da7566fd4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Lock "cinder-quobyte-6d928acc-70c3-4823-9e31-f3760218b243" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:40:45 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-ae8896ae-13de-452a-824f-579da7566fd4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Deleting offline snapshot 6d928acc-70c3-4823-9e31-f3760218b243 of volume 25fd90a3-6f4f-4292-8319-fc9d4925af24 {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:40:45 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-ae8896ae-13de-452a-824f-579da7566fd4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] snapshot_file for this snap is: volume-25fd90a3-6f4f-4292-8319-fc9d4925af24.6d928acc-70c3-4823-9e31-f3760218b243 {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:40:45 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf23ca4-86e5-4133-95a1-4ec103906ffc]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:40:45 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ae8896ae-13de-452a-824f-579da7566fd4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-25fd90a3-6f4f-4292-8319-fc9d4925af24.6d928acc-70c3-4823-9e31-f3760218b243 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:46 devstack sudo[106954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-25fd90a3-6f4f-4292-8319-fc9d4925af24.6d928acc-70c3-4823-9e31-f3760218b243 Jun 23 16:40:46 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:46 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f" returned: 0 in 0.733s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:46 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] <== create_volume: return (1691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:40:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:40:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8891c457-066f-43f7-bfa3-353879c51276 tempest-VolumesGetTest-1550830579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.214s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:40:46 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-8891c457-066f-43f7-bfa3-353879c51276 tempest-VolumesGetTest-1550830579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:40:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2066420079',display_name='tempest-VolumesGetTest-Volume-1465250141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d020ebca-9abc-4ae8-9e77-cd981b7ae50d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e0c6765fc6c450aa7d0be9b768dc1f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:40:41Z,use_quota=True,user_id='a0eda2b8c0f54a9cb23869514ffecda4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:40:46 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-8891c457-066f-43f7-bfa3-353879c51276 tempest-VolumesGetTest-1550830579 None] Creating volume d020ebca-9abc-4ae8-9e77-cd981b7ae50d {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:40:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8891c457-066f-43f7-bfa3-353879c51276 tempest-VolumesGetTest-1550830579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:40:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8891c457-066f-43f7-bfa3-353879c51276 tempest-VolumesGetTest-1550830579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:40:46 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-8891c457-066f-43f7-bfa3-353879c51276 tempest-VolumesGetTest-1550830579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:40:46 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-8891c457-066f-43f7-bfa3-353879c51276 tempest-VolumesGetTest-1550830579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:40:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8891c457-066f-43f7-bfa3-353879c51276 tempest-VolumesGetTest-1550830579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:40:46 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-8891c457-066f-43f7-bfa3-353879c51276 tempest-VolumesGetTest-1550830579 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:40:46 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-8891c457-066f-43f7-bfa3-353879c51276 tempest-VolumesGetTest-1550830579 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:40:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8891c457-066f-43f7-bfa3-353879c51276 tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d020ebca-9abc-4ae8-9e77-cd981b7ae50d 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:46 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d020ebca-9abc-4ae8-9e77-cd981b7ae50d 1073741824 Jun 23 16:40:46 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:46 devstack cinder-volume[93788]: DEBUG cinder.volume.volume_utils [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] Attempting download of 36d19347-ef32-4018-a0b0-67c4eb356ff0 ((None, [{'url': 'file:///opt/stack/data/glance/images/36d19347-ef32-4018-a0b0-67c4eb356ff0', 'metadata': {}}])) to volume fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f. {{(pid=93788) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 16:40:46 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[05677938-6437-4c19-962a-070edb164c34]: (4, 'raw') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:40:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36d19347-ef32-4018-a0b0-67c4eb356ff0_wpsowcjt {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:46 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36d19347-ef32-4018-a0b0-67c4eb356ff0_wpsowcjt Jun 23 16:40:46 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:46 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ae8896ae-13de-452a-824f-579da7566fd4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-25fd90a3-6f4f-4292-8319-fc9d4925af24.6d928acc-70c3-4823-9e31-f3760218b243" returned: 0 in 0.811s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:46 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-ae8896ae-13de-452a-824f-579da7566fd4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25fd90a3-6f4f-4292-8319-fc9d4925af24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:40:46 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f492b997-9137-410a-8cc3-91c664143272]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:40:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ae8896ae-13de-452a-824f-579da7566fd4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-25fd90a3-6f4f-4292-8319-fc9d4925af24 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:46 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-25fd90a3-6f4f-4292-8319-fc9d4925af24 Jun 23 16:40:46 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:47 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36d19347-ef32-4018-a0b0-67c4eb356ff0_wpsowcjt" returned: 0 in 0.816s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36d19347-ef32-4018-a0b0-67c4eb356ff0_wpsowcjt {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:47 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8891c457-066f-43f7-bfa3-353879c51276 tempest-VolumesGetTest-1550830579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d020ebca-9abc-4ae8-9e77-cd981b7ae50d 1073741824" returned: 0 in 0.962s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8891c457-066f-43f7-bfa3-353879c51276 tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d020ebca-9abc-4ae8-9e77-cd981b7ae50d {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:47 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d020ebca-9abc-4ae8-9e77-cd981b7ae50d Jun 23 16:40:47 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:47 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36d19347-ef32-4018-a0b0-67c4eb356ff0_wpsowcjt Jun 23 16:40:47 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:47 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ae8896ae-13de-452a-824f-579da7566fd4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-25fd90a3-6f4f-4292-8319-fc9d4925af24" returned: 0 in 0.860s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ae8896ae-13de-452a-824f-579da7566fd4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-25fd90a3-6f4f-4292-8319-fc9d4925af24.6d928acc-70c3-4823-9e31-f3760218b243 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:47 devstack sudo[106987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-25fd90a3-6f4f-4292-8319-fc9d4925af24.6d928acc-70c3-4823-9e31-f3760218b243 Jun 23 16:40:47 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:48 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36d19347-ef32-4018-a0b0-67c4eb356ff0_wpsowcjt" returned: 1 in 0.829s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36d19347-ef32-4018-a0b0-67c4eb356ff0_wpsowcjt' failed. Not Retrying. {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:40:48 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c4d087-dc36-4b13-8fea-04859af673ee]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:40:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_clevc_37devstack@QuobyteHD {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:48 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8891c457-066f-43f7-bfa3-353879c51276 tempest-VolumesGetTest-1550830579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d020ebca-9abc-4ae8-9e77-cd981b7ae50d" returned: 0 in 0.792s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:48 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-8891c457-066f-43f7-bfa3-353879c51276 tempest-VolumesGetTest-1550830579 None] <== create_volume: return (1799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:40:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8891c457-066f-43f7-bfa3-353879c51276 tempest-VolumesGetTest-1550830579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.804s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:40:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-c2a580da-b342-427e-8cdf-a40f313b15bb req-e1536a68-866a-4cec-b179-c001a52468f8 tempest-TestInstancesWithCinderVolumes-865228744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:40:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-c2a580da-b342-427e-8cdf-a40f313b15bb req-e1536a68-866a-4cec-b179-c001a52468f8 tempest-TestInstancesWithCinderVolumes-865228744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:40:48 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8891c457-066f-43f7-bfa3-353879c51276 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (228df29c-7eb7-43e7-aefb-2fa27ffb4456) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d020ebca-9abc-4ae8-9e77-cd981b7ae50d', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:40:48 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8891c457-066f-43f7-bfa3-353879c51276 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35064d1e-8c5b-4c77-847e-e17c425f8304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:40:48 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e99194-1a36-4181-b534-cf3008b1bef4]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:40:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-c2a580da-b342-427e-8cdf-a40f313b15bb req-e1536a68-866a-4cec-b179-c001a52468f8 tempest-TestInstancesWithCinderVolumes-865228744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-ed5b7957-ce1a-466c-8010-be34e6ce89fd {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:48 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-8891c457-066f-43f7-bfa3-353879c51276 tempest-VolumesGetTest-1550830579 None] Volume volume-d020ebca-9abc-4ae8-9e77-cd981b7ae50d (d020ebca-9abc-4ae8-9e77-cd981b7ae50d): created successfully Jun 23 16:40:48 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8891c457-066f-43f7-bfa3-353879c51276 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35064d1e-8c5b-4c77-847e-e17c425f8304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:40:48 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8891c457-066f-43f7-bfa3-353879c51276 tempest-VolumesGetTest-1550830579 None] Flow 'volume_create_manager' (bcb4abb8-45ac-4796-bece-6d2c49cc8c05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:40:48 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_clevc_37devstack@QuobyteHD Jun 23 16:40:48 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-8891c457-066f-43f7-bfa3-353879c51276 tempest-VolumesGetTest-1550830579 None] Created volume successfully. Jun 23 16:40:48 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:48 devstack sudo[107001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-ed5b7957-ce1a-466c-8010-be34e6ce89fd Jun 23 16:40:48 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:48 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:48 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-017b0f61-b2b9-4d36-ab22-81867e405cba tempest-VolumesGetTest-1550830579 None] Acquiring lock "cinder-d020ebca-9abc-4ae8-9e77-cd981b7ae50d-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:40:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ae8896ae-13de-452a-824f-579da7566fd4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-25fd90a3-6f4f-4292-8319-fc9d4925af24.6d928acc-70c3-4823-9e31-f3760218b243" returned: 0 in 0.917s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ae8896ae-13de-452a-824f-579da7566fd4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-25fd90a3-6f4f-4292-8319-fc9d4925af24.6d928acc-70c3-4823-9e31-f3760218b243 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:48 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-017b0f61-b2b9-4d36-ab22-81867e405cba tempest-VolumesGetTest-1550830579 None] Lock "cinder-d020ebca-9abc-4ae8-9e77-cd981b7ae50d-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:40:48 devstack sudo[107008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-25fd90a3-6f4f-4292-8319-fc9d4925af24.6d928acc-70c3-4823-9e31-f3760218b243 Jun 23 16:40:48 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:48 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-017b0f61-b2b9-4d36-ab22-81867e405cba tempest-VolumesGetTest-1550830579 None] Acquiring lock "cinder-quobyte-d020ebca-9abc-4ae8-9e77-cd981b7ae50d" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:40:48 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-017b0f61-b2b9-4d36-ab22-81867e405cba tempest-VolumesGetTest-1550830579 None] Lock "cinder-quobyte-d020ebca-9abc-4ae8-9e77-cd981b7ae50d" acquired by "delete_volume" :: waited 0.023s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:40:48 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[954c28b6-b8a3-49de-8e20-6f98d6716028]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:40:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-017b0f61-b2b9-4d36-ab22-81867e405cba tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d020ebca-9abc-4ae8-9e77-cd981b7ae50d {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:48 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d020ebca-9abc-4ae8-9e77-cd981b7ae50d Jun 23 16:40:48 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:49 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_clevc_37devstack@QuobyteHD" returned: 0 in 0.962s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:49 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] 36d19347-ef32-4018-a0b0-67c4eb356ff0 was qcow2, converting to raw {{(pid=93788) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 16:40:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_clevc_37devstack@QuobyteHD /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:49 devstack sudo[107019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_clevc_37devstack@QuobyteHD /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f Jun 23 16:40:49 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:49 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-c2a580da-b342-427e-8cdf-a40f313b15bb req-e1536a68-866a-4cec-b179-c001a52468f8 tempest-TestInstancesWithCinderVolumes-865228744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-ed5b7957-ce1a-466c-8010-be34e6ce89fd" returned: 0 in 0.996s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-c2a580da-b342-427e-8cdf-a40f313b15bb req-e1536a68-866a-4cec-b179-c001a52468f8 tempest-TestInstancesWithCinderVolumes-865228744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.026s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:40:49 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-c2a580da-b342-427e-8cdf-a40f313b15bb req-e1536a68-866a-4cec-b179-c001a52468f8 tempest-TestInstancesWithCinderVolumes-865228744 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e', 'name': 'volume-ed5b7957-ce1a-466c-8010-be34e6ce89fd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e0625fb9-fcf4-4a7d-8f98-d7934338f4d2', 'enforce_multipath': True} {{(pid=93788) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 16:40:49 devstack cinder-volume[93788]: INFO cinder.volume.manager [req-c2a580da-b342-427e-8cdf-a40f313b15bb req-e1536a68-866a-4cec-b179-c001a52468f8 tempest-TestInstancesWithCinderVolumes-865228744 None] attachment_update completed successfully. Jun 23 16:40:49 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ae8896ae-13de-452a-824f-579da7566fd4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-25fd90a3-6f4f-4292-8319-fc9d4925af24.6d928acc-70c3-4823-9e31-f3760218b243" returned: 0 in 0.786s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:49 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ae8896ae-13de-452a-824f-579da7566fd4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Lock "cinder-quobyte-6d928acc-70c3-4823-9e31-f3760218b243" released by "_delete_snapshot" :: held 3.492s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:40:49 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ae8896ae-13de-452a-824f-579da7566fd4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Lock "cinder-quobyte-25fd90a3-6f4f-4292-8319-fc9d4925af24" released by "delete_snapshot" :: held 3.516s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:40:49 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-ae8896ae-13de-452a-824f-579da7566fd4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Created reservations ['53a0bf60-10c1-4524-9335-a19bf19d117c', '6609d632-fb4b-445d-a6a2-de49674db1ad', '8f23ebd5-80f6-4838-8dd4-a8d43d9d3c23', '36b169a0-1d7c-45b5-9221-88279b6efb1f'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:40:49 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-ae8896ae-13de-452a-824f-579da7566fd4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Delete snapshot completed successfully. Jun 23 16:40:49 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ae8896ae-13de-452a-824f-579da7566fd4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Lock "cinder-6d928acc-70c3-4823-9e31-f3760218b243-delete_snapshot" released by "delete_snapshot" :: held 3.674s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:40:49 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-017b0f61-b2b9-4d36-ab22-81867e405cba tempest-VolumesGetTest-1550830579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d020ebca-9abc-4ae8-9e77-cd981b7ae50d" returned: 0 in 0.960s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-017b0f61-b2b9-4d36-ab22-81867e405cba tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d020ebca-9abc-4ae8-9e77-cd981b7ae50d {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:49 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d020ebca-9abc-4ae8-9e77-cd981b7ae50d Jun 23 16:40:49 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:50 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-79c61cf8-5e6f-4b58-8570-2287a3c99a1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Acquiring lock "cinder-25fd90a3-6f4f-4292-8319-fc9d4925af24-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:40:50 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-79c61cf8-5e6f-4b58-8570-2287a3c99a1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Lock "cinder-25fd90a3-6f4f-4292-8319-fc9d4925af24-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:40:50 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-79c61cf8-5e6f-4b58-8570-2287a3c99a1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Acquiring lock "cinder-quobyte-25fd90a3-6f4f-4292-8319-fc9d4925af24" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:40:50 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-79c61cf8-5e6f-4b58-8570-2287a3c99a1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Lock "cinder-quobyte-25fd90a3-6f4f-4292-8319-fc9d4925af24" acquired by "delete_volume" :: waited 0.025s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:40:50 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1360f1db-2b9e-4839-a269-29bd9e3a4753]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:40:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-79c61cf8-5e6f-4b58-8570-2287a3c99a1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-25fd90a3-6f4f-4292-8319-fc9d4925af24 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:50 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-017b0f61-b2b9-4d36-ab22-81867e405cba tempest-VolumesGetTest-1550830579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d020ebca-9abc-4ae8-9e77-cd981b7ae50d" returned: 0 in 0.809s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:50 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-017b0f61-b2b9-4d36-ab22-81867e405cba tempest-VolumesGetTest-1550830579 None] Lock "cinder-quobyte-d020ebca-9abc-4ae8-9e77-cd981b7ae50d" released by "delete_volume" :: held 1.809s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:40:50 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-25fd90a3-6f4f-4292-8319-fc9d4925af24 Jun 23 16:40:50 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:50 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-017b0f61-b2b9-4d36-ab22-81867e405cba tempest-VolumesGetTest-1550830579 None] Created reservations ['c9b04e18-a579-43e4-a2a8-b04a49cebebb', '37949c8f-ffb9-4a4e-a854-6f2658d0bb35', 'ff51433f-9f9f-4982-bc34-baab1ea2df4c', 'bae9442c-2a62-487c-a887-d5e553e6c534'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:40:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-017b0f61-b2b9-4d36-ab22-81867e405cba tempest-VolumesGetTest-1550830579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:40:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-017b0f61-b2b9-4d36-ab22-81867e405cba tempest-VolumesGetTest-1550830579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:40:50 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-017b0f61-b2b9-4d36-ab22-81867e405cba tempest-VolumesGetTest-1550830579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:40:50 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-017b0f61-b2b9-4d36-ab22-81867e405cba tempest-VolumesGetTest-1550830579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:40:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-017b0f61-b2b9-4d36-ab22-81867e405cba tempest-VolumesGetTest-1550830579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:40:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-017b0f61-b2b9-4d36-ab22-81867e405cba tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:50 devstack sudo[107043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:40:50 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:50 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-59f9e961-24f1-4b17-8268-4e1b474b0823 tempest-VolumesGetTest-1550830579 None] Acquiring lock "cinder-1e97b470-4b13-4432-9ba9-1f72191ebeb1-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:40:50 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-59f9e961-24f1-4b17-8268-4e1b474b0823 tempest-VolumesGetTest-1550830579 None] Lock "cinder-1e97b470-4b13-4432-9ba9-1f72191ebeb1-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:40:51 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-59f9e961-24f1-4b17-8268-4e1b474b0823 tempest-VolumesGetTest-1550830579 None] Acquiring lock "cinder-quobyte-1e97b470-4b13-4432-9ba9-1f72191ebeb1" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:40:51 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-59f9e961-24f1-4b17-8268-4e1b474b0823 tempest-VolumesGetTest-1550830579 None] Lock "cinder-quobyte-1e97b470-4b13-4432-9ba9-1f72191ebeb1" acquired by "delete_volume" :: waited 0.023s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:40:51 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a009a6-50d9-4441-9f95-15a09ca92fc5]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:40:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-59f9e961-24f1-4b17-8268-4e1b474b0823 tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1e97b470-4b13-4432-9ba9-1f72191ebeb1 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:51 devstack sudo[107045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1e97b470-4b13-4432-9ba9-1f72191ebeb1 Jun 23 16:40:51 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:51 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_clevc_37devstack@QuobyteHD /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f" returned: 0 in 2.252s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:51 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_clevc_37devstack@QuobyteHD, size 112.00 MB, duration 2.25 sec, destination /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f {{(pid=93788) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 16:40:51 devstack cinder-volume[93788]: INFO cinder.image.image_utils [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] Converted 112.00 MB image at 49.71 MB/s Jun 23 16:40:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f 1G {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:51 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f 1G Jun 23 16:40:51 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:51 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-79c61cf8-5e6f-4b58-8570-2287a3c99a1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-25fd90a3-6f4f-4292-8319-fc9d4925af24" returned: 0 in 1.107s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-79c61cf8-5e6f-4b58-8570-2287a3c99a1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-25fd90a3-6f4f-4292-8319-fc9d4925af24 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:51 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-25fd90a3-6f4f-4292-8319-fc9d4925af24 Jun 23 16:40:51 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:51 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-017b0f61-b2b9-4d36-ab22-81867e405cba tempest-VolumesGetTest-1550830579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.872s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:51 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-017b0f61-b2b9-4d36-ab22-81867e405cba tempest-VolumesGetTest-1550830579 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:40:51 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-017b0f61-b2b9-4d36-ab22-81867e405cba tempest-VolumesGetTest-1550830579 None] Deleted volume successfully. Jun 23 16:40:51 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-017b0f61-b2b9-4d36-ab22-81867e405cba tempest-VolumesGetTest-1550830579 None] Lock "cinder-d020ebca-9abc-4ae8-9e77-cd981b7ae50d-delete_volume" released by "delete_volume" :: held 2.959s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:40:52 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-59f9e961-24f1-4b17-8268-4e1b474b0823 tempest-VolumesGetTest-1550830579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1e97b470-4b13-4432-9ba9-1f72191ebeb1" returned: 0 in 0.889s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-59f9e961-24f1-4b17-8268-4e1b474b0823 tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1e97b470-4b13-4432-9ba9-1f72191ebeb1 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:52 devstack sudo[107062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1e97b470-4b13-4432-9ba9-1f72191ebeb1 Jun 23 16:40:52 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:52 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f 1G" returned: 0 in 0.770s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:52 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[977112a4-5768-4386-b371-c5c00714510b]: (4, 'raw') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:40:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:52 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-79c61cf8-5e6f-4b58-8570-2287a3c99a1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-25fd90a3-6f4f-4292-8319-fc9d4925af24" returned: 0 in 0.738s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:52 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-79c61cf8-5e6f-4b58-8570-2287a3c99a1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Lock "cinder-quobyte-25fd90a3-6f4f-4292-8319-fc9d4925af24" released by "delete_volume" :: held 1.915s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:40:52 devstack sudo[107065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f Jun 23 16:40:52 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:52 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-79c61cf8-5e6f-4b58-8570-2287a3c99a1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Created reservations ['46ed3866-8ab7-43dc-8c79-f7a2f3270ba0', 'd8708a81-2858-4ee4-8f11-faea5837eb51', '37cb93bb-59bb-493a-aac2-2a83a6067f04', 'e568d4d6-d3d1-4c96-9f6e-b6f693aec90c'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:40:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-79c61cf8-5e6f-4b58-8570-2287a3c99a1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:40:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-79c61cf8-5e6f-4b58-8570-2287a3c99a1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:40:52 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-79c61cf8-5e6f-4b58-8570-2287a3c99a1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:40:52 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-79c61cf8-5e6f-4b58-8570-2287a3c99a1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:40:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-79c61cf8-5e6f-4b58-8570-2287a3c99a1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:40:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-79c61cf8-5e6f-4b58-8570-2287a3c99a1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:52 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:40:52 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:52 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-59f9e961-24f1-4b17-8268-4e1b474b0823 tempest-VolumesGetTest-1550830579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1e97b470-4b13-4432-9ba9-1f72191ebeb1" returned: 0 in 0.728s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:52 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-59f9e961-24f1-4b17-8268-4e1b474b0823 tempest-VolumesGetTest-1550830579 None] Lock "cinder-quobyte-1e97b470-4b13-4432-9ba9-1f72191ebeb1" released by "delete_volume" :: held 1.682s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:40:52 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-59f9e961-24f1-4b17-8268-4e1b474b0823 tempest-VolumesGetTest-1550830579 None] Created reservations ['92e4d1f9-a2fd-4fc2-b933-6215fa44ff42', '2e625e69-4372-4c20-9246-2dede03c6fec', '09ff6c3a-5069-4caf-a685-b355ec7df6b8', 'de92de36-8910-4f4c-ad55-6a2eeaa65633'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:40:52 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-59f9e961-24f1-4b17-8268-4e1b474b0823 tempest-VolumesGetTest-1550830579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:40:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-59f9e961-24f1-4b17-8268-4e1b474b0823 tempest-VolumesGetTest-1550830579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:40:52 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-59f9e961-24f1-4b17-8268-4e1b474b0823 tempest-VolumesGetTest-1550830579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:40:52 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-59f9e961-24f1-4b17-8268-4e1b474b0823 tempest-VolumesGetTest-1550830579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:40:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-59f9e961-24f1-4b17-8268-4e1b474b0823 tempest-VolumesGetTest-1550830579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:40:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-59f9e961-24f1-4b17-8268-4e1b474b0823 tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f" returned: 0 in 0.857s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:52 devstack sudo[107072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:40:52 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:53 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f Jun 23 16:40:53 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:53 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:53 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-79c61cf8-5e6f-4b58-8570-2287a3c99a1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.897s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:53 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-79c61cf8-5e6f-4b58-8570-2287a3c99a1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:40:53 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-79c61cf8-5e6f-4b58-8570-2287a3c99a1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Deleted volume successfully. Jun 23 16:40:53 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-79c61cf8-5e6f-4b58-8570-2287a3c99a1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1026078026 None] Lock "cinder-25fd90a3-6f4f-4292-8319-fc9d4925af24-delete_volume" released by "delete_volume" :: held 3.100s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:40:53 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d2e5ba39-e20f-4b2a-81a9-5957d768be2f tempest-VolumesGetTest-1550830579 None] Acquiring lock "cinder-9a0ceb4c-c364-40aa-b2f9-dd870f611cac-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:40:53 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d2e5ba39-e20f-4b2a-81a9-5957d768be2f tempest-VolumesGetTest-1550830579 None] Lock "cinder-9a0ceb4c-c364-40aa-b2f9-dd870f611cac-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:40:53 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d2e5ba39-e20f-4b2a-81a9-5957d768be2f tempest-VolumesGetTest-1550830579 None] Acquiring lock "cinder-quobyte-9a0ceb4c-c364-40aa-b2f9-dd870f611cac" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:40:53 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d2e5ba39-e20f-4b2a-81a9-5957d768be2f tempest-VolumesGetTest-1550830579 None] Lock "cinder-quobyte-9a0ceb4c-c364-40aa-b2f9-dd870f611cac" acquired by "delete_volume" :: waited 0.019s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:40:53 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[47069dd0-6691-4c7a-8d40-6e692aa913a7]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:40:53 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d2e5ba39-e20f-4b2a-81a9-5957d768be2f tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:53 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac Jun 23 16:40:53 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:53 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:53 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-59f9e961-24f1-4b17-8268-4e1b474b0823 tempest-VolumesGetTest-1550830579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.866s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:53 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-59f9e961-24f1-4b17-8268-4e1b474b0823 tempest-VolumesGetTest-1550830579 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:40:53 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-59f9e961-24f1-4b17-8268-4e1b474b0823 tempest-VolumesGetTest-1550830579 None] Deleted volume successfully. Jun 23 16:40:53 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-59f9e961-24f1-4b17-8268-4e1b474b0823 tempest-VolumesGetTest-1550830579 None] Lock "cinder-1e97b470-4b13-4432-9ba9-1f72191ebeb1-delete_volume" released by "delete_volume" :: held 2.868s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:40:53 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:53 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f" returned: 1 in 1.023s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:53 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f' failed. Not Retrying. {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:40:53 devstack cinder-volume[93788]: DEBUG cinder.volume.volume_utils [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] Downloaded image 36d19347-ef32-4018-a0b0-67c4eb356ff0 ((None, [{'url': 'file:///opt/stack/data/glance/images/36d19347-ef32-4018-a0b0-67c4eb356ff0', 'metadata': {}}])) to volume fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f successfully. {{(pid=93788) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 16:40:54 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] Temporary image 36d19347-ef32-4018-a0b0-67c4eb356ff0 for user ac7a402e42d94573bc77828c02e12cb4 is deleted. {{(pid=93788) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 16:40:54 devstack cinder-volume[93788]: DEBUG cinder.volume.volume_utils [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] Marking volume fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f as bootable. {{(pid=93788) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 16:40:54 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] Copying metadata from image 36d19347-ef32-4018-a0b0-67c4eb356ff0 to fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f. {{(pid=93788) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 16:40:54 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] Creating volume glance metadata for volume fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f backed by image 36d19347-ef32-4018-a0b0-67c4eb356ff0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '36d19347-ef32-4018-a0b0-67c4eb356ff0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93788) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 16:40:54 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b65be59e-c69d-494e-962b-2ceae510dae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f', 'volume_size': 1, 'image_id': '36d19347-ef32-4018-a0b0-67c4eb356ff0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/36d19347-ef32-4018-a0b0-67c4eb356ff0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '96f86ae628444b53b4eb7231789566de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '36d19347-ef32-4018-a0b0-67c4eb356ff0', 'created_at': datetime.datetime(2026, 6, 23, 14, 20, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 14, 20, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36d19347-ef32-4018-a0b0-67c4eb356ff0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:40:54 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a432f4c-ce5e-4dc8-8660-beaa83d36cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:40:54 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] Volume volume-fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f (fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f): created successfully Jun 23 16:40:54 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a432f4c-ce5e-4dc8-8660-beaa83d36cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:40:54 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] Flow 'volume_create_manager' (6d16ebf1-17f6-4fa7-b251-4e647377030c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:40:54 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-bd4d4e68-550a-4c37-a5c9-091d83bd10f4 tempest-VolumesExtendTest-1721937786 None] Created volume successfully. Jun 23 16:40:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b1601c20-eb4e-47f1-9bad-7dfdb3096917 tempest-VolumesExtendTest-1721937786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:40:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b1601c20-eb4e-47f1-9bad-7dfdb3096917 tempest-VolumesExtendTest-1721937786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:40:54 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:54 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff73f0f2-557c-4bd2-af71-26986ac5e0f7]: (4, 'raw') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:40:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b1601c20-eb4e-47f1-9bad-7dfdb3096917 tempest-VolumesExtendTest-1721937786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d2e5ba39-e20f-4b2a-81a9-5957d768be2f tempest-VolumesGetTest-1550830579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac" returned: 0 in 1.081s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d2e5ba39-e20f-4b2a-81a9-5957d768be2f tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:54 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac Jun 23 16:40:54 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:54 devstack sudo[107095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f Jun 23 16:40:54 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:55 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b1601c20-eb4e-47f1-9bad-7dfdb3096917 tempest-VolumesExtendTest-1721937786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f" returned: 0 in 0.846s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b1601c20-eb4e-47f1-9bad-7dfdb3096917 tempest-VolumesExtendTest-1721937786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:55 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d2e5ba39-e20f-4b2a-81a9-5957d768be2f tempest-VolumesGetTest-1550830579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9a0ceb4c-c364-40aa-b2f9-dd870f611cac" returned: 0 in 0.919s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:55 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d2e5ba39-e20f-4b2a-81a9-5957d768be2f tempest-VolumesGetTest-1550830579 None] Lock "cinder-quobyte-9a0ceb4c-c364-40aa-b2f9-dd870f611cac" released by "delete_volume" :: held 2.092s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:40:55 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f Jun 23 16:40:55 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:55 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-d2e5ba39-e20f-4b2a-81a9-5957d768be2f tempest-VolumesGetTest-1550830579 None] Created reservations ['8a84eb19-f0a8-4673-a538-4a768a1dfcca', '6493f6c0-1385-4be8-bfe2-ac550bd37379', 'ae555d17-6649-4c90-a13f-1ce6b176079f', '81c49351-e76d-4cc6-a859-f177cd418064'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:40:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d2e5ba39-e20f-4b2a-81a9-5957d768be2f tempest-VolumesGetTest-1550830579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:40:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d2e5ba39-e20f-4b2a-81a9-5957d768be2f tempest-VolumesGetTest-1550830579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:40:55 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-d2e5ba39-e20f-4b2a-81a9-5957d768be2f tempest-VolumesGetTest-1550830579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:40:55 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-d2e5ba39-e20f-4b2a-81a9-5957d768be2f tempest-VolumesGetTest-1550830579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:40:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d2e5ba39-e20f-4b2a-81a9-5957d768be2f tempest-VolumesGetTest-1550830579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:40:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d2e5ba39-e20f-4b2a-81a9-5957d768be2f tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:55 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:40:55 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:56 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b1601c20-eb4e-47f1-9bad-7dfdb3096917 tempest-VolumesExtendTest-1721937786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f" returned: 1 in 1.028s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b1601c20-eb4e-47f1-9bad-7dfdb3096917 tempest-VolumesExtendTest-1721937786 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f' failed. Not Retrying. {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:40:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b1601c20-eb4e-47f1-9bad-7dfdb3096917 tempest-VolumesExtendTest-1721937786 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f 2G {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b1601c20-eb4e-47f1-9bad-7dfdb3096917 tempest-VolumesExtendTest-1721937786 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f 2G" returned: 0 in 0.092s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b1601c20-eb4e-47f1-9bad-7dfdb3096917 tempest-VolumesExtendTest-1721937786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.029s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:40:56 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d2e5ba39-e20f-4b2a-81a9-5957d768be2f tempest-VolumesGetTest-1550830579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.771s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:56 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-d2e5ba39-e20f-4b2a-81a9-5957d768be2f tempest-VolumesGetTest-1550830579 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:40:56 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-d2e5ba39-e20f-4b2a-81a9-5957d768be2f tempest-VolumesGetTest-1550830579 None] Deleted volume successfully. Jun 23 16:40:56 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d2e5ba39-e20f-4b2a-81a9-5957d768be2f tempest-VolumesGetTest-1550830579 None] Lock "cinder-9a0ceb4c-c364-40aa-b2f9-dd870f611cac-delete_volume" released by "delete_volume" :: held 3.230s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:40:56 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-b1601c20-eb4e-47f1-9bad-7dfdb3096917 tempest-VolumesExtendTest-1721937786 None] Extend volume completed successfully. Jun 23 16:40:57 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d27fc133-03ee-49c9-bd17-0062b5c46557 tempest-VolumesExtendTest-1721937786 None] Acquiring lock "cinder-fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:40:57 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d27fc133-03ee-49c9-bd17-0062b5c46557 tempest-VolumesExtendTest-1721937786 None] Lock "cinder-fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:40:57 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d27fc133-03ee-49c9-bd17-0062b5c46557 tempest-VolumesExtendTest-1721937786 None] Acquiring lock "cinder-quobyte-fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:40:57 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d27fc133-03ee-49c9-bd17-0062b5c46557 tempest-VolumesExtendTest-1721937786 None] Lock "cinder-quobyte-fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f" acquired by "delete_volume" :: waited 0.019s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:40:57 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd933563-148e-4f14-b6d7-bb1c8aa4f82a]: (4, 'raw') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:40:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d27fc133-03ee-49c9-bd17-0062b5c46557 tempest-VolumesExtendTest-1721937786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:57 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f Jun 23 16:40:57 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:57 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:40:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] Flow 'volume_create_manager' (22a52f36-6765-4f47-b008-19132098a02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:40:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9603250f-c1d3-4184-bc5a-0aed0d1f49e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:40:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9603250f-c1d3-4184-bc5a-0aed0d1f49e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-528056698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08e05ac8-3bef-44f1-b5b2-1d8675d9cd6d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7e0c6765fc6c450aa7d0be9b768dc1f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:40:58Z,use_quota=True,user_id='a0eda2b8c0f54a9cb23869514ffecda4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:40:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (045ebdb5-dc81-43a8-b6c4-178638041a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:40:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (045ebdb5-dc81-43a8-b6c4-178638041a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:40:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57406ec4-412c-427c-bd90-8a1c147c95b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:40:58 devstack cinder-volume[93788]: DEBUG cinder.image.glance [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] Creating Keystone auth plugin from conf {{(pid=93788) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 16:40:58 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d27fc133-03ee-49c9-bd17-0062b5c46557 tempest-VolumesExtendTest-1721937786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f" returned: 0 in 0.908s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d27fc133-03ee-49c9-bd17-0062b5c46557 tempest-VolumesExtendTest-1721937786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:58 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f Jun 23 16:40:58 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57406ec4-412c-427c-bd90-8a1c147c95b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '08e05ac8-3bef-44f1-b5b2-1d8675d9cd6d', 'volume_name': 'volume-08e05ac8-3bef-44f1-b5b2-1d8675d9cd6d', 'volume_size': 1, 'image_id': '36d19347-ef32-4018-a0b0-67c4eb356ff0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/36d19347-ef32-4018-a0b0-67c4eb356ff0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '96f86ae628444b53b4eb7231789566de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '36d19347-ef32-4018-a0b0-67c4eb356ff0', 'created_at': datetime.datetime(2026, 6, 23, 14, 20, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 14, 20, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36d19347-ef32-4018-a0b0-67c4eb356ff0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:40:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (348109c1-2a16-40bf-8cb4-bfd9050982ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:40:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (348109c1-2a16-40bf-8cb4-bfd9050982ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:40:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa527419-2050-42fd-bdef-c4b5a1afaf85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:40:58 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] Volume 08e05ac8-3bef-44f1-b5b2-1d8675d9cd6d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-08e05ac8-3bef-44f1-b5b2-1d8675d9cd6d', 'volume_size': 1, 'image_id': '36d19347-ef32-4018-a0b0-67c4eb356ff0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/36d19347-ef32-4018-a0b0-67c4eb356ff0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '96f86ae628444b53b4eb7231789566de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '36d19347-ef32-4018-a0b0-67c4eb356ff0', 'created_at': datetime.datetime(2026, 6, 23, 14, 20, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 14, 20, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36d19347-ef32-4018-a0b0-67c4eb356ff0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 23 16:40:58 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] Trying to clone 08e05ac8-3bef-44f1-b5b2-1d8675d9cd6d from image 36d19347-ef32-4018-a0b0-67c4eb356ff0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/36d19347-ef32-4018-a0b0-67c4eb356ff0', 'metadata': {}}]). {{(pid=93788) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 16:40:59 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_fgvigt0rdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93788) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 16:40:59 devstack cinder-volume[93788]: INFO cinder.image.image_utils [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] Image download 20.69 MB at 20.69 MB/s Jun 23 16:40:59 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d27fc133-03ee-49c9-bd17-0062b5c46557 tempest-VolumesExtendTest-1721937786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f" returned: 1 in 0.895s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d27fc133-03ee-49c9-bd17-0062b5c46557 tempest-VolumesExtendTest-1721937786 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f' failed. Not Retrying. {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:40:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d27fc133-03ee-49c9-bd17-0062b5c46557 tempest-VolumesExtendTest-1721937786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:59 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ceb72a-7bb7-403f-b896-0f419674d91e]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:40:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_fgvigt0rdevstack@QuobyteHD {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:40:59 devstack sudo[107147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f Jun 23 16:40:59 devstack sudo[107147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:59 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_fgvigt0rdevstack@QuobyteHD Jun 23 16:40:59 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:40:59 devstack sudo[107147]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d27fc133-03ee-49c9-bd17-0062b5c46557 tempest-VolumesExtendTest-1721937786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f" returned: 0 in 0.702s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:59 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d27fc133-03ee-49c9-bd17-0062b5c46557 tempest-VolumesExtendTest-1721937786 None] Lock "cinder-quobyte-fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f" released by "delete_volume" :: held 2.607s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:40:59 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-d27fc133-03ee-49c9-bd17-0062b5c46557 tempest-VolumesExtendTest-1721937786 None] Created reservations ['dbde1127-6a7d-417c-a9d3-ef5d843ff1ef', '98934f3f-982c-4653-9094-59ea5a2d6a10', '12ea0cfe-9a0a-4d51-afac-7ebd6617c10e', '7344f5da-b1b7-44c0-8f4a-4df13119365f'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:40:59 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Jun 23 16:40:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_fgvigt0rdevstack@QuobyteHD" returned: 0 in 0.814s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:40:59 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] Temporary image 36d19347-ef32-4018-a0b0-67c4eb356ff0 is fetched for user a0eda2b8c0f54a9cb23869514ffecda4. {{(pid=93788) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 16:41:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d27fc133-03ee-49c9-bd17-0062b5c46557 tempest-VolumesExtendTest-1721937786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:41:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d27fc133-03ee-49c9-bd17-0062b5c46557 tempest-VolumesExtendTest-1721937786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:41:00 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-d27fc133-03ee-49c9-bd17-0062b5c46557 tempest-VolumesExtendTest-1721937786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:41:00 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-d27fc133-03ee-49c9-bd17-0062b5c46557 tempest-VolumesExtendTest-1721937786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:41:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d27fc133-03ee-49c9-bd17-0062b5c46557 tempest-VolumesExtendTest-1721937786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:41:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d27fc133-03ee-49c9-bd17-0062b5c46557 tempest-VolumesExtendTest-1721937786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:00 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6baa8f5f-a37b-46b8-a7b0-6cc821c76cce]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:41:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_fgvigt0rdevstack@QuobyteHD {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:00 devstack sudo[107159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:41:00 devstack sudo[107159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:00 devstack sudo[107162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_fgvigt0rdevstack@QuobyteHD Jun 23 16:41:00 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:00 devstack cinder-volume[93788]: INFO cinder.volume.manager [req-6435d07f-5a80-40ed-a616-745b719598bf req-c054fc74-ab34-4229-a9e4-ae775ec378a1 tempest-TestInstancesWithCinderVolumes-865228744 None] Terminate volume connection completed successfully. Jun 23 16:41:00 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-6435d07f-5a80-40ed-a616-745b719598bf req-c054fc74-ab34-4229-a9e4-ae775ec378a1 tempest-TestInstancesWithCinderVolumes-865228744 None] Deleting attachment 371f4487-c68d-4cf9-9d25-5d9bc0dab7fe. {{(pid=93788) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 16:41:00 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d5989ad-fade-4fa3-b941-5f480f2614c0 tempest-VolumeTypesAccessTest-1629431127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:41:00 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-7d5989ad-fade-4fa3-b941-5f480f2614c0 tempest-VolumeTypesAccessTest-1629431127 None] Flow 'volume_create_manager' (ac25d59f-075c-47cc-9a92-65cf592125ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:41:00 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-7d5989ad-fade-4fa3-b941-5f480f2614c0 tempest-VolumeTypesAccessTest-1629431127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b31a9f2e-6610-4c7e-9c8e-796f7b4f9ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:00 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-7d5989ad-fade-4fa3-b941-5f480f2614c0 tempest-VolumeTypesAccessTest-1629431127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b31a9f2e-6610-4c7e-9c8e-796f7b4f9ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-633259208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2408878-bf1b-4d73-bfe4-46a7e32604d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a67c404237984ed68cc6440f415d59f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:41:00Z,use_quota=True,user_id='176a187f7af94f06aa61cd68cb2d0ee3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0f2f461-58aa-4885-a02b-3f193237d7d5),volume_type_id=a0f2f461-58aa-4885-a02b-3f193237d7d5)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:00 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-7d5989ad-fade-4fa3-b941-5f480f2614c0 tempest-VolumeTypesAccessTest-1629431127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08352ccb-a92c-4765-8087-70916d0547a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:00 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-7d5989ad-fade-4fa3-b941-5f480f2614c0 tempest-VolumeTypesAccessTest-1629431127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08352ccb-a92c-4765-8087-70916d0547a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:00 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-7d5989ad-fade-4fa3-b941-5f480f2614c0 tempest-VolumeTypesAccessTest-1629431127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc462d8e-a14c-491e-8a34-cee8624ac6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:00 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-7d5989ad-fade-4fa3-b941-5f480f2614c0 tempest-VolumeTypesAccessTest-1629431127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc462d8e-a14c-491e-8a34-cee8624ac6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2408878-bf1b-4d73-bfe4-46a7e32604d2', 'volume_name': 'volume-a2408878-bf1b-4d73-bfe4-46a7e32604d2', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:00 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-7d5989ad-fade-4fa3-b941-5f480f2614c0 tempest-VolumeTypesAccessTest-1629431127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b680291-ff23-47aa-8ca3-471fa5137f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:00 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-7d5989ad-fade-4fa3-b941-5f480f2614c0 tempest-VolumeTypesAccessTest-1629431127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b680291-ff23-47aa-8ca3-471fa5137f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:00 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-7d5989ad-fade-4fa3-b941-5f480f2614c0 tempest-VolumeTypesAccessTest-1629431127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (209725cd-9729-428a-9bf6-14c02a7584b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:00 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-7d5989ad-fade-4fa3-b941-5f480f2614c0 tempest-VolumeTypesAccessTest-1629431127 None] Volume a2408878-bf1b-4d73-bfe4-46a7e32604d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2408878-bf1b-4d73-bfe4-46a7e32604d2', 'volume_size': 1} Jun 23 16:41:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-7d5989ad-fade-4fa3-b941-5f480f2614c0 tempest-VolumeTypesAccessTest-1629431127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:41:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-7d5989ad-fade-4fa3-b941-5f480f2614c0 tempest-VolumeTypesAccessTest-1629431127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:41:00 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-7d5989ad-fade-4fa3-b941-5f480f2614c0 tempest-VolumeTypesAccessTest-1629431127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-633259208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2408878-bf1b-4d73-bfe4-46a7e32604d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a67c404237984ed68cc6440f415d59f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:41:00Z,use_quota=True,user_id='176a187f7af94f06aa61cd68cb2d0ee3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0f2f461-58aa-4885-a02b-3f193237d7d5),volume_type_id=a0f2f461-58aa-4885-a02b-3f193237d7d5)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:41:00 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-7d5989ad-fade-4fa3-b941-5f480f2614c0 tempest-VolumeTypesAccessTest-1629431127 None] Creating volume a2408878-bf1b-4d73-bfe4-46a7e32604d2 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:41:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-7d5989ad-fade-4fa3-b941-5f480f2614c0 tempest-VolumeTypesAccessTest-1629431127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:41:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-7d5989ad-fade-4fa3-b941-5f480f2614c0 tempest-VolumeTypesAccessTest-1629431127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:41:00 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-7d5989ad-fade-4fa3-b941-5f480f2614c0 tempest-VolumeTypesAccessTest-1629431127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:41:00 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-7d5989ad-fade-4fa3-b941-5f480f2614c0 tempest-VolumeTypesAccessTest-1629431127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:41:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-7d5989ad-fade-4fa3-b941-5f480f2614c0 tempest-VolumeTypesAccessTest-1629431127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:41:00 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-7d5989ad-fade-4fa3-b941-5f480f2614c0 tempest-VolumeTypesAccessTest-1629431127 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:41:00 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-7d5989ad-fade-4fa3-b941-5f480f2614c0 tempest-VolumeTypesAccessTest-1629431127 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:41:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-7d5989ad-fade-4fa3-b941-5f480f2614c0 tempest-VolumeTypesAccessTest-1629431127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-a2408878-bf1b-4d73-bfe4-46a7e32604d2 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:00 devstack sudo[107165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-a2408878-bf1b-4d73-bfe4-46a7e32604d2 1073741824 Jun 23 16:41:00 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:00 devstack sudo[107159]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d27fc133-03ee-49c9-bd17-0062b5c46557 tempest-VolumesExtendTest-1721937786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.710s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:00 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-d27fc133-03ee-49c9-bd17-0062b5c46557 tempest-VolumesExtendTest-1721937786 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:41:00 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-d27fc133-03ee-49c9-bd17-0062b5c46557 tempest-VolumesExtendTest-1721937786 None] Deleted volume successfully. Jun 23 16:41:00 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d27fc133-03ee-49c9-bd17-0062b5c46557 tempest-VolumesExtendTest-1721937786 None] Lock "cinder-fe5f5c38-7c9c-4c61-bc15-0e6c1292f02f-delete_volume" released by "delete_volume" :: held 3.668s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:41:01 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_fgvigt0rdevstack@QuobyteHD" returned: 0 in 0.980s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:41:01 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8cf17fd-df68-4e7c-8a57-91ce94c74979 tempest-VolumesExtendTest-1721937786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:41:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a8cf17fd-df68-4e7c-8a57-91ce94c74979 tempest-VolumesExtendTest-1721937786 None] Flow 'volume_create_manager' (b90d6fd3-6269-48d4-8923-2d99422cf381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:41:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a8cf17fd-df68-4e7c-8a57-91ce94c74979 tempest-VolumesExtendTest-1721937786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (123ad0b4-269d-4970-a550-b4f70f3c9c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a8cf17fd-df68-4e7c-8a57-91ce94c74979 tempest-VolumesExtendTest-1721937786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (123ad0b4-269d-4970-a550-b4f70f3c9c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2013103801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83af8e5e-b4b4-4eee-bd13-f2f92cb73828,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8f29b0b2e5a460b9c5fb6abe4779332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:41:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:41:01Z,use_quota=True,user_id='ac7a402e42d94573bc77828c02e12cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a8cf17fd-df68-4e7c-8a57-91ce94c74979 tempest-VolumesExtendTest-1721937786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38457897-ce92-46e0-b33a-2f3218e1c038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a8cf17fd-df68-4e7c-8a57-91ce94c74979 tempest-VolumesExtendTest-1721937786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38457897-ce92-46e0-b33a-2f3218e1c038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a8cf17fd-df68-4e7c-8a57-91ce94c74979 tempest-VolumesExtendTest-1721937786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb9bb4d3-3829-4ef1-af96-c4178fda1d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a8cf17fd-df68-4e7c-8a57-91ce94c74979 tempest-VolumesExtendTest-1721937786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb9bb4d3-3829-4ef1-af96-c4178fda1d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83af8e5e-b4b4-4eee-bd13-f2f92cb73828', 'volume_name': 'volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a8cf17fd-df68-4e7c-8a57-91ce94c74979 tempest-VolumesExtendTest-1721937786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66d06773-77b5-4f32-af83-353bf113836e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a8cf17fd-df68-4e7c-8a57-91ce94c74979 tempest-VolumesExtendTest-1721937786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66d06773-77b5-4f32-af83-353bf113836e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a8cf17fd-df68-4e7c-8a57-91ce94c74979 tempest-VolumesExtendTest-1721937786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ce0dbfa-a252-4f5a-a76f-f10ed4c51a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:01 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-a8cf17fd-df68-4e7c-8a57-91ce94c74979 tempest-VolumesExtendTest-1721937786 None] Volume 83af8e5e-b4b4-4eee-bd13-f2f92cb73828: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828', 'volume_size': 1} Jun 23 16:41:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a8cf17fd-df68-4e7c-8a57-91ce94c74979 tempest-VolumesExtendTest-1721937786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:41:01 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:41:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:41:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:41:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:41:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:41:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:41:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:01 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-7d5989ad-fade-4fa3-b941-5f480f2614c0 tempest-VolumeTypesAccessTest-1629431127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-a2408878-bf1b-4d73-bfe4-46a7e32604d2 1073741824" returned: 0 in 1.027s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:01 devstack sudo[107175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:41:01 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-7d5989ad-fade-4fa3-b941-5f480f2614c0 tempest-VolumeTypesAccessTest-1629431127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-a2408878-bf1b-4d73-bfe4-46a7e32604d2 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:01 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-a2408878-bf1b-4d73-bfe4-46a7e32604d2 Jun 23 16:41:01 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:02 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-42f03da2-5952-4976-845d-d8301f02f523 tempest-TestInstancesWithCinderVolumes-865228744 None] Acquiring lock "cinder-f6a5072e-4d4d-4303-8a1b-ef8b7dc46562-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:41:02 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-42f03da2-5952-4976-845d-d8301f02f523 tempest-TestInstancesWithCinderVolumes-865228744 None] Lock "cinder-f6a5072e-4d4d-4303-8a1b-ef8b7dc46562-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:41:02 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.705s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:02 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:41:02 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager._thread_info {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:41:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread count: 28 {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 16:41:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread info: [<_MainThread(MainThread, started 126303828988032)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 16:41:02 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-42f03da2-5952-4976-845d-d8301f02f523 tempest-TestInstancesWithCinderVolumes-865228744 None] Acquiring lock "cinder-quobyte-f6a5072e-4d4d-4303-8a1b-ef8b7dc46562" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:41:02 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-42f03da2-5952-4976-845d-d8301f02f523 tempest-TestInstancesWithCinderVolumes-865228744 None] Lock "cinder-quobyte-f6a5072e-4d4d-4303-8a1b-ef8b7dc46562" acquired by "delete_volume" :: waited 0.015s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:41:02 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[284180b5-34ef-4b70-b05b-a001eb9cb5fc]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:41:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-42f03da2-5952-4976-845d-d8301f02f523 tempest-TestInstancesWithCinderVolumes-865228744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f6a5072e-4d4d-4303-8a1b-ef8b7dc46562 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:02 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-7d5989ad-fade-4fa3-b941-5f480f2614c0 tempest-VolumeTypesAccessTest-1629431127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-a2408878-bf1b-4d73-bfe4-46a7e32604d2" returned: 0 in 0.730s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:02 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-7d5989ad-fade-4fa3-b941-5f480f2614c0 tempest-VolumeTypesAccessTest-1629431127 None] <== create_volume: return (1810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:41:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-7d5989ad-fade-4fa3-b941-5f480f2614c0 tempest-VolumeTypesAccessTest-1629431127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.813s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:41:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.150s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:41:02 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-528056698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08e05ac8-3bef-44f1-b5b2-1d8675d9cd6d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7e0c6765fc6c450aa7d0be9b768dc1f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:40:58Z,use_quota=True,user_id='a0eda2b8c0f54a9cb23869514ffecda4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:41:02 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] Creating volume 08e05ac8-3bef-44f1-b5b2-1d8675d9cd6d {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:41:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:41:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:41:02 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:41:02 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:41:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:41:02 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:41:02 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:41:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-08e05ac8-3bef-44f1-b5b2-1d8675d9cd6d 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:02 devstack sudo[107186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-08e05ac8-3bef-44f1-b5b2-1d8675d9cd6d 1073741824 Jun 23 16:41:02 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-7d5989ad-fade-4fa3-b941-5f480f2614c0 tempest-VolumeTypesAccessTest-1629431127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (209725cd-9729-428a-9bf6-14c02a7584b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2408878-bf1b-4d73-bfe4-46a7e32604d2', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-7d5989ad-fade-4fa3-b941-5f480f2614c0 tempest-VolumeTypesAccessTest-1629431127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5242aa4e-3c6f-421c-82dc-43a8d50ce67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:02 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-7d5989ad-fade-4fa3-b941-5f480f2614c0 tempest-VolumeTypesAccessTest-1629431127 None] Volume volume-a2408878-bf1b-4d73-bfe4-46a7e32604d2 (a2408878-bf1b-4d73-bfe4-46a7e32604d2): created successfully Jun 23 16:41:02 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f6a5072e-4d4d-4303-8a1b-ef8b7dc46562 Jun 23 16:41:02 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-7d5989ad-fade-4fa3-b941-5f480f2614c0 tempest-VolumeTypesAccessTest-1629431127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5242aa4e-3c6f-421c-82dc-43a8d50ce67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-7d5989ad-fade-4fa3-b941-5f480f2614c0 tempest-VolumeTypesAccessTest-1629431127 None] Flow 'volume_create_manager' (ac25d59f-075c-47cc-9a92-65cf592125ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:41:02 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-7d5989ad-fade-4fa3-b941-5f480f2614c0 tempest-VolumeTypesAccessTest-1629431127 None] Created volume successfully. Jun 23 16:41:03 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-42f03da2-5952-4976-845d-d8301f02f523 tempest-TestInstancesWithCinderVolumes-865228744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f6a5072e-4d4d-4303-8a1b-ef8b7dc46562" returned: 0 in 0.918s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-42f03da2-5952-4976-845d-d8301f02f523 tempest-TestInstancesWithCinderVolumes-865228744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f6a5072e-4d4d-4303-8a1b-ef8b7dc46562 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:03 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f6a5072e-4d4d-4303-8a1b-ef8b7dc46562 Jun 23 16:41:03 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:03 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-08e05ac8-3bef-44f1-b5b2-1d8675d9cd6d 1073741824" returned: 0 in 0.951s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-08e05ac8-3bef-44f1-b5b2-1d8675d9cd6d {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:03 devstack sudo[107198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-08e05ac8-3bef-44f1-b5b2-1d8675d9cd6d Jun 23 16:41:03 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:03 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e6b697cc-a8d0-4682-9f62-559b82ab8945 tempest-VolumeTypesAccessTest-1629431127 None] Acquiring lock "cinder-a2408878-bf1b-4d73-bfe4-46a7e32604d2-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:41:03 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e6b697cc-a8d0-4682-9f62-559b82ab8945 tempest-VolumeTypesAccessTest-1629431127 None] Lock "cinder-a2408878-bf1b-4d73-bfe4-46a7e32604d2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:41:03 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e6b697cc-a8d0-4682-9f62-559b82ab8945 tempest-VolumeTypesAccessTest-1629431127 None] Acquiring lock "cinder-quobyte-a2408878-bf1b-4d73-bfe4-46a7e32604d2" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:41:03 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e6b697cc-a8d0-4682-9f62-559b82ab8945 tempest-VolumeTypesAccessTest-1629431127 None] Lock "cinder-quobyte-a2408878-bf1b-4d73-bfe4-46a7e32604d2" acquired by "delete_volume" :: waited 0.014s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:41:03 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[7370f6ca-24ae-40f0-87a5-a1d4b992f684]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:41:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e6b697cc-a8d0-4682-9f62-559b82ab8945 tempest-VolumeTypesAccessTest-1629431127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-a2408878-bf1b-4d73-bfe4-46a7e32604d2 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:03 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-a2408878-bf1b-4d73-bfe4-46a7e32604d2 Jun 23 16:41:03 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:03 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-42f03da2-5952-4976-845d-d8301f02f523 tempest-TestInstancesWithCinderVolumes-865228744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f6a5072e-4d4d-4303-8a1b-ef8b7dc46562" returned: 0 in 0.801s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:03 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-42f03da2-5952-4976-845d-d8301f02f523 tempest-TestInstancesWithCinderVolumes-865228744 None] Lock "cinder-quobyte-f6a5072e-4d4d-4303-8a1b-ef8b7dc46562" released by "delete_volume" :: held 1.798s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:41:03 devstack cinder-volume[93788]: WARNING cinder.quota [None req-42f03da2-5952-4976-845d-d8301f02f523 tempest-TestInstancesWithCinderVolumes-865228744 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-190600292-1682539045 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-190600292-1682539045, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:41:03 devstack cinder-volume[93788]: WARNING cinder.quota [None req-42f03da2-5952-4976-845d-d8301f02f523 tempest-TestInstancesWithCinderVolumes-865228744 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-190600292-1682539045 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-190600292-1682539045, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:41:03 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-08e05ac8-3bef-44f1-b5b2-1d8675d9cd6d" returned: 0 in 0.794s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:03 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] <== create_volume: return (1793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:41:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.796s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:41:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a8cf17fd-df68-4e7c-8a57-91ce94c74979 tempest-VolumesExtendTest-1721937786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.774s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:41:03 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-a8cf17fd-df68-4e7c-8a57-91ce94c74979 tempest-VolumesExtendTest-1721937786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2013103801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83af8e5e-b4b4-4eee-bd13-f2f92cb73828,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8f29b0b2e5a460b9c5fb6abe4779332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:41:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:41:01Z,use_quota=True,user_id='ac7a402e42d94573bc77828c02e12cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:41:03 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-a8cf17fd-df68-4e7c-8a57-91ce94c74979 tempest-VolumesExtendTest-1721937786 None] Creating volume 83af8e5e-b4b4-4eee-bd13-f2f92cb73828 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:41:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a8cf17fd-df68-4e7c-8a57-91ce94c74979 tempest-VolumesExtendTest-1721937786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:41:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a8cf17fd-df68-4e7c-8a57-91ce94c74979 tempest-VolumesExtendTest-1721937786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:41:03 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-a8cf17fd-df68-4e7c-8a57-91ce94c74979 tempest-VolumesExtendTest-1721937786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:41:03 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-a8cf17fd-df68-4e7c-8a57-91ce94c74979 tempest-VolumesExtendTest-1721937786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:41:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a8cf17fd-df68-4e7c-8a57-91ce94c74979 tempest-VolumesExtendTest-1721937786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:41:03 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-a8cf17fd-df68-4e7c-8a57-91ce94c74979 tempest-VolumesExtendTest-1721937786 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:41:03 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-a8cf17fd-df68-4e7c-8a57-91ce94c74979 tempest-VolumesExtendTest-1721937786 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:41:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a8cf17fd-df68-4e7c-8a57-91ce94c74979 tempest-VolumesExtendTest-1721937786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:04 devstack sudo[107206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828 1073741824 Jun 23 16:41:04 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:04 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-42f03da2-5952-4976-845d-d8301f02f523 tempest-TestInstancesWithCinderVolumes-865228744 None] Created reservations ['807a17c2-0702-4604-bbda-2b2dcf1437db', 'f52f1692-4aa9-4312-a4ac-1786e98e218b', 'b8065fda-2ec3-4350-bda9-9429642af948', '2290efc7-2df4-4123-b737-3a35656e7109'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:41:04 devstack cinder-volume[93788]: DEBUG cinder.volume.volume_utils [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] Attempting download of 36d19347-ef32-4018-a0b0-67c4eb356ff0 ((None, [{'url': 'file:///opt/stack/data/glance/images/36d19347-ef32-4018-a0b0-67c4eb356ff0', 'metadata': {}}])) to volume 08e05ac8-3bef-44f1-b5b2-1d8675d9cd6d. {{(pid=93788) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 16:41:04 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada386b6-8985-4818-926b-987802016e5d]: (4, 'raw') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:41:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36d19347-ef32-4018-a0b0-67c4eb356ff0__dul774s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-42f03da2-5952-4976-845d-d8301f02f523 tempest-TestInstancesWithCinderVolumes-865228744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:41:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-42f03da2-5952-4976-845d-d8301f02f523 tempest-TestInstancesWithCinderVolumes-865228744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:41:04 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-42f03da2-5952-4976-845d-d8301f02f523 tempest-TestInstancesWithCinderVolumes-865228744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:41:04 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-42f03da2-5952-4976-845d-d8301f02f523 tempest-TestInstancesWithCinderVolumes-865228744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:41:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-42f03da2-5952-4976-845d-d8301f02f523 tempest-TestInstancesWithCinderVolumes-865228744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:41:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-42f03da2-5952-4976-845d-d8301f02f523 tempest-TestInstancesWithCinderVolumes-865228744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:04 devstack sudo[107211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:41:04 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:04 devstack sudo[107210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36d19347-ef32-4018-a0b0-67c4eb356ff0__dul774s Jun 23 16:41:04 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:04 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e6b697cc-a8d0-4682-9f62-559b82ab8945 tempest-VolumeTypesAccessTest-1629431127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-a2408878-bf1b-4d73-bfe4-46a7e32604d2" returned: 0 in 1.170s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e6b697cc-a8d0-4682-9f62-559b82ab8945 tempest-VolumeTypesAccessTest-1629431127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-a2408878-bf1b-4d73-bfe4-46a7e32604d2 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:04 devstack sudo[107230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-a2408878-bf1b-4d73-bfe4-46a7e32604d2 Jun 23 16:41:04 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:05 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36d19347-ef32-4018-a0b0-67c4eb356ff0__dul774s" returned: 0 in 0.910s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36d19347-ef32-4018-a0b0-67c4eb356ff0__dul774s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:05 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-42f03da2-5952-4976-845d-d8301f02f523 tempest-TestInstancesWithCinderVolumes-865228744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.948s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:05 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-42f03da2-5952-4976-845d-d8301f02f523 tempest-TestInstancesWithCinderVolumes-865228744 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:41:05 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-42f03da2-5952-4976-845d-d8301f02f523 tempest-TestInstancesWithCinderVolumes-865228744 None] Deleted volume successfully. Jun 23 16:41:05 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-42f03da2-5952-4976-845d-d8301f02f523 tempest-TestInstancesWithCinderVolumes-865228744 None] Lock "cinder-f6a5072e-4d4d-4303-8a1b-ef8b7dc46562-delete_volume" released by "delete_volume" :: held 3.137s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:41:05 devstack sudo[107242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36d19347-ef32-4018-a0b0-67c4eb356ff0__dul774s Jun 23 16:41:05 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:05 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a8cf17fd-df68-4e7c-8a57-91ce94c74979 tempest-VolumesExtendTest-1721937786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828 1073741824" returned: 0 in 1.354s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a8cf17fd-df68-4e7c-8a57-91ce94c74979 tempest-VolumesExtendTest-1721937786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:05 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828 Jun 23 16:41:05 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:05 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e6b697cc-a8d0-4682-9f62-559b82ab8945 tempest-VolumeTypesAccessTest-1629431127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-a2408878-bf1b-4d73-bfe4-46a7e32604d2" returned: 0 in 0.755s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:05 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e6b697cc-a8d0-4682-9f62-559b82ab8945 tempest-VolumeTypesAccessTest-1629431127 None] Lock "cinder-quobyte-a2408878-bf1b-4d73-bfe4-46a7e32604d2" released by "delete_volume" :: held 1.982s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:41:05 devstack cinder-volume[93788]: WARNING cinder.quota [None req-e6b697cc-a8d0-4682-9f62-559b82ab8945 tempest-VolumeTypesAccessTest-1629431127 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1742647174 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1742647174, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:41:05 devstack cinder-volume[93788]: WARNING cinder.quota [None req-e6b697cc-a8d0-4682-9f62-559b82ab8945 tempest-VolumeTypesAccessTest-1629431127 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1742647174 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1742647174, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:41:05 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-e6b697cc-a8d0-4682-9f62-559b82ab8945 tempest-VolumeTypesAccessTest-1629431127 None] Created reservations ['e5356d46-245c-4c33-bb62-3d7360c558ec', 'd773bccf-dba7-4fe5-bc53-8a94935aacad', 'efbde80f-d245-464c-a3d0-3c14aa753fdd', '1d82deb0-691a-4311-9b74-0f86fd046bd1'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:41:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e6b697cc-a8d0-4682-9f62-559b82ab8945 tempest-VolumeTypesAccessTest-1629431127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:41:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e6b697cc-a8d0-4682-9f62-559b82ab8945 tempest-VolumeTypesAccessTest-1629431127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:41:05 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e6b697cc-a8d0-4682-9f62-559b82ab8945 tempest-VolumeTypesAccessTest-1629431127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:41:05 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e6b697cc-a8d0-4682-9f62-559b82ab8945 tempest-VolumeTypesAccessTest-1629431127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:41:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e6b697cc-a8d0-4682-9f62-559b82ab8945 tempest-VolumeTypesAccessTest-1629431127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:41:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e6b697cc-a8d0-4682-9f62-559b82ab8945 tempest-VolumeTypesAccessTest-1629431127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:05 devstack sudo[107247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:41:05 devstack sudo[107247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:06 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36d19347-ef32-4018-a0b0-67c4eb356ff0__dul774s" returned: 1 in 0.971s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36d19347-ef32-4018-a0b0-67c4eb356ff0__dul774s' failed. Not Retrying. {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:41:06 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23cee82-5e44-48d3-961c-04580f0c99c0]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:41:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_fgvigt0rdevstack@QuobyteHD {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:06 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_fgvigt0rdevstack@QuobyteHD Jun 23 16:41:06 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:06 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a8cf17fd-df68-4e7c-8a57-91ce94c74979 tempest-VolumesExtendTest-1721937786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828" returned: 0 in 0.805s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:06 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-a8cf17fd-df68-4e7c-8a57-91ce94c74979 tempest-VolumesExtendTest-1721937786 None] <== create_volume: return (2252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:41:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a8cf17fd-df68-4e7c-8a57-91ce94c74979 tempest-VolumesExtendTest-1721937786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.256s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:41:06 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a8cf17fd-df68-4e7c-8a57-91ce94c74979 tempest-VolumesExtendTest-1721937786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ce0dbfa-a252-4f5a-a76f-f10ed4c51a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:06 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a8cf17fd-df68-4e7c-8a57-91ce94c74979 tempest-VolumesExtendTest-1721937786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ead24007-a55b-4c50-8e6b-d9d6f07f0135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:06 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-a8cf17fd-df68-4e7c-8a57-91ce94c74979 tempest-VolumesExtendTest-1721937786 None] Volume volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828 (83af8e5e-b4b4-4eee-bd13-f2f92cb73828): created successfully Jun 23 16:41:06 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a8cf17fd-df68-4e7c-8a57-91ce94c74979 tempest-VolumesExtendTest-1721937786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ead24007-a55b-4c50-8e6b-d9d6f07f0135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:06 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a8cf17fd-df68-4e7c-8a57-91ce94c74979 tempest-VolumesExtendTest-1721937786 None] Flow 'volume_create_manager' (b90d6fd3-6269-48d4-8923-2d99422cf381) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:41:06 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-a8cf17fd-df68-4e7c-8a57-91ce94c74979 tempest-VolumesExtendTest-1721937786 None] Created volume successfully. Jun 23 16:41:06 devstack sudo[107247]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e6b697cc-a8d0-4682-9f62-559b82ab8945 tempest-VolumeTypesAccessTest-1629431127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.958s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:06 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-e6b697cc-a8d0-4682-9f62-559b82ab8945 tempest-VolumeTypesAccessTest-1629431127 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:41:06 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-e6b697cc-a8d0-4682-9f62-559b82ab8945 tempest-VolumeTypesAccessTest-1629431127 None] Deleted volume successfully. Jun 23 16:41:06 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e6b697cc-a8d0-4682-9f62-559b82ab8945 tempest-VolumeTypesAccessTest-1629431127 None] Lock "cinder-a2408878-bf1b-4d73-bfe4-46a7e32604d2-delete_volume" released by "delete_volume" :: held 3.213s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:41:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-60dd2f67-c952-4a1c-a12b-15321b18acec tempest-VolumesExtendTest-1721937786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:41:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-60dd2f67-c952-4a1c-a12b-15321b18acec tempest-VolumesExtendTest-1721937786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:41:06 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-60dd2f67-c952-4a1c-a12b-15321b18acec tempest-VolumesExtendTest-1721937786 None] Creating offline snapshot fdb5d500-95a6-48c2-bea2-9e95d0241746 of volume 83af8e5e-b4b4-4eee-bd13-f2f92cb73828 {{(pid=93788) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:41:06 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[73006ee4-8540-4c9e-bc91-13c930a66b0b]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:41:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-60dd2f67-c952-4a1c-a12b-15321b18acec tempest-VolumesExtendTest-1721937786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:06 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828 Jun 23 16:41:06 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:07 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_fgvigt0rdevstack@QuobyteHD" returned: 0 in 1.021s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:07 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] 36d19347-ef32-4018-a0b0-67c4eb356ff0 was qcow2, converting to raw {{(pid=93788) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 16:41:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_fgvigt0rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-08e05ac8-3bef-44f1-b5b2-1d8675d9cd6d {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:07 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_fgvigt0rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-08e05ac8-3bef-44f1-b5b2-1d8675d9cd6d Jun 23 16:41:07 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:07 devstack cinder-volume[93788]: INFO cinder.volume.manager [req-2563978b-37ed-42f2-b38c-55b4b4737613 req-dde3a5c6-8bc2-4bab-af7f-9d5dcc5cbc8f tempest-TestInstancesWithCinderVolumes-865228744 None] Terminate volume connection completed successfully. Jun 23 16:41:07 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-2563978b-37ed-42f2-b38c-55b4b4737613 req-dde3a5c6-8bc2-4bab-af7f-9d5dcc5cbc8f tempest-TestInstancesWithCinderVolumes-865228744 None] Deleting attachment e0625fb9-fcf4-4a7d-8f98-d7934338f4d2. {{(pid=93788) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 16:41:07 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-60dd2f67-c952-4a1c-a12b-15321b18acec tempest-VolumesExtendTest-1721937786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828" returned: 0 in 0.870s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-60dd2f67-c952-4a1c-a12b-15321b18acec tempest-VolumesExtendTest-1721937786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828.fdb5d500-95a6-48c2-bea2-9e95d0241746 1G {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:07 devstack sudo[107272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828.fdb5d500-95a6-48c2-bea2-9e95d0241746 1G Jun 23 16:41:07 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:08 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-60dd2f67-c952-4a1c-a12b-15321b18acec tempest-VolumesExtendTest-1721937786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828.fdb5d500-95a6-48c2-bea2-9e95d0241746 1G" returned: 0 in 1.155s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-60dd2f67-c952-4a1c-a12b-15321b18acec tempest-VolumesExtendTest-1721937786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828.fdb5d500-95a6-48c2-bea2-9e95d0241746 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:08 devstack sudo[107286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828.fdb5d500-95a6-48c2-bea2-9e95d0241746 Jun 23 16:41:08 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:09 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-43791e73-5019-4cab-89c1-e4deeea7a15f tempest-TestInstancesWithCinderVolumes-865228744 None] Acquiring lock "cinder-ed5b7957-ce1a-466c-8010-be34e6ce89fd-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:41:09 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-43791e73-5019-4cab-89c1-e4deeea7a15f tempest-TestInstancesWithCinderVolumes-865228744 None] Lock "cinder-ed5b7957-ce1a-466c-8010-be34e6ce89fd-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:41:09 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-43791e73-5019-4cab-89c1-e4deeea7a15f tempest-TestInstancesWithCinderVolumes-865228744 None] Acquiring lock "cinder-quobyte-ed5b7957-ce1a-466c-8010-be34e6ce89fd" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:41:09 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-43791e73-5019-4cab-89c1-e4deeea7a15f tempest-TestInstancesWithCinderVolumes-865228744 None] Lock "cinder-quobyte-ed5b7957-ce1a-466c-8010-be34e6ce89fd" acquired by "delete_volume" :: waited 0.035s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:41:09 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[8458a55f-9ae8-4eb1-854b-ecb434f0dd88]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:41:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-43791e73-5019-4cab-89c1-e4deeea7a15f tempest-TestInstancesWithCinderVolumes-865228744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-ed5b7957-ce1a-466c-8010-be34e6ce89fd {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:09 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-ed5b7957-ce1a-466c-8010-be34e6ce89fd Jun 23 16:41:09 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:09 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_fgvigt0rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-08e05ac8-3bef-44f1-b5b2-1d8675d9cd6d" returned: 0 in 2.529s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:09 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_fgvigt0rdevstack@QuobyteHD, size 112.00 MB, duration 2.53 sec, destination /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-08e05ac8-3bef-44f1-b5b2-1d8675d9cd6d {{(pid=93788) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 16:41:09 devstack cinder-volume[93788]: INFO cinder.image.image_utils [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] Converted 112.00 MB image at 44.24 MB/s Jun 23 16:41:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-08e05ac8-3bef-44f1-b5b2-1d8675d9cd6d 1G {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:09 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-08e05ac8-3bef-44f1-b5b2-1d8675d9cd6d 1G Jun 23 16:41:09 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:10 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-60dd2f67-c952-4a1c-a12b-15321b18acec tempest-VolumesExtendTest-1721937786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828.fdb5d500-95a6-48c2-bea2-9e95d0241746" returned: 0 in 1.214s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:10 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-60dd2f67-c952-4a1c-a12b-15321b18acec tempest-VolumesExtendTest-1721937786 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828.fdb5d500-95a6-48c2-bea2-9e95d0241746 is being set with open permissions: ugo+rw Jun 23 16:41:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-60dd2f67-c952-4a1c-a12b-15321b18acec tempest-VolumesExtendTest-1721937786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828.fdb5d500-95a6-48c2-bea2-9e95d0241746 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:10 devstack sudo[107298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828.fdb5d500-95a6-48c2-bea2-9e95d0241746 Jun 23 16:41:10 devstack sudo[107298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:10 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-43791e73-5019-4cab-89c1-e4deeea7a15f tempest-TestInstancesWithCinderVolumes-865228744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-ed5b7957-ce1a-466c-8010-be34e6ce89fd" returned: 0 in 0.983s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-43791e73-5019-4cab-89c1-e4deeea7a15f tempest-TestInstancesWithCinderVolumes-865228744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-ed5b7957-ce1a-466c-8010-be34e6ce89fd {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:10 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-ed5b7957-ce1a-466c-8010-be34e6ce89fd Jun 23 16:41:10 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:10 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-08e05ac8-3bef-44f1-b5b2-1d8675d9cd6d 1G" returned: 0 in 1.190s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:10 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03b092e-3958-463e-b099-c5d4f173d27a]: (4, 'raw') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:41:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-08e05ac8-3bef-44f1-b5b2-1d8675d9cd6d {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:11 devstack sudo[107298]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-60dd2f67-c952-4a1c-a12b-15321b18acec tempest-VolumesExtendTest-1721937786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828.fdb5d500-95a6-48c2-bea2-9e95d0241746" returned: 0 in 0.972s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:11 devstack sudo[107307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-08e05ac8-3bef-44f1-b5b2-1d8675d9cd6d Jun 23 16:41:11 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-60dd2f67-c952-4a1c-a12b-15321b18acec tempest-VolumesExtendTest-1721937786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:11 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828.info Jun 23 16:41:11 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:11 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-43791e73-5019-4cab-89c1-e4deeea7a15f tempest-TestInstancesWithCinderVolumes-865228744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-ed5b7957-ce1a-466c-8010-be34e6ce89fd" returned: 0 in 1.014s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:11 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-43791e73-5019-4cab-89c1-e4deeea7a15f tempest-TestInstancesWithCinderVolumes-865228744 None] Lock "cinder-quobyte-ed5b7957-ce1a-466c-8010-be34e6ce89fd" released by "delete_volume" :: held 2.090s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:41:11 devstack cinder-volume[93788]: WARNING cinder.quota [None req-43791e73-5019-4cab-89c1-e4deeea7a15f tempest-TestInstancesWithCinderVolumes-865228744 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-932545549-1787665714 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-932545549-1787665714, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:41:11 devstack cinder-volume[93788]: WARNING cinder.quota [None req-43791e73-5019-4cab-89c1-e4deeea7a15f tempest-TestInstancesWithCinderVolumes-865228744 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-932545549-1787665714 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-932545549-1787665714, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:41:11 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-43791e73-5019-4cab-89c1-e4deeea7a15f tempest-TestInstancesWithCinderVolumes-865228744 None] Created reservations ['15e96078-9e3f-43b3-9cd8-09508e5efe5b', 'c1adb2e4-0ab5-4877-91ce-6dc1d320f843', '4f5e9296-2b4a-4580-a0dc-68db117422e7', 'a86ba52f-5c6e-41b9-b40e-844948ec5ccd'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:41:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-43791e73-5019-4cab-89c1-e4deeea7a15f tempest-TestInstancesWithCinderVolumes-865228744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:41:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-43791e73-5019-4cab-89c1-e4deeea7a15f tempest-TestInstancesWithCinderVolumes-865228744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:41:11 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-43791e73-5019-4cab-89c1-e4deeea7a15f tempest-TestInstancesWithCinderVolumes-865228744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:41:11 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-43791e73-5019-4cab-89c1-e4deeea7a15f tempest-TestInstancesWithCinderVolumes-865228744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:41:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-43791e73-5019-4cab-89c1-e4deeea7a15f tempest-TestInstancesWithCinderVolumes-865228744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:41:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-43791e73-5019-4cab-89c1-e4deeea7a15f tempest-TestInstancesWithCinderVolumes-865228744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:11 devstack sudo[107312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:41:11 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:12 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-60dd2f67-c952-4a1c-a12b-15321b18acec tempest-VolumesExtendTest-1721937786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828.info" returned: 0 in 0.941s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:12 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-60dd2f67-c952-4a1c-a12b-15321b18acec tempest-VolumesExtendTest-1721937786 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828.info is being set with open permissions: ugo+rw Jun 23 16:41:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-60dd2f67-c952-4a1c-a12b-15321b18acec tempest-VolumesExtendTest-1721937786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:12 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-08e05ac8-3bef-44f1-b5b2-1d8675d9cd6d" returned: 0 in 1.223s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-08e05ac8-3bef-44f1-b5b2-1d8675d9cd6d {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:12 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828.info Jun 23 16:41:12 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:12 devstack sudo[107319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-08e05ac8-3bef-44f1-b5b2-1d8675d9cd6d Jun 23 16:41:12 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:12 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-43791e73-5019-4cab-89c1-e4deeea7a15f tempest-TestInstancesWithCinderVolumes-865228744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.073s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:12 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-43791e73-5019-4cab-89c1-e4deeea7a15f tempest-TestInstancesWithCinderVolumes-865228744 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:41:12 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-43791e73-5019-4cab-89c1-e4deeea7a15f tempest-TestInstancesWithCinderVolumes-865228744 None] Deleted volume successfully. Jun 23 16:41:12 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-43791e73-5019-4cab-89c1-e4deeea7a15f tempest-TestInstancesWithCinderVolumes-865228744 None] Lock "cinder-ed5b7957-ce1a-466c-8010-be34e6ce89fd-delete_volume" released by "delete_volume" :: held 3.550s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:41:12 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-60dd2f67-c952-4a1c-a12b-15321b18acec tempest-VolumesExtendTest-1721937786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828.info" returned: 0 in 0.817s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-60dd2f67-c952-4a1c-a12b-15321b18acec tempest-VolumesExtendTest-1721937786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.161s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:41:12 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-60dd2f67-c952-4a1c-a12b-15321b18acec tempest-VolumesExtendTest-1721937786 None] Create snapshot completed successfully Jun 23 16:41:13 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-08e05ac8-3bef-44f1-b5b2-1d8675d9cd6d" returned: 1 in 1.189s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-08e05ac8-3bef-44f1-b5b2-1d8675d9cd6d' failed. Not Retrying. {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:41:13 devstack cinder-volume[93788]: DEBUG cinder.volume.volume_utils [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] Downloaded image 36d19347-ef32-4018-a0b0-67c4eb356ff0 ((None, [{'url': 'file:///opt/stack/data/glance/images/36d19347-ef32-4018-a0b0-67c4eb356ff0', 'metadata': {}}])) to volume 08e05ac8-3bef-44f1-b5b2-1d8675d9cd6d successfully. {{(pid=93788) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 16:41:13 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] Temporary image 36d19347-ef32-4018-a0b0-67c4eb356ff0 for user a0eda2b8c0f54a9cb23869514ffecda4 is deleted. {{(pid=93788) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 16:41:13 devstack cinder-volume[93788]: DEBUG cinder.volume.volume_utils [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] Marking volume 08e05ac8-3bef-44f1-b5b2-1d8675d9cd6d as bootable. {{(pid=93788) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 16:41:13 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] Copying metadata from image 36d19347-ef32-4018-a0b0-67c4eb356ff0 to 08e05ac8-3bef-44f1-b5b2-1d8675d9cd6d. {{(pid=93788) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 16:41:13 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] Creating volume glance metadata for volume 08e05ac8-3bef-44f1-b5b2-1d8675d9cd6d backed by image 36d19347-ef32-4018-a0b0-67c4eb356ff0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '36d19347-ef32-4018-a0b0-67c4eb356ff0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93788) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 16:41:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-82ec0228-baa1-49a8-b970-858b8cc503f4 tempest-VolumesExtendTest-1721937786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:41:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-82ec0228-baa1-49a8-b970-858b8cc503f4 tempest-VolumesExtendTest-1721937786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:41:13 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ed8df6-f03f-4d07-85a4-0d4f328bd754]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:41:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-82ec0228-baa1-49a8-b970-858b8cc503f4 tempest-VolumesExtendTest-1721937786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa527419-2050-42fd-bdef-c4b5a1afaf85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08e05ac8-3bef-44f1-b5b2-1d8675d9cd6d', 'volume_size': 1, 'image_id': '36d19347-ef32-4018-a0b0-67c4eb356ff0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/36d19347-ef32-4018-a0b0-67c4eb356ff0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '96f86ae628444b53b4eb7231789566de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '36d19347-ef32-4018-a0b0-67c4eb356ff0', 'created_at': datetime.datetime(2026, 6, 23, 14, 20, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 14, 20, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36d19347-ef32-4018-a0b0-67c4eb356ff0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e03c9baf-9f5a-450b-9afe-ca6744cbe72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:13 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] Volume volume-08e05ac8-3bef-44f1-b5b2-1d8675d9cd6d (08e05ac8-3bef-44f1-b5b2-1d8675d9cd6d): created successfully Jun 23 16:41:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e03c9baf-9f5a-450b-9afe-ca6744cbe72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] Flow 'volume_create_manager' (22a52f36-6765-4f47-b008-19132098a02f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:41:13 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-9c5186a7-0a1f-4f30-9fa4-f3f2e859a6e9 tempest-VolumesGetTest-1550830579 None] Created volume successfully. Jun 23 16:41:13 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828 Jun 23 16:41:13 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:14 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-82ec0228-baa1-49a8-b970-858b8cc503f4 tempest-VolumesExtendTest-1721937786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828" returned: 0 in 0.850s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-82ec0228-baa1-49a8-b970-858b8cc503f4 tempest-VolumesExtendTest-1721937786 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828.fdb5d500-95a6-48c2-bea2-9e95d0241746 2G {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-82ec0228-baa1-49a8-b970-858b8cc503f4 tempest-VolumesExtendTest-1721937786 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828.fdb5d500-95a6-48c2-bea2-9e95d0241746 2G" returned: 0 in 0.330s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-82ec0228-baa1-49a8-b970-858b8cc503f4 tempest-VolumesExtendTest-1721937786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.246s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:41:14 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-82ec0228-baa1-49a8-b970-858b8cc503f4 tempest-VolumesExtendTest-1721937786 None] Extend volume completed successfully. Jun 23 16:41:15 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f918c87-bacc-4bbc-b718-7dac5130f491 tempest-VolumesGetTest-1550830579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:41:15 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6f918c87-bacc-4bbc-b718-7dac5130f491 tempest-VolumesGetTest-1550830579 None] Flow 'volume_create_manager' (84ff821e-8198-4af5-b569-44b24ba4ac16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:41:15 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6f918c87-bacc-4bbc-b718-7dac5130f491 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fa9269b-93d1-4fa8-9f76-2a200fb05c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:15 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6f918c87-bacc-4bbc-b718-7dac5130f491 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fa9269b-93d1-4fa8-9f76-2a200fb05c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:41:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-26689151',display_name='tempest-VolumesGetTest-Volume-1532274006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1536e23-378a-4324-8a4e-3a03cdebe1e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e0c6765fc6c450aa7d0be9b768dc1f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:41:15Z,use_quota=True,user_id='a0eda2b8c0f54a9cb23869514ffecda4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:15 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6f918c87-bacc-4bbc-b718-7dac5130f491 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a39e905b-cfcc-4152-97d9-0ad8086265fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:15 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6f918c87-bacc-4bbc-b718-7dac5130f491 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a39e905b-cfcc-4152-97d9-0ad8086265fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:15 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6f918c87-bacc-4bbc-b718-7dac5130f491 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (448a4a97-6d8e-441c-96af-9e9f4a4417d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:15 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6f918c87-bacc-4bbc-b718-7dac5130f491 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (448a4a97-6d8e-441c-96af-9e9f4a4417d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1536e23-378a-4324-8a4e-3a03cdebe1e0', 'volume_name': 'volume-b1536e23-378a-4324-8a4e-3a03cdebe1e0', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:15 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6f918c87-bacc-4bbc-b718-7dac5130f491 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8599bbd4-efe6-4ec5-8983-3946d709a5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:15 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6f918c87-bacc-4bbc-b718-7dac5130f491 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8599bbd4-efe6-4ec5-8983-3946d709a5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:15 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6f918c87-bacc-4bbc-b718-7dac5130f491 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14e55ab4-8fce-4bb1-a66f-2f7b53e3799f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:15 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-6f918c87-bacc-4bbc-b718-7dac5130f491 tempest-VolumesGetTest-1550830579 None] Volume b1536e23-378a-4324-8a4e-3a03cdebe1e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1536e23-378a-4324-8a4e-3a03cdebe1e0', 'volume_size': 1} Jun 23 16:41:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-6f918c87-bacc-4bbc-b718-7dac5130f491 tempest-VolumesGetTest-1550830579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:41:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-6f918c87-bacc-4bbc-b718-7dac5130f491 tempest-VolumesGetTest-1550830579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:41:15 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-6f918c87-bacc-4bbc-b718-7dac5130f491 tempest-VolumesGetTest-1550830579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:41:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-26689151',display_name='tempest-VolumesGetTest-Volume-1532274006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1536e23-378a-4324-8a4e-3a03cdebe1e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e0c6765fc6c450aa7d0be9b768dc1f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:41:15Z,use_quota=True,user_id='a0eda2b8c0f54a9cb23869514ffecda4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:41:15 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-6f918c87-bacc-4bbc-b718-7dac5130f491 tempest-VolumesGetTest-1550830579 None] Creating volume b1536e23-378a-4324-8a4e-3a03cdebe1e0 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:41:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-6f918c87-bacc-4bbc-b718-7dac5130f491 tempest-VolumesGetTest-1550830579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:41:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-6f918c87-bacc-4bbc-b718-7dac5130f491 tempest-VolumesGetTest-1550830579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:41:15 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-6f918c87-bacc-4bbc-b718-7dac5130f491 tempest-VolumesGetTest-1550830579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:41:15 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-6f918c87-bacc-4bbc-b718-7dac5130f491 tempest-VolumesGetTest-1550830579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:41:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-6f918c87-bacc-4bbc-b718-7dac5130f491 tempest-VolumesGetTest-1550830579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:41:15 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-6f918c87-bacc-4bbc-b718-7dac5130f491 tempest-VolumesGetTest-1550830579 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:41:15 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-6f918c87-bacc-4bbc-b718-7dac5130f491 tempest-VolumesGetTest-1550830579 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:41:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-6f918c87-bacc-4bbc-b718-7dac5130f491 tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b1536e23-378a-4324-8a4e-3a03cdebe1e0 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:15 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b1536e23-378a-4324-8a4e-3a03cdebe1e0 1073741824 Jun 23 16:41:15 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:15 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d21c48b7-2e47-461f-b9e0-1de76ef6dbc1 tempest-VolumesExtendTest-1721937786 None] Acquiring lock "cinder-fdb5d500-95a6-48c2-bea2-9e95d0241746-delete_snapshot" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:41:15 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d21c48b7-2e47-461f-b9e0-1de76ef6dbc1 tempest-VolumesExtendTest-1721937786 None] Lock "cinder-fdb5d500-95a6-48c2-bea2-9e95d0241746-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:41:15 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d21c48b7-2e47-461f-b9e0-1de76ef6dbc1 tempest-VolumesExtendTest-1721937786 None] Acquiring lock "cinder-quobyte-83af8e5e-b4b4-4eee-bd13-f2f92cb73828" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:41:15 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d21c48b7-2e47-461f-b9e0-1de76ef6dbc1 tempest-VolumesExtendTest-1721937786 None] Lock "cinder-quobyte-83af8e5e-b4b4-4eee-bd13-f2f92cb73828" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:41:15 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d21c48b7-2e47-461f-b9e0-1de76ef6dbc1 tempest-VolumesExtendTest-1721937786 None] Acquiring lock "cinder-quobyte-fdb5d500-95a6-48c2-bea2-9e95d0241746" by "_delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:41:16 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d21c48b7-2e47-461f-b9e0-1de76ef6dbc1 tempest-VolumesExtendTest-1721937786 None] Lock "cinder-quobyte-fdb5d500-95a6-48c2-bea2-9e95d0241746" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:41:16 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-d21c48b7-2e47-461f-b9e0-1de76ef6dbc1 tempest-VolumesExtendTest-1721937786 None] Deleting offline snapshot fdb5d500-95a6-48c2-bea2-9e95d0241746 of volume 83af8e5e-b4b4-4eee-bd13-f2f92cb73828 {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:41:16 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-d21c48b7-2e47-461f-b9e0-1de76ef6dbc1 tempest-VolumesExtendTest-1721937786 None] snapshot_file for this snap is: volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828.fdb5d500-95a6-48c2-bea2-9e95d0241746 {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:41:16 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d32b8c-68d6-4bfb-a436-dbffc6a2240b]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:41:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d21c48b7-2e47-461f-b9e0-1de76ef6dbc1 tempest-VolumesExtendTest-1721937786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828.fdb5d500-95a6-48c2-bea2-9e95d0241746 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:16 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828.fdb5d500-95a6-48c2-bea2-9e95d0241746 Jun 23 16:41:16 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:16 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-6f918c87-bacc-4bbc-b718-7dac5130f491 tempest-VolumesGetTest-1550830579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b1536e23-378a-4324-8a4e-3a03cdebe1e0 1073741824" returned: 0 in 1.205s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-6f918c87-bacc-4bbc-b718-7dac5130f491 tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b1536e23-378a-4324-8a4e-3a03cdebe1e0 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:17 devstack sudo[107395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b1536e23-378a-4324-8a4e-3a03cdebe1e0 Jun 23 16:41:17 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:17 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d21c48b7-2e47-461f-b9e0-1de76ef6dbc1 tempest-VolumesExtendTest-1721937786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828.fdb5d500-95a6-48c2-bea2-9e95d0241746" returned: 0 in 1.080s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:17 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-d21c48b7-2e47-461f-b9e0-1de76ef6dbc1 tempest-VolumesExtendTest-1721937786 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:41:17 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[de07f64e-adb1-4719-9bfe-e97838b77d89]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:41:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d21c48b7-2e47-461f-b9e0-1de76ef6dbc1 tempest-VolumesExtendTest-1721937786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:17 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828 Jun 23 16:41:17 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:17 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-6f918c87-bacc-4bbc-b718-7dac5130f491 tempest-VolumesGetTest-1550830579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b1536e23-378a-4324-8a4e-3a03cdebe1e0" returned: 0 in 0.691s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:17 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-6f918c87-bacc-4bbc-b718-7dac5130f491 tempest-VolumesGetTest-1550830579 None] <== create_volume: return (1960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:41:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-6f918c87-bacc-4bbc-b718-7dac5130f491 tempest-VolumesGetTest-1550830579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.963s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:41:17 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6f918c87-bacc-4bbc-b718-7dac5130f491 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14e55ab4-8fce-4bb1-a66f-2f7b53e3799f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1536e23-378a-4324-8a4e-3a03cdebe1e0', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:17 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6f918c87-bacc-4bbc-b718-7dac5130f491 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c616f072-60b7-43ea-a16d-4e1fa16de935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:17 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-6f918c87-bacc-4bbc-b718-7dac5130f491 tempest-VolumesGetTest-1550830579 None] Volume volume-b1536e23-378a-4324-8a4e-3a03cdebe1e0 (b1536e23-378a-4324-8a4e-3a03cdebe1e0): created successfully Jun 23 16:41:17 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6f918c87-bacc-4bbc-b718-7dac5130f491 tempest-VolumesGetTest-1550830579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c616f072-60b7-43ea-a16d-4e1fa16de935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:17 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-6f918c87-bacc-4bbc-b718-7dac5130f491 tempest-VolumesGetTest-1550830579 None] Flow 'volume_create_manager' (84ff821e-8198-4af5-b569-44b24ba4ac16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:41:17 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-6f918c87-bacc-4bbc-b718-7dac5130f491 tempest-VolumesGetTest-1550830579 None] Created volume successfully. Jun 23 16:41:17 devstack cinder-volume[93788]: INFO cinder.volume.manager [req-4938aa1e-47a9-472f-9ecc-3885c84b2a23 req-7444a6da-2e1a-49fa-9606-93d090d28263 tempest-TestInstancesWithCinderVolumes-865228744 None] Terminate volume connection completed successfully. Jun 23 16:41:17 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-4938aa1e-47a9-472f-9ecc-3885c84b2a23 req-7444a6da-2e1a-49fa-9606-93d090d28263 tempest-TestInstancesWithCinderVolumes-865228744 None] Deleting attachment 5de03bd9-d280-4dc9-98d6-823f74c5e04b. {{(pid=93788) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 16:41:18 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:18 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d21c48b7-2e47-461f-b9e0-1de76ef6dbc1 tempest-VolumesExtendTest-1721937786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828" returned: 0 in 0.955s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:18 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d21c48b7-2e47-461f-b9e0-1de76ef6dbc1 tempest-VolumesExtendTest-1721937786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828.fdb5d500-95a6-48c2-bea2-9e95d0241746 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:18 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828.fdb5d500-95a6-48c2-bea2-9e95d0241746 Jun 23 16:41:18 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:18 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-7fa8e576-7bf9-496b-8520-efeeec70c053 tempest-VolumesGetTest-1550830579 None] Acquiring lock "cinder-b1536e23-378a-4324-8a4e-3a03cdebe1e0-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:41:18 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-7fa8e576-7bf9-496b-8520-efeeec70c053 tempest-VolumesGetTest-1550830579 None] Lock "cinder-b1536e23-378a-4324-8a4e-3a03cdebe1e0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:41:18 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-7fa8e576-7bf9-496b-8520-efeeec70c053 tempest-VolumesGetTest-1550830579 None] Acquiring lock "cinder-quobyte-b1536e23-378a-4324-8a4e-3a03cdebe1e0" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:41:19 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-7fa8e576-7bf9-496b-8520-efeeec70c053 tempest-VolumesGetTest-1550830579 None] Lock "cinder-quobyte-b1536e23-378a-4324-8a4e-3a03cdebe1e0" acquired by "delete_volume" :: waited 0.040s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:41:19 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:19 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d21c48b7-2e47-461f-b9e0-1de76ef6dbc1 tempest-VolumesExtendTest-1721937786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828.fdb5d500-95a6-48c2-bea2-9e95d0241746" returned: 0 in 0.951s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:19 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d21c48b7-2e47-461f-b9e0-1de76ef6dbc1 tempest-VolumesExtendTest-1721937786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828.fdb5d500-95a6-48c2-bea2-9e95d0241746 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:19 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2237c752-efe9-498c-9096-d6df3be574e3]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:41:19 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-7fa8e576-7bf9-496b-8520-efeeec70c053 tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b1536e23-378a-4324-8a4e-3a03cdebe1e0 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:19 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828.fdb5d500-95a6-48c2-bea2-9e95d0241746 Jun 23 16:41:19 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:19 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b1536e23-378a-4324-8a4e-3a03cdebe1e0 Jun 23 16:41:19 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:19 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:19 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d21c48b7-2e47-461f-b9e0-1de76ef6dbc1 tempest-VolumesExtendTest-1721937786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828.fdb5d500-95a6-48c2-bea2-9e95d0241746" returned: 0 in 0.781s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:19 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d21c48b7-2e47-461f-b9e0-1de76ef6dbc1 tempest-VolumesExtendTest-1721937786 None] Lock "cinder-quobyte-fdb5d500-95a6-48c2-bea2-9e95d0241746" released by "_delete_snapshot" :: held 3.900s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:41:19 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d21c48b7-2e47-461f-b9e0-1de76ef6dbc1 tempest-VolumesExtendTest-1721937786 None] Lock "cinder-quobyte-83af8e5e-b4b4-4eee-bd13-f2f92cb73828" released by "delete_snapshot" :: held 3.931s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:41:19 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:19 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-d21c48b7-2e47-461f-b9e0-1de76ef6dbc1 tempest-VolumesExtendTest-1721937786 None] Created reservations ['7fb39871-4db6-457d-93ac-16686abf8816', '4694dbcc-98f7-48ee-a900-bded6f7ba5e3', '24ce18c2-8600-41e9-a950-b3fb4b51be2e', '02bacb2f-38f9-4b95-8988-5c91a513288b'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:41:19 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-7fa8e576-7bf9-496b-8520-efeeec70c053 tempest-VolumesGetTest-1550830579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b1536e23-378a-4324-8a4e-3a03cdebe1e0" returned: 0 in 0.887s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:19 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-7fa8e576-7bf9-496b-8520-efeeec70c053 tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b1536e23-378a-4324-8a4e-3a03cdebe1e0 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:20 devstack sudo[107420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b1536e23-378a-4324-8a4e-3a03cdebe1e0 Jun 23 16:41:20 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:20 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-d21c48b7-2e47-461f-b9e0-1de76ef6dbc1 tempest-VolumesExtendTest-1721937786 None] Delete snapshot completed successfully. Jun 23 16:41:20 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d21c48b7-2e47-461f-b9e0-1de76ef6dbc1 tempest-VolumesExtendTest-1721937786 None] Lock "cinder-fdb5d500-95a6-48c2-bea2-9e95d0241746-delete_snapshot" released by "delete_snapshot" :: held 4.139s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:41:20 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b685add3-4533-4427-9a42-a900ff9ebb3f tempest-VolumesExtendTest-1721937786 None] Acquiring lock "cinder-83af8e5e-b4b4-4eee-bd13-f2f92cb73828-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:41:20 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b685add3-4533-4427-9a42-a900ff9ebb3f tempest-VolumesExtendTest-1721937786 None] Lock "cinder-83af8e5e-b4b4-4eee-bd13-f2f92cb73828-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:41:20 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:UPDATE=139,cinder:SELECT=118,cinder:INSERT=41,cinder:DELETE=7 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:41:20 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b685add3-4533-4427-9a42-a900ff9ebb3f tempest-VolumesExtendTest-1721937786 None] Acquiring lock "cinder-quobyte-83af8e5e-b4b4-4eee-bd13-f2f92cb73828" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:41:20 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b685add3-4533-4427-9a42-a900ff9ebb3f tempest-VolumesExtendTest-1721937786 None] Lock "cinder-quobyte-83af8e5e-b4b4-4eee-bd13-f2f92cb73828" acquired by "delete_volume" :: waited 0.020s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:41:20 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca75fd1-7375-45b8-b2b6-0e03e57c53ba]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:41:20 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b685add3-4533-4427-9a42-a900ff9ebb3f tempest-VolumesExtendTest-1721937786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:20 devstack sudo[107422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828 Jun 23 16:41:20 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:20 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:20 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-7fa8e576-7bf9-496b-8520-efeeec70c053 tempest-VolumesGetTest-1550830579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b1536e23-378a-4324-8a4e-3a03cdebe1e0" returned: 0 in 0.833s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:20 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-7fa8e576-7bf9-496b-8520-efeeec70c053 tempest-VolumesGetTest-1550830579 None] Lock "cinder-quobyte-b1536e23-378a-4324-8a4e-3a03cdebe1e0" released by "delete_volume" :: held 1.812s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:41:20 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-7fa8e576-7bf9-496b-8520-efeeec70c053 tempest-VolumesGetTest-1550830579 None] Created reservations ['7bd748ec-9608-4844-b8c9-e81eadf8b660', 'b8270363-4995-4e1d-b7e3-ab5ecb151e80', 'cdcf9a74-7471-41aa-ae25-29489e500095', 'b91f0e5e-270d-4ec2-8c4d-4335b50b20c8'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:41:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-7fa8e576-7bf9-496b-8520-efeeec70c053 tempest-VolumesGetTest-1550830579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:41:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-7fa8e576-7bf9-496b-8520-efeeec70c053 tempest-VolumesGetTest-1550830579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:41:21 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-7fa8e576-7bf9-496b-8520-efeeec70c053 tempest-VolumesGetTest-1550830579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:41:21 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-7fa8e576-7bf9-496b-8520-efeeec70c053 tempest-VolumesGetTest-1550830579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:41:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-7fa8e576-7bf9-496b-8520-efeeec70c053 tempest-VolumesGetTest-1550830579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:41:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-7fa8e576-7bf9-496b-8520-efeeec70c053 tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:21 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:41:21 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:21 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e8e20701-2a21-484f-899c-83b48c0da362 tempest-VolumesGetTest-1550830579 None] Acquiring lock "cinder-08e05ac8-3bef-44f1-b5b2-1d8675d9cd6d-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:41:21 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e8e20701-2a21-484f-899c-83b48c0da362 tempest-VolumesGetTest-1550830579 None] Lock "cinder-08e05ac8-3bef-44f1-b5b2-1d8675d9cd6d-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:41:21 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b685add3-4533-4427-9a42-a900ff9ebb3f tempest-VolumesExtendTest-1721937786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828" returned: 0 in 0.878s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b685add3-4533-4427-9a42-a900ff9ebb3f tempest-VolumesExtendTest-1721937786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:21 devstack sudo[107430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828 Jun 23 16:41:21 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:21 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e8e20701-2a21-484f-899c-83b48c0da362 tempest-VolumesGetTest-1550830579 None] Acquiring lock "cinder-quobyte-08e05ac8-3bef-44f1-b5b2-1d8675d9cd6d" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:41:21 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e8e20701-2a21-484f-899c-83b48c0da362 tempest-VolumesGetTest-1550830579 None] Lock "cinder-quobyte-08e05ac8-3bef-44f1-b5b2-1d8675d9cd6d" acquired by "delete_volume" :: waited 0.028s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:41:21 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa4576f-1abf-45d7-b6f1-518fc3259fb9]: (4, 'raw') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:41:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e8e20701-2a21-484f-899c-83b48c0da362 tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-08e05ac8-3bef-44f1-b5b2-1d8675d9cd6d {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:21 devstack sudo[107432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-08e05ac8-3bef-44f1-b5b2-1d8675d9cd6d Jun 23 16:41:21 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:21 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-71592238-6e44-44bf-a7da-ce9da69b9b4c tempest-TestInstancesWithCinderVolumes-865228744 None] Acquiring lock "cinder-d607b6f6-a013-44e8-bd80-e8a3d6356a83-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:41:21 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-71592238-6e44-44bf-a7da-ce9da69b9b4c tempest-TestInstancesWithCinderVolumes-865228744 None] Lock "cinder-d607b6f6-a013-44e8-bd80-e8a3d6356a83-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:41:21 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-71592238-6e44-44bf-a7da-ce9da69b9b4c tempest-TestInstancesWithCinderVolumes-865228744 None] Acquiring lock "cinder-quobyte-d607b6f6-a013-44e8-bd80-e8a3d6356a83" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:41:21 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-71592238-6e44-44bf-a7da-ce9da69b9b4c tempest-TestInstancesWithCinderVolumes-865228744 None] Lock "cinder-quobyte-d607b6f6-a013-44e8-bd80-e8a3d6356a83" acquired by "delete_volume" :: waited 0.030s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:41:21 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70e521d-907c-4e3e-a019-522808791062]: (4, 'raw') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:41:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-71592238-6e44-44bf-a7da-ce9da69b9b4c tempest-TestInstancesWithCinderVolumes-865228744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d607b6f6-a013-44e8-bd80-e8a3d6356a83 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:21 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-7fa8e576-7bf9-496b-8520-efeeec70c053 tempest-VolumesGetTest-1550830579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.912s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:21 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-7fa8e576-7bf9-496b-8520-efeeec70c053 tempest-VolumesGetTest-1550830579 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:41:21 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-7fa8e576-7bf9-496b-8520-efeeec70c053 tempest-VolumesGetTest-1550830579 None] Deleted volume successfully. Jun 23 16:41:22 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-7fa8e576-7bf9-496b-8520-efeeec70c053 tempest-VolumesGetTest-1550830579 None] Lock "cinder-b1536e23-378a-4324-8a4e-3a03cdebe1e0-delete_volume" released by "delete_volume" :: held 3.116s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:41:22 devstack sudo[107435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d607b6f6-a013-44e8-bd80-e8a3d6356a83 Jun 23 16:41:22 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:22 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b685add3-4533-4427-9a42-a900ff9ebb3f tempest-VolumesExtendTest-1721937786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-83af8e5e-b4b4-4eee-bd13-f2f92cb73828" returned: 0 in 0.994s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:22 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b685add3-4533-4427-9a42-a900ff9ebb3f tempest-VolumesExtendTest-1721937786 None] Lock "cinder-quobyte-83af8e5e-b4b4-4eee-bd13-f2f92cb73828" released by "delete_volume" :: held 1.956s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:41:22 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-b685add3-4533-4427-9a42-a900ff9ebb3f tempest-VolumesExtendTest-1721937786 None] Created reservations ['8bd87c11-ad78-4eae-a6dc-36edbc4190e7', '45d79462-fa89-4188-89ad-aac647dddfca', 'd8b7dc2f-ac1c-4d47-9280-e04737ffb4c4', '9a284811-3684-4a8a-8db4-96d32eb408e2'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:41:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b685add3-4533-4427-9a42-a900ff9ebb3f tempest-VolumesExtendTest-1721937786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:41:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b685add3-4533-4427-9a42-a900ff9ebb3f tempest-VolumesExtendTest-1721937786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:41:22 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b685add3-4533-4427-9a42-a900ff9ebb3f tempest-VolumesExtendTest-1721937786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:41:22 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b685add3-4533-4427-9a42-a900ff9ebb3f tempest-VolumesExtendTest-1721937786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:41:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b685add3-4533-4427-9a42-a900ff9ebb3f tempest-VolumesExtendTest-1721937786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:41:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b685add3-4533-4427-9a42-a900ff9ebb3f tempest-VolumesExtendTest-1721937786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:22 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e8e20701-2a21-484f-899c-83b48c0da362 tempest-VolumesGetTest-1550830579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-08e05ac8-3bef-44f1-b5b2-1d8675d9cd6d" returned: 0 in 1.137s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e8e20701-2a21-484f-899c-83b48c0da362 tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-08e05ac8-3bef-44f1-b5b2-1d8675d9cd6d {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:22 devstack sudo[107440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:41:22 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:22 devstack sudo[107441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-08e05ac8-3bef-44f1-b5b2-1d8675d9cd6d Jun 23 16:41:22 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:23 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-71592238-6e44-44bf-a7da-ce9da69b9b4c tempest-TestInstancesWithCinderVolumes-865228744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d607b6f6-a013-44e8-bd80-e8a3d6356a83" returned: 0 in 1.094s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-71592238-6e44-44bf-a7da-ce9da69b9b4c tempest-TestInstancesWithCinderVolumes-865228744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d607b6f6-a013-44e8-bd80-e8a3d6356a83 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:23 devstack sudo[107446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d607b6f6-a013-44e8-bd80-e8a3d6356a83 Jun 23 16:41:23 devstack sudo[107446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:23 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b685add3-4533-4427-9a42-a900ff9ebb3f tempest-VolumesExtendTest-1721937786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.949s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:23 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-b685add3-4533-4427-9a42-a900ff9ebb3f tempest-VolumesExtendTest-1721937786 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:41:23 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-b685add3-4533-4427-9a42-a900ff9ebb3f tempest-VolumesExtendTest-1721937786 None] Deleted volume successfully. Jun 23 16:41:23 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b685add3-4533-4427-9a42-a900ff9ebb3f tempest-VolumesExtendTest-1721937786 None] Lock "cinder-83af8e5e-b4b4-4eee-bd13-f2f92cb73828-delete_volume" released by "delete_volume" :: held 3.295s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:41:23 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e8e20701-2a21-484f-899c-83b48c0da362 tempest-VolumesGetTest-1550830579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-08e05ac8-3bef-44f1-b5b2-1d8675d9cd6d" returned: 1 in 1.035s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e8e20701-2a21-484f-899c-83b48c0da362 tempest-VolumesGetTest-1550830579 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-08e05ac8-3bef-44f1-b5b2-1d8675d9cd6d' failed. Not Retrying. {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:41:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e8e20701-2a21-484f-899c-83b48c0da362 tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-08e05ac8-3bef-44f1-b5b2-1d8675d9cd6d {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:23 devstack sudo[107452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-08e05ac8-3bef-44f1-b5b2-1d8675d9cd6d Jun 23 16:41:23 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:24 devstack sudo[107446]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-71592238-6e44-44bf-a7da-ce9da69b9b4c tempest-TestInstancesWithCinderVolumes-865228744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d607b6f6-a013-44e8-bd80-e8a3d6356a83" returned: 1 in 1.176s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-71592238-6e44-44bf-a7da-ce9da69b9b4c tempest-TestInstancesWithCinderVolumes-865228744 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d607b6f6-a013-44e8-bd80-e8a3d6356a83' failed. Not Retrying. {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:41:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-71592238-6e44-44bf-a7da-ce9da69b9b4c tempest-TestInstancesWithCinderVolumes-865228744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d607b6f6-a013-44e8-bd80-e8a3d6356a83 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:24 devstack sudo[107457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d607b6f6-a013-44e8-bd80-e8a3d6356a83 Jun 23 16:41:24 devstack sudo[107457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:24 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e8e20701-2a21-484f-899c-83b48c0da362 tempest-VolumesGetTest-1550830579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-08e05ac8-3bef-44f1-b5b2-1d8675d9cd6d" returned: 0 in 0.850s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:24 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e8e20701-2a21-484f-899c-83b48c0da362 tempest-VolumesGetTest-1550830579 None] Lock "cinder-quobyte-08e05ac8-3bef-44f1-b5b2-1d8675d9cd6d" released by "delete_volume" :: held 3.126s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:41:24 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-e8e20701-2a21-484f-899c-83b48c0da362 tempest-VolumesGetTest-1550830579 None] Created reservations ['19a267a8-cee3-401f-843d-dba09088fb8e', 'dda58e0b-e640-421a-b348-150cf25aabed', '37d7746b-dd7f-4740-9b63-789578e48bb5', '4d435866-0838-4b7a-b1a2-160890131deb'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:41:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e8e20701-2a21-484f-899c-83b48c0da362 tempest-VolumesGetTest-1550830579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:41:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e8e20701-2a21-484f-899c-83b48c0da362 tempest-VolumesGetTest-1550830579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:41:24 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e8e20701-2a21-484f-899c-83b48c0da362 tempest-VolumesGetTest-1550830579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:41:24 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e8e20701-2a21-484f-899c-83b48c0da362 tempest-VolumesGetTest-1550830579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:41:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e8e20701-2a21-484f-899c-83b48c0da362 tempest-VolumesGetTest-1550830579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:41:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e8e20701-2a21-484f-899c-83b48c0da362 tempest-VolumesGetTest-1550830579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:24 devstack sudo[107460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:41:24 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:25 devstack sudo[107457]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-71592238-6e44-44bf-a7da-ce9da69b9b4c tempest-TestInstancesWithCinderVolumes-865228744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d607b6f6-a013-44e8-bd80-e8a3d6356a83" returned: 0 in 0.913s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:25 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-71592238-6e44-44bf-a7da-ce9da69b9b4c tempest-TestInstancesWithCinderVolumes-865228744 None] Lock "cinder-quobyte-d607b6f6-a013-44e8-bd80-e8a3d6356a83" released by "delete_volume" :: held 3.311s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:41:25 devstack cinder-volume[93788]: WARNING cinder.quota [None req-71592238-6e44-44bf-a7da-ce9da69b9b4c tempest-TestInstancesWithCinderVolumes-865228744 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1654058162-2077870705 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1654058162-2077870705, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:41:25 devstack cinder-volume[93788]: WARNING cinder.quota [None req-71592238-6e44-44bf-a7da-ce9da69b9b4c tempest-TestInstancesWithCinderVolumes-865228744 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1654058162-2077870705 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1654058162-2077870705, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:41:25 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-71592238-6e44-44bf-a7da-ce9da69b9b4c tempest-TestInstancesWithCinderVolumes-865228744 None] Created reservations ['f8e174ad-3fb3-4d86-980b-859fd3573835', 'aab0e413-240c-4a20-b667-8e37160ea5ee', '063a7fdc-74cb-43f3-b9bf-a9f54ad477fb', 'f6d313fd-d757-48be-9c24-44d2faeb8b52'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:41:25 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-12ebacfe-9b61-48d7-85b3-d48bee1ddc31 tempest-CreateVolumesFromImageTest-554272876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:41:25 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-12ebacfe-9b61-48d7-85b3-d48bee1ddc31 tempest-CreateVolumesFromImageTest-554272876 None] Flow 'volume_create_manager' (d33dd517-5492-4f22-b5db-4cbb3fce2d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:41:25 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-12ebacfe-9b61-48d7-85b3-d48bee1ddc31 tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2671565-87bc-48ba-8f41-71c2cfdd81c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:25 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-12ebacfe-9b61-48d7-85b3-d48bee1ddc31 tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2671565-87bc-48ba-8f41-71c2cfdd81c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1666030106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38d0552e-ec8c-4647-aa6d-645bb08d0dc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8f250ad50b04d16b59bce1e1b44c79c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:41:25Z,use_quota=True,user_id='f79f13671d724883a9c0d5ba25c5ab29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:25 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-12ebacfe-9b61-48d7-85b3-d48bee1ddc31 tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fccfdca8-df2b-40d7-8c6e-1e321fe71ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:25 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-12ebacfe-9b61-48d7-85b3-d48bee1ddc31 tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fccfdca8-df2b-40d7-8c6e-1e321fe71ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:25 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-12ebacfe-9b61-48d7-85b3-d48bee1ddc31 tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a86ba3dd-62db-4788-bbbc-db6f8ce3c22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:25 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-12ebacfe-9b61-48d7-85b3-d48bee1ddc31 tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a86ba3dd-62db-4788-bbbc-db6f8ce3c22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38d0552e-ec8c-4647-aa6d-645bb08d0dc4', 'volume_name': 'volume-38d0552e-ec8c-4647-aa6d-645bb08d0dc4', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:25 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-12ebacfe-9b61-48d7-85b3-d48bee1ddc31 tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90d7577a-4c1f-4acc-a90a-d49bf9aa55ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:25 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-12ebacfe-9b61-48d7-85b3-d48bee1ddc31 tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90d7577a-4c1f-4acc-a90a-d49bf9aa55ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:25 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-12ebacfe-9b61-48d7-85b3-d48bee1ddc31 tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8a9f914-2985-497c-bfd6-b1ea75086417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:25 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-12ebacfe-9b61-48d7-85b3-d48bee1ddc31 tempest-CreateVolumesFromImageTest-554272876 None] Volume 38d0552e-ec8c-4647-aa6d-645bb08d0dc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38d0552e-ec8c-4647-aa6d-645bb08d0dc4', 'volume_size': 1} Jun 23 16:41:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-12ebacfe-9b61-48d7-85b3-d48bee1ddc31 tempest-CreateVolumesFromImageTest-554272876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:41:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-12ebacfe-9b61-48d7-85b3-d48bee1ddc31 tempest-CreateVolumesFromImageTest-554272876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:41:25 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-12ebacfe-9b61-48d7-85b3-d48bee1ddc31 tempest-CreateVolumesFromImageTest-554272876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1666030106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38d0552e-ec8c-4647-aa6d-645bb08d0dc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8f250ad50b04d16b59bce1e1b44c79c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:41:25Z,use_quota=True,user_id='f79f13671d724883a9c0d5ba25c5ab29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:41:25 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-12ebacfe-9b61-48d7-85b3-d48bee1ddc31 tempest-CreateVolumesFromImageTest-554272876 None] Creating volume 38d0552e-ec8c-4647-aa6d-645bb08d0dc4 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:41:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-12ebacfe-9b61-48d7-85b3-d48bee1ddc31 tempest-CreateVolumesFromImageTest-554272876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:41:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-12ebacfe-9b61-48d7-85b3-d48bee1ddc31 tempest-CreateVolumesFromImageTest-554272876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:41:25 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-12ebacfe-9b61-48d7-85b3-d48bee1ddc31 tempest-CreateVolumesFromImageTest-554272876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:41:25 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-12ebacfe-9b61-48d7-85b3-d48bee1ddc31 tempest-CreateVolumesFromImageTest-554272876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:41:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-12ebacfe-9b61-48d7-85b3-d48bee1ddc31 tempest-CreateVolumesFromImageTest-554272876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:41:25 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-12ebacfe-9b61-48d7-85b3-d48bee1ddc31 tempest-CreateVolumesFromImageTest-554272876 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:41:25 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-12ebacfe-9b61-48d7-85b3-d48bee1ddc31 tempest-CreateVolumesFromImageTest-554272876 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:41:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-12ebacfe-9b61-48d7-85b3-d48bee1ddc31 tempest-CreateVolumesFromImageTest-554272876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-38d0552e-ec8c-4647-aa6d-645bb08d0dc4 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:25 devstack sudo[107463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-38d0552e-ec8c-4647-aa6d-645bb08d0dc4 1073741824 Jun 23 16:41:25 devstack sudo[107463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-71592238-6e44-44bf-a7da-ce9da69b9b4c tempest-TestInstancesWithCinderVolumes-865228744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:41:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-71592238-6e44-44bf-a7da-ce9da69b9b4c tempest-TestInstancesWithCinderVolumes-865228744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:41:25 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-71592238-6e44-44bf-a7da-ce9da69b9b4c tempest-TestInstancesWithCinderVolumes-865228744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:41:25 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-71592238-6e44-44bf-a7da-ce9da69b9b4c tempest-TestInstancesWithCinderVolumes-865228744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:41:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-71592238-6e44-44bf-a7da-ce9da69b9b4c tempest-TestInstancesWithCinderVolumes-865228744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:41:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-71592238-6e44-44bf-a7da-ce9da69b9b4c tempest-TestInstancesWithCinderVolumes-865228744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:25 devstack sudo[107465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:41:25 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:25 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-491da200-3728-437f-aa9b-9ba1db0e693f tempest-CreateVolumesFromImageTest-554272876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:41:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-491da200-3728-437f-aa9b-9ba1db0e693f tempest-CreateVolumesFromImageTest-554272876 None] Flow 'volume_create_manager' (2c4d9fea-438f-4ed2-b235-e0f5f1a56da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:41:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-491da200-3728-437f-aa9b-9ba1db0e693f tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31267ae0-dbaf-4863-ac25-65637e37a8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-491da200-3728-437f-aa9b-9ba1db0e693f tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31267ae0-dbaf-4863-ac25-65637e37a8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-52929524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43591cbe-f576-4be2-8029-8ffe9eeeae41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8f250ad50b04d16b59bce1e1b44c79c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:41:26Z,use_quota=True,user_id='f79f13671d724883a9c0d5ba25c5ab29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:26 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-491da200-3728-437f-aa9b-9ba1db0e693f tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc755785-06ea-431e-855b-d836640ff86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-491da200-3728-437f-aa9b-9ba1db0e693f tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc755785-06ea-431e-855b-d836640ff86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-491da200-3728-437f-aa9b-9ba1db0e693f tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (886c91e0-a0f0-442c-9963-1d0dd786e56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-491da200-3728-437f-aa9b-9ba1db0e693f tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (886c91e0-a0f0-442c-9963-1d0dd786e56c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43591cbe-f576-4be2-8029-8ffe9eeeae41', 'volume_name': 'volume-43591cbe-f576-4be2-8029-8ffe9eeeae41', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-491da200-3728-437f-aa9b-9ba1db0e693f tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d0a3530-5fce-4fb9-abab-4656027e8861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-491da200-3728-437f-aa9b-9ba1db0e693f tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d0a3530-5fce-4fb9-abab-4656027e8861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-491da200-3728-437f-aa9b-9ba1db0e693f tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4f8d545-24ea-4b67-bb9c-861b8042173c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:26 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-491da200-3728-437f-aa9b-9ba1db0e693f tempest-CreateVolumesFromImageTest-554272876 None] Volume 43591cbe-f576-4be2-8029-8ffe9eeeae41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43591cbe-f576-4be2-8029-8ffe9eeeae41', 'volume_size': 1} Jun 23 16:41:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-491da200-3728-437f-aa9b-9ba1db0e693f tempest-CreateVolumesFromImageTest-554272876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:41:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e8e20701-2a21-484f-899c-83b48c0da362 tempest-VolumesGetTest-1550830579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.395s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:26 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-e8e20701-2a21-484f-899c-83b48c0da362 tempest-VolumesGetTest-1550830579 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:41:26 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-e8e20701-2a21-484f-899c-83b48c0da362 tempest-VolumesGetTest-1550830579 None] Deleted volume successfully. Jun 23 16:41:26 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e8e20701-2a21-484f-899c-83b48c0da362 tempest-VolumesGetTest-1550830579 None] Lock "cinder-08e05ac8-3bef-44f1-b5b2-1d8675d9cd6d-delete_volume" released by "delete_volume" :: held 4.876s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:41:26 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-71592238-6e44-44bf-a7da-ce9da69b9b4c tempest-TestInstancesWithCinderVolumes-865228744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.015s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:26 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-71592238-6e44-44bf-a7da-ce9da69b9b4c tempest-TestInstancesWithCinderVolumes-865228744 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:41:26 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-71592238-6e44-44bf-a7da-ce9da69b9b4c tempest-TestInstancesWithCinderVolumes-865228744 None] Deleted volume successfully. Jun 23 16:41:26 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-71592238-6e44-44bf-a7da-ce9da69b9b4c tempest-TestInstancesWithCinderVolumes-865228744 None] Lock "cinder-d607b6f6-a013-44e8-bd80-e8a3d6356a83-delete_volume" released by "delete_volume" :: held 4.866s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:41:26 devstack sudo[107463]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-12ebacfe-9b61-48d7-85b3-d48bee1ddc31 tempest-CreateVolumesFromImageTest-554272876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-38d0552e-ec8c-4647-aa6d-645bb08d0dc4 1073741824" returned: 0 in 1.315s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-12ebacfe-9b61-48d7-85b3-d48bee1ddc31 tempest-CreateVolumesFromImageTest-554272876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-38d0552e-ec8c-4647-aa6d-645bb08d0dc4 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:26 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-38d0552e-ec8c-4647-aa6d-645bb08d0dc4 Jun 23 16:41:26 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:26 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c57a57e-177f-4a9a-b46f-1b9f07b5724e tempest-CreateVolumesFromImageTest-554272876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:41:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4c57a57e-177f-4a9a-b46f-1b9f07b5724e tempest-CreateVolumesFromImageTest-554272876 None] Flow 'volume_create_manager' (ae9dc020-8dd0-48c0-8add-c2238c704ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:41:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4c57a57e-177f-4a9a-b46f-1b9f07b5724e tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37239af4-f4e5-4b22-947f-c05477ad90f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4c57a57e-177f-4a9a-b46f-1b9f07b5724e tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37239af4-f4e5-4b22-947f-c05477ad90f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1002925491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68e7255a-ce4b-4712-9cfb-cf8754afc6e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8f250ad50b04d16b59bce1e1b44c79c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:41:27Z,use_quota=True,user_id='f79f13671d724883a9c0d5ba25c5ab29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4c57a57e-177f-4a9a-b46f-1b9f07b5724e tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (835726db-c1f5-4236-bff6-2b25a44f44fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4c57a57e-177f-4a9a-b46f-1b9f07b5724e tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (835726db-c1f5-4236-bff6-2b25a44f44fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4c57a57e-177f-4a9a-b46f-1b9f07b5724e tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9a7da49-2fff-4a34-b1e4-6392f9bdb164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4c57a57e-177f-4a9a-b46f-1b9f07b5724e tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9a7da49-2fff-4a34-b1e4-6392f9bdb164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68e7255a-ce4b-4712-9cfb-cf8754afc6e2', 'volume_name': 'volume-68e7255a-ce4b-4712-9cfb-cf8754afc6e2', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4c57a57e-177f-4a9a-b46f-1b9f07b5724e tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6216cd61-f055-4967-9481-47a3d6d63ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4c57a57e-177f-4a9a-b46f-1b9f07b5724e tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6216cd61-f055-4967-9481-47a3d6d63ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4c57a57e-177f-4a9a-b46f-1b9f07b5724e tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fe53880-4cd8-481e-9c65-2a3b237e3ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:27 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-4c57a57e-177f-4a9a-b46f-1b9f07b5724e tempest-CreateVolumesFromImageTest-554272876 None] Volume 68e7255a-ce4b-4712-9cfb-cf8754afc6e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68e7255a-ce4b-4712-9cfb-cf8754afc6e2', 'volume_size': 1} Jun 23 16:41:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-4c57a57e-177f-4a9a-b46f-1b9f07b5724e tempest-CreateVolumesFromImageTest-554272876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:41:27 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-a74760bb-9861-454a-9d81-deda915a6255 tempest-CreateVolumesFromImageTest-554272876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:41:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a74760bb-9861-454a-9d81-deda915a6255 tempest-CreateVolumesFromImageTest-554272876 None] Flow 'volume_create_manager' (46f8f72a-49e9-4601-9dcb-d3c5f7a1cd55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:41:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a74760bb-9861-454a-9d81-deda915a6255 tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7793c2c-2c3b-44bb-9454-039e2efb309a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a74760bb-9861-454a-9d81-deda915a6255 tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7793c2c-2c3b-44bb-9454-039e2efb309a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1079370009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38d30448-6bd2-41e7-baa6-e6b78531c105,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8f250ad50b04d16b59bce1e1b44c79c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:41:27Z,use_quota=True,user_id='f79f13671d724883a9c0d5ba25c5ab29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a74760bb-9861-454a-9d81-deda915a6255 tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a656c7c0-84c6-4492-acfa-9e4b42c97053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a74760bb-9861-454a-9d81-deda915a6255 tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a656c7c0-84c6-4492-acfa-9e4b42c97053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a74760bb-9861-454a-9d81-deda915a6255 tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13ecdaa8-2cbb-418f-b781-95eff3af03bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a74760bb-9861-454a-9d81-deda915a6255 tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13ecdaa8-2cbb-418f-b781-95eff3af03bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38d30448-6bd2-41e7-baa6-e6b78531c105', 'volume_name': 'volume-38d30448-6bd2-41e7-baa6-e6b78531c105', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a74760bb-9861-454a-9d81-deda915a6255 tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ad16600-bfda-45ad-9582-7207418194ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a74760bb-9861-454a-9d81-deda915a6255 tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ad16600-bfda-45ad-9582-7207418194ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a74760bb-9861-454a-9d81-deda915a6255 tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f67b65eb-07d3-437d-9fbf-08176bbe4d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:27 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-a74760bb-9861-454a-9d81-deda915a6255 tempest-CreateVolumesFromImageTest-554272876 None] Volume 38d30448-6bd2-41e7-baa6-e6b78531c105: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38d30448-6bd2-41e7-baa6-e6b78531c105', 'volume_size': 1} Jun 23 16:41:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a74760bb-9861-454a-9d81-deda915a6255 tempest-CreateVolumesFromImageTest-554272876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:41:27 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-c43d0ce3-c1d5-477a-a544-708493c1fdc7 tempest-VolumesListTestJSON-1762966689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:41:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c43d0ce3-c1d5-477a-a544-708493c1fdc7 tempest-VolumesListTestJSON-1762966689 None] Flow 'volume_create_manager' (be3dceaa-8edf-480b-b1db-d17b39dd2b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:41:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c43d0ce3-c1d5-477a-a544-708493c1fdc7 tempest-VolumesListTestJSON-1762966689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a83c9a0-2a94-4259-a468-7803ab622907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c43d0ce3-c1d5-477a-a544-708493c1fdc7 tempest-VolumesListTestJSON-1762966689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a83c9a0-2a94-4259-a468-7803ab622907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-449071817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40cb182b-b1df-40bd-a840-6deb58151a39,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cfa86c06e7874ae1afaeca72a58c3b44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:41:28Z,use_quota=True,user_id='4af9dbbeecaf444e81dd664d088adda0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c43d0ce3-c1d5-477a-a544-708493c1fdc7 tempest-VolumesListTestJSON-1762966689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (862bf7c1-9328-425d-b733-ac6e96e43760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c43d0ce3-c1d5-477a-a544-708493c1fdc7 tempest-VolumesListTestJSON-1762966689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (862bf7c1-9328-425d-b733-ac6e96e43760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c43d0ce3-c1d5-477a-a544-708493c1fdc7 tempest-VolumesListTestJSON-1762966689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ec427d9-7744-4570-949f-0643398abf21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c43d0ce3-c1d5-477a-a544-708493c1fdc7 tempest-VolumesListTestJSON-1762966689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ec427d9-7744-4570-949f-0643398abf21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40cb182b-b1df-40bd-a840-6deb58151a39', 'volume_name': 'volume-40cb182b-b1df-40bd-a840-6deb58151a39', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c43d0ce3-c1d5-477a-a544-708493c1fdc7 tempest-VolumesListTestJSON-1762966689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (585b0c64-9700-4b2c-bc52-087af259cb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c43d0ce3-c1d5-477a-a544-708493c1fdc7 tempest-VolumesListTestJSON-1762966689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (585b0c64-9700-4b2c-bc52-087af259cb25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c43d0ce3-c1d5-477a-a544-708493c1fdc7 tempest-VolumesListTestJSON-1762966689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ce60eb9-1a04-4958-b10b-e3541da6b9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:27 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-c43d0ce3-c1d5-477a-a544-708493c1fdc7 tempest-VolumesListTestJSON-1762966689 None] Volume 40cb182b-b1df-40bd-a840-6deb58151a39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40cb182b-b1df-40bd-a840-6deb58151a39', 'volume_size': 1} Jun 23 16:41:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-c43d0ce3-c1d5-477a-a544-708493c1fdc7 tempest-VolumesListTestJSON-1762966689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:41:27 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d04728e-08b6-4d07-b2b1-1415e271519a tempest-CreateVolumesFromImageTest-554272876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:41:27 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-3d04728e-08b6-4d07-b2b1-1415e271519a tempest-CreateVolumesFromImageTest-554272876 None] Flow 'volume_create_manager' (d03768c4-6182-4909-8ce2-453370807c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:41:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-3d04728e-08b6-4d07-b2b1-1415e271519a tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0e65241-9d56-4649-afc2-e5c46a6c7ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-12ebacfe-9b61-48d7-85b3-d48bee1ddc31 tempest-CreateVolumesFromImageTest-554272876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-38d0552e-ec8c-4647-aa6d-645bb08d0dc4" returned: 0 in 1.174s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:27 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-12ebacfe-9b61-48d7-85b3-d48bee1ddc31 tempest-CreateVolumesFromImageTest-554272876 None] <== create_volume: return (2555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:41:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-12ebacfe-9b61-48d7-85b3-d48bee1ddc31 tempest-CreateVolumesFromImageTest-554272876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.559s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:41:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-491da200-3728-437f-aa9b-9ba1db0e693f tempest-CreateVolumesFromImageTest-554272876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.837s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:41:27 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-491da200-3728-437f-aa9b-9ba1db0e693f tempest-CreateVolumesFromImageTest-554272876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-52929524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43591cbe-f576-4be2-8029-8ffe9eeeae41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8f250ad50b04d16b59bce1e1b44c79c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:41:26Z,use_quota=True,user_id='f79f13671d724883a9c0d5ba25c5ab29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:41:27 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-491da200-3728-437f-aa9b-9ba1db0e693f tempest-CreateVolumesFromImageTest-554272876 None] Creating volume 43591cbe-f576-4be2-8029-8ffe9eeeae41 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:41:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-491da200-3728-437f-aa9b-9ba1db0e693f tempest-CreateVolumesFromImageTest-554272876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:41:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-491da200-3728-437f-aa9b-9ba1db0e693f tempest-CreateVolumesFromImageTest-554272876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:41:27 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-491da200-3728-437f-aa9b-9ba1db0e693f tempest-CreateVolumesFromImageTest-554272876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:41:27 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-491da200-3728-437f-aa9b-9ba1db0e693f tempest-CreateVolumesFromImageTest-554272876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:41:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-491da200-3728-437f-aa9b-9ba1db0e693f tempest-CreateVolumesFromImageTest-554272876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:41:27 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-491da200-3728-437f-aa9b-9ba1db0e693f tempest-CreateVolumesFromImageTest-554272876 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:41:27 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-491da200-3728-437f-aa9b-9ba1db0e693f tempest-CreateVolumesFromImageTest-554272876 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:41:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-491da200-3728-437f-aa9b-9ba1db0e693f tempest-CreateVolumesFromImageTest-554272876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-43591cbe-f576-4be2-8029-8ffe9eeeae41 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:28 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-3d04728e-08b6-4d07-b2b1-1415e271519a tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0e65241-9d56-4649-afc2-e5c46a6c7ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2079511462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=739605ab-d157-496e-b27f-fa24396e8a73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8f250ad50b04d16b59bce1e1b44c79c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:41:28Z,use_quota=True,user_id='f79f13671d724883a9c0d5ba25c5ab29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:28 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-43591cbe-f576-4be2-8029-8ffe9eeeae41 1073741824 Jun 23 16:41:28 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:28 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-3d04728e-08b6-4d07-b2b1-1415e271519a tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (594b0d90-510f-4b3d-8857-017c395f415c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:28 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-3d04728e-08b6-4d07-b2b1-1415e271519a tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (594b0d90-510f-4b3d-8857-017c395f415c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:28 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-3d04728e-08b6-4d07-b2b1-1415e271519a tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b8717ae-7ed2-4084-850d-b7f807532139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:28 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-3d04728e-08b6-4d07-b2b1-1415e271519a tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b8717ae-7ed2-4084-850d-b7f807532139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '739605ab-d157-496e-b27f-fa24396e8a73', 'volume_name': 'volume-739605ab-d157-496e-b27f-fa24396e8a73', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:28 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-3d04728e-08b6-4d07-b2b1-1415e271519a tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fad650c3-f38e-410f-b951-081ef20edcef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:28 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-3d04728e-08b6-4d07-b2b1-1415e271519a tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fad650c3-f38e-410f-b951-081ef20edcef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:28 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-3d04728e-08b6-4d07-b2b1-1415e271519a tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d48d909-f364-4fd1-a65b-c8debfb5b0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:28 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-3d04728e-08b6-4d07-b2b1-1415e271519a tempest-CreateVolumesFromImageTest-554272876 None] Volume 739605ab-d157-496e-b27f-fa24396e8a73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-739605ab-d157-496e-b27f-fa24396e8a73', 'volume_size': 1} Jun 23 16:41:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-3d04728e-08b6-4d07-b2b1-1415e271519a tempest-CreateVolumesFromImageTest-554272876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:41:28 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-12ebacfe-9b61-48d7-85b3-d48bee1ddc31 tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8a9f914-2985-497c-bfd6-b1ea75086417) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38d0552e-ec8c-4647-aa6d-645bb08d0dc4', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:28 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-12ebacfe-9b61-48d7-85b3-d48bee1ddc31 tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (507c0433-044d-48d9-8613-a70ddc4a8c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:28 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-12ebacfe-9b61-48d7-85b3-d48bee1ddc31 tempest-CreateVolumesFromImageTest-554272876 None] Volume volume-38d0552e-ec8c-4647-aa6d-645bb08d0dc4 (38d0552e-ec8c-4647-aa6d-645bb08d0dc4): created successfully Jun 23 16:41:28 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-12ebacfe-9b61-48d7-85b3-d48bee1ddc31 tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (507c0433-044d-48d9-8613-a70ddc4a8c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:28 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-12ebacfe-9b61-48d7-85b3-d48bee1ddc31 tempest-CreateVolumesFromImageTest-554272876 None] Flow 'volume_create_manager' (d33dd517-5492-4f22-b5db-4cbb3fce2d0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:41:28 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-12ebacfe-9b61-48d7-85b3-d48bee1ddc31 tempest-CreateVolumesFromImageTest-554272876 None] Created volume successfully. Jun 23 16:41:29 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-491da200-3728-437f-aa9b-9ba1db0e693f tempest-CreateVolumesFromImageTest-554272876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-43591cbe-f576-4be2-8029-8ffe9eeeae41 1073741824" returned: 0 in 1.018s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-491da200-3728-437f-aa9b-9ba1db0e693f tempest-CreateVolumesFromImageTest-554272876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-43591cbe-f576-4be2-8029-8ffe9eeeae41 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:29 devstack sudo[107484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-43591cbe-f576-4be2-8029-8ffe9eeeae41 Jun 23 16:41:29 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:29 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-491da200-3728-437f-aa9b-9ba1db0e693f tempest-CreateVolumesFromImageTest-554272876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-43591cbe-f576-4be2-8029-8ffe9eeeae41" returned: 0 in 0.776s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:29 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-491da200-3728-437f-aa9b-9ba1db0e693f tempest-CreateVolumesFromImageTest-554272876 None] <== create_volume: return (1843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:41:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-491da200-3728-437f-aa9b-9ba1db0e693f tempest-CreateVolumesFromImageTest-554272876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.846s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:41:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-4c57a57e-177f-4a9a-b46f-1b9f07b5724e tempest-CreateVolumesFromImageTest-554272876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.803s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:41:29 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-4c57a57e-177f-4a9a-b46f-1b9f07b5724e tempest-CreateVolumesFromImageTest-554272876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1002925491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68e7255a-ce4b-4712-9cfb-cf8754afc6e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8f250ad50b04d16b59bce1e1b44c79c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:41:27Z,use_quota=True,user_id='f79f13671d724883a9c0d5ba25c5ab29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:41:29 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-4c57a57e-177f-4a9a-b46f-1b9f07b5724e tempest-CreateVolumesFromImageTest-554272876 None] Creating volume 68e7255a-ce4b-4712-9cfb-cf8754afc6e2 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:41:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-4c57a57e-177f-4a9a-b46f-1b9f07b5724e tempest-CreateVolumesFromImageTest-554272876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:41:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-4c57a57e-177f-4a9a-b46f-1b9f07b5724e tempest-CreateVolumesFromImageTest-554272876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:41:29 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-4c57a57e-177f-4a9a-b46f-1b9f07b5724e tempest-CreateVolumesFromImageTest-554272876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:41:29 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-4c57a57e-177f-4a9a-b46f-1b9f07b5724e tempest-CreateVolumesFromImageTest-554272876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:41:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-4c57a57e-177f-4a9a-b46f-1b9f07b5724e tempest-CreateVolumesFromImageTest-554272876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:41:29 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-4c57a57e-177f-4a9a-b46f-1b9f07b5724e tempest-CreateVolumesFromImageTest-554272876 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:41:29 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-4c57a57e-177f-4a9a-b46f-1b9f07b5724e tempest-CreateVolumesFromImageTest-554272876 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:41:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4c57a57e-177f-4a9a-b46f-1b9f07b5724e tempest-CreateVolumesFromImageTest-554272876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-68e7255a-ce4b-4712-9cfb-cf8754afc6e2 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:29 devstack sudo[107489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-68e7255a-ce4b-4712-9cfb-cf8754afc6e2 1073741824 Jun 23 16:41:29 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:29 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-491da200-3728-437f-aa9b-9ba1db0e693f tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4f8d545-24ea-4b67-bb9c-861b8042173c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43591cbe-f576-4be2-8029-8ffe9eeeae41', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:29 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-491da200-3728-437f-aa9b-9ba1db0e693f tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a2b6a33-52db-49d5-9c0a-5bb7fa7926ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:29 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-491da200-3728-437f-aa9b-9ba1db0e693f tempest-CreateVolumesFromImageTest-554272876 None] Volume volume-43591cbe-f576-4be2-8029-8ffe9eeeae41 (43591cbe-f576-4be2-8029-8ffe9eeeae41): created successfully Jun 23 16:41:29 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-491da200-3728-437f-aa9b-9ba1db0e693f tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a2b6a33-52db-49d5-9c0a-5bb7fa7926ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:29 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-491da200-3728-437f-aa9b-9ba1db0e693f tempest-CreateVolumesFromImageTest-554272876 None] Flow 'volume_create_manager' (2c4d9fea-438f-4ed2-b235-e0f5f1a56da8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:41:29 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-491da200-3728-437f-aa9b-9ba1db0e693f tempest-CreateVolumesFromImageTest-554272876 None] Created volume successfully. Jun 23 16:41:30 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-2547eaf7-7f19-4dd5-ad9a-47e06b228030 tempest-VolumesNegativeTest-1121631231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:41:30 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2547eaf7-7f19-4dd5-ad9a-47e06b228030 tempest-VolumesNegativeTest-1121631231 None] Flow 'volume_create_manager' (51f39a76-afb8-4384-9fae-e42d88068956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:41:30 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2547eaf7-7f19-4dd5-ad9a-47e06b228030 tempest-VolumesNegativeTest-1121631231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15b2d3fd-c899-4a1f-ac5a-6b0baf719de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:30 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2547eaf7-7f19-4dd5-ad9a-47e06b228030 tempest-VolumesNegativeTest-1121631231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15b2d3fd-c899-4a1f-ac5a-6b0baf719de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1844542798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e8c60b2-8b4e-4be3-a79a-0e71c2b5e86f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08a23f0dee354fc2bd38584056837a3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:41:30Z,use_quota=True,user_id='b40b6e6c283146d0b562f1671e477eaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:30 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2547eaf7-7f19-4dd5-ad9a-47e06b228030 tempest-VolumesNegativeTest-1121631231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec112e84-bd67-476e-ba12-895153d89422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:30 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2547eaf7-7f19-4dd5-ad9a-47e06b228030 tempest-VolumesNegativeTest-1121631231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec112e84-bd67-476e-ba12-895153d89422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:30 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2547eaf7-7f19-4dd5-ad9a-47e06b228030 tempest-VolumesNegativeTest-1121631231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a84de971-9db6-4ecb-858c-4491a25f6bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:30 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2547eaf7-7f19-4dd5-ad9a-47e06b228030 tempest-VolumesNegativeTest-1121631231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a84de971-9db6-4ecb-858c-4491a25f6bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e8c60b2-8b4e-4be3-a79a-0e71c2b5e86f', 'volume_name': 'volume-2e8c60b2-8b4e-4be3-a79a-0e71c2b5e86f', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:30 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2547eaf7-7f19-4dd5-ad9a-47e06b228030 tempest-VolumesNegativeTest-1121631231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad8192e3-0375-498b-ab1e-deffc520066f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:30 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2547eaf7-7f19-4dd5-ad9a-47e06b228030 tempest-VolumesNegativeTest-1121631231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad8192e3-0375-498b-ab1e-deffc520066f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:30 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2547eaf7-7f19-4dd5-ad9a-47e06b228030 tempest-VolumesNegativeTest-1121631231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8671523f-c922-4e73-89a1-3316ace31dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:30 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-2547eaf7-7f19-4dd5-ad9a-47e06b228030 tempest-VolumesNegativeTest-1121631231 None] Volume 2e8c60b2-8b4e-4be3-a79a-0e71c2b5e86f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e8c60b2-8b4e-4be3-a79a-0e71c2b5e86f', 'volume_size': 1} Jun 23 16:41:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-2547eaf7-7f19-4dd5-ad9a-47e06b228030 tempest-VolumesNegativeTest-1121631231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:41:30 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4c57a57e-177f-4a9a-b46f-1b9f07b5724e tempest-CreateVolumesFromImageTest-554272876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-68e7255a-ce4b-4712-9cfb-cf8754afc6e2 1073741824" returned: 0 in 1.053s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4c57a57e-177f-4a9a-b46f-1b9f07b5724e tempest-CreateVolumesFromImageTest-554272876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-68e7255a-ce4b-4712-9cfb-cf8754afc6e2 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:30 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-68e7255a-ce4b-4712-9cfb-cf8754afc6e2 Jun 23 16:41:30 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:31 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:31 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4c57a57e-177f-4a9a-b46f-1b9f07b5724e tempest-CreateVolumesFromImageTest-554272876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-68e7255a-ce4b-4712-9cfb-cf8754afc6e2" returned: 0 in 0.771s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:31 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-4c57a57e-177f-4a9a-b46f-1b9f07b5724e tempest-CreateVolumesFromImageTest-554272876 None] <== create_volume: return (1884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:41:31 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-4c57a57e-177f-4a9a-b46f-1b9f07b5724e tempest-CreateVolumesFromImageTest-554272876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.889s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:41:31 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a74760bb-9861-454a-9d81-deda915a6255 tempest-CreateVolumesFromImageTest-554272876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.195s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:41:31 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-a74760bb-9861-454a-9d81-deda915a6255 tempest-CreateVolumesFromImageTest-554272876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1079370009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38d30448-6bd2-41e7-baa6-e6b78531c105,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8f250ad50b04d16b59bce1e1b44c79c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:41:27Z,use_quota=True,user_id='f79f13671d724883a9c0d5ba25c5ab29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:41:31 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-a74760bb-9861-454a-9d81-deda915a6255 tempest-CreateVolumesFromImageTest-554272876 None] Creating volume 38d30448-6bd2-41e7-baa6-e6b78531c105 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:41:31 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a74760bb-9861-454a-9d81-deda915a6255 tempest-CreateVolumesFromImageTest-554272876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:41:31 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a74760bb-9861-454a-9d81-deda915a6255 tempest-CreateVolumesFromImageTest-554272876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:41:31 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-a74760bb-9861-454a-9d81-deda915a6255 tempest-CreateVolumesFromImageTest-554272876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:41:31 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-a74760bb-9861-454a-9d81-deda915a6255 tempest-CreateVolumesFromImageTest-554272876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:41:31 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a74760bb-9861-454a-9d81-deda915a6255 tempest-CreateVolumesFromImageTest-554272876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:41:31 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-a74760bb-9861-454a-9d81-deda915a6255 tempest-CreateVolumesFromImageTest-554272876 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:41:31 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-a74760bb-9861-454a-9d81-deda915a6255 tempest-CreateVolumesFromImageTest-554272876 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:41:31 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a74760bb-9861-454a-9d81-deda915a6255 tempest-CreateVolumesFromImageTest-554272876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-38d30448-6bd2-41e7-baa6-e6b78531c105 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:31 devstack sudo[107500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-38d30448-6bd2-41e7-baa6-e6b78531c105 1073741824 Jun 23 16:41:31 devstack sudo[107500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:31 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4c57a57e-177f-4a9a-b46f-1b9f07b5724e tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fe53880-4cd8-481e-9c65-2a3b237e3ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68e7255a-ce4b-4712-9cfb-cf8754afc6e2', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:31 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4c57a57e-177f-4a9a-b46f-1b9f07b5724e tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c57a384-97b0-488c-816b-e9d29e0079ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:31 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-4c57a57e-177f-4a9a-b46f-1b9f07b5724e tempest-CreateVolumesFromImageTest-554272876 None] Volume volume-68e7255a-ce4b-4712-9cfb-cf8754afc6e2 (68e7255a-ce4b-4712-9cfb-cf8754afc6e2): created successfully Jun 23 16:41:31 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4c57a57e-177f-4a9a-b46f-1b9f07b5724e tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c57a384-97b0-488c-816b-e9d29e0079ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:31 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4c57a57e-177f-4a9a-b46f-1b9f07b5724e tempest-CreateVolumesFromImageTest-554272876 None] Flow 'volume_create_manager' (ae9dc020-8dd0-48c0-8add-c2238c704ab1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:41:31 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-4c57a57e-177f-4a9a-b46f-1b9f07b5724e tempest-CreateVolumesFromImageTest-554272876 None] Created volume successfully. Jun 23 16:41:32 devstack sudo[107500]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a74760bb-9861-454a-9d81-deda915a6255 tempest-CreateVolumesFromImageTest-554272876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-38d30448-6bd2-41e7-baa6-e6b78531c105 1073741824" returned: 0 in 0.960s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a74760bb-9861-454a-9d81-deda915a6255 tempest-CreateVolumesFromImageTest-554272876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-38d30448-6bd2-41e7-baa6-e6b78531c105 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:32 devstack sudo[107507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-38d30448-6bd2-41e7-baa6-e6b78531c105 Jun 23 16:41:32 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:33 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:33 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a74760bb-9861-454a-9d81-deda915a6255 tempest-CreateVolumesFromImageTest-554272876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-38d30448-6bd2-41e7-baa6-e6b78531c105" returned: 0 in 0.698s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:33 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-a74760bb-9861-454a-9d81-deda915a6255 tempest-CreateVolumesFromImageTest-554272876 None] <== create_volume: return (1753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:41:33 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a74760bb-9861-454a-9d81-deda915a6255 tempest-CreateVolumesFromImageTest-554272876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.756s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:41:33 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-c43d0ce3-c1d5-477a-a544-708493c1fdc7 tempest-VolumesListTestJSON-1762966689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.586s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:41:33 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-c43d0ce3-c1d5-477a-a544-708493c1fdc7 tempest-VolumesListTestJSON-1762966689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-449071817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40cb182b-b1df-40bd-a840-6deb58151a39,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cfa86c06e7874ae1afaeca72a58c3b44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:41:28Z,use_quota=True,user_id='4af9dbbeecaf444e81dd664d088adda0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:41:33 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-c43d0ce3-c1d5-477a-a544-708493c1fdc7 tempest-VolumesListTestJSON-1762966689 None] Creating volume 40cb182b-b1df-40bd-a840-6deb58151a39 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:41:33 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-c43d0ce3-c1d5-477a-a544-708493c1fdc7 tempest-VolumesListTestJSON-1762966689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:41:33 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-c43d0ce3-c1d5-477a-a544-708493c1fdc7 tempest-VolumesListTestJSON-1762966689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:41:33 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-c43d0ce3-c1d5-477a-a544-708493c1fdc7 tempest-VolumesListTestJSON-1762966689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:41:33 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-c43d0ce3-c1d5-477a-a544-708493c1fdc7 tempest-VolumesListTestJSON-1762966689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:41:33 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-c43d0ce3-c1d5-477a-a544-708493c1fdc7 tempest-VolumesListTestJSON-1762966689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:41:33 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-c43d0ce3-c1d5-477a-a544-708493c1fdc7 tempest-VolumesListTestJSON-1762966689 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:41:33 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-c43d0ce3-c1d5-477a-a544-708493c1fdc7 tempest-VolumesListTestJSON-1762966689 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:41:33 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c43d0ce3-c1d5-477a-a544-708493c1fdc7 tempest-VolumesListTestJSON-1762966689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-40cb182b-b1df-40bd-a840-6deb58151a39 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:33 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a74760bb-9861-454a-9d81-deda915a6255 tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f67b65eb-07d3-437d-9fbf-08176bbe4d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38d30448-6bd2-41e7-baa6-e6b78531c105', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:33 devstack sudo[107510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-40cb182b-b1df-40bd-a840-6deb58151a39 1073741824 Jun 23 16:41:33 devstack sudo[107510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:33 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a74760bb-9861-454a-9d81-deda915a6255 tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0054d36d-8edc-4f22-9c16-9f530a66d7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:33 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-a74760bb-9861-454a-9d81-deda915a6255 tempest-CreateVolumesFromImageTest-554272876 None] Volume volume-38d30448-6bd2-41e7-baa6-e6b78531c105 (38d30448-6bd2-41e7-baa6-e6b78531c105): created successfully Jun 23 16:41:33 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a74760bb-9861-454a-9d81-deda915a6255 tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0054d36d-8edc-4f22-9c16-9f530a66d7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:33 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a74760bb-9861-454a-9d81-deda915a6255 tempest-CreateVolumesFromImageTest-554272876 None] Flow 'volume_create_manager' (46f8f72a-49e9-4601-9dcb-d3c5f7a1cd55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:41:33 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-a74760bb-9861-454a-9d81-deda915a6255 tempest-CreateVolumesFromImageTest-554272876 None] Created volume successfully. Jun 23 16:41:34 devstack sudo[107510]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c43d0ce3-c1d5-477a-a544-708493c1fdc7 tempest-VolumesListTestJSON-1762966689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-40cb182b-b1df-40bd-a840-6deb58151a39 1073741824" returned: 0 in 0.986s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c43d0ce3-c1d5-477a-a544-708493c1fdc7 tempest-VolumesListTestJSON-1762966689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-40cb182b-b1df-40bd-a840-6deb58151a39 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:34 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-40cb182b-b1df-40bd-a840-6deb58151a39 Jun 23 16:41:34 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:35 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c43d0ce3-c1d5-477a-a544-708493c1fdc7 tempest-VolumesListTestJSON-1762966689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-40cb182b-b1df-40bd-a840-6deb58151a39" returned: 0 in 0.731s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:35 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-c43d0ce3-c1d5-477a-a544-708493c1fdc7 tempest-VolumesListTestJSON-1762966689 None] <== create_volume: return (1765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:41:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-c43d0ce3-c1d5-477a-a544-708493c1fdc7 tempest-VolumesListTestJSON-1762966689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.770s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:41:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-3d04728e-08b6-4d07-b2b1-1415e271519a tempest-CreateVolumesFromImageTest-554272876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.211s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:41:35 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-3d04728e-08b6-4d07-b2b1-1415e271519a tempest-CreateVolumesFromImageTest-554272876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2079511462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=739605ab-d157-496e-b27f-fa24396e8a73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8f250ad50b04d16b59bce1e1b44c79c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:41:28Z,use_quota=True,user_id='f79f13671d724883a9c0d5ba25c5ab29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:41:35 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-3d04728e-08b6-4d07-b2b1-1415e271519a tempest-CreateVolumesFromImageTest-554272876 None] Creating volume 739605ab-d157-496e-b27f-fa24396e8a73 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:41:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-3d04728e-08b6-4d07-b2b1-1415e271519a tempest-CreateVolumesFromImageTest-554272876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:41:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-3d04728e-08b6-4d07-b2b1-1415e271519a tempest-CreateVolumesFromImageTest-554272876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:41:35 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-3d04728e-08b6-4d07-b2b1-1415e271519a tempest-CreateVolumesFromImageTest-554272876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:41:35 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-3d04728e-08b6-4d07-b2b1-1415e271519a tempest-CreateVolumesFromImageTest-554272876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:41:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-3d04728e-08b6-4d07-b2b1-1415e271519a tempest-CreateVolumesFromImageTest-554272876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:41:35 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-3d04728e-08b6-4d07-b2b1-1415e271519a tempest-CreateVolumesFromImageTest-554272876 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:41:35 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-3d04728e-08b6-4d07-b2b1-1415e271519a tempest-CreateVolumesFromImageTest-554272876 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:41:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-3d04728e-08b6-4d07-b2b1-1415e271519a tempest-CreateVolumesFromImageTest-554272876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-739605ab-d157-496e-b27f-fa24396e8a73 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:35 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c43d0ce3-c1d5-477a-a544-708493c1fdc7 tempest-VolumesListTestJSON-1762966689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ce60eb9-1a04-4958-b10b-e3541da6b9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40cb182b-b1df-40bd-a840-6deb58151a39', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:35 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c43d0ce3-c1d5-477a-a544-708493c1fdc7 tempest-VolumesListTestJSON-1762966689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (310067cd-2bce-49d9-9da7-4997fa00aa1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:35 devstack sudo[107554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-739605ab-d157-496e-b27f-fa24396e8a73 1073741824 Jun 23 16:41:35 devstack sudo[107554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:35 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-c43d0ce3-c1d5-477a-a544-708493c1fdc7 tempest-VolumesListTestJSON-1762966689 None] Volume volume-40cb182b-b1df-40bd-a840-6deb58151a39 (40cb182b-b1df-40bd-a840-6deb58151a39): created successfully Jun 23 16:41:35 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c43d0ce3-c1d5-477a-a544-708493c1fdc7 tempest-VolumesListTestJSON-1762966689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (310067cd-2bce-49d9-9da7-4997fa00aa1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:35 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c43d0ce3-c1d5-477a-a544-708493c1fdc7 tempest-VolumesListTestJSON-1762966689 None] Flow 'volume_create_manager' (be3dceaa-8edf-480b-b1db-d17b39dd2b4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:41:35 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-c43d0ce3-c1d5-477a-a544-708493c1fdc7 tempest-VolumesListTestJSON-1762966689 None] Created volume successfully. Jun 23 16:41:36 devstack sudo[107554]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-3d04728e-08b6-4d07-b2b1-1415e271519a tempest-CreateVolumesFromImageTest-554272876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-739605ab-d157-496e-b27f-fa24396e8a73 1073741824" returned: 0 in 1.059s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-3d04728e-08b6-4d07-b2b1-1415e271519a tempest-CreateVolumesFromImageTest-554272876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-739605ab-d157-496e-b27f-fa24396e8a73 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:36 devstack sudo[107562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-739605ab-d157-496e-b27f-fa24396e8a73 Jun 23 16:41:36 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:36 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-4373fc9a-d753-4332-b84a-3723868c8458 tempest-VolumesListTestJSON-1762966689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:41:36 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4373fc9a-d753-4332-b84a-3723868c8458 tempest-VolumesListTestJSON-1762966689 None] Flow 'volume_create_manager' (dfed6722-ae49-47c6-a880-c145db908461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:41:36 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4373fc9a-d753-4332-b84a-3723868c8458 tempest-VolumesListTestJSON-1762966689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac50f0b5-9f75-4533-82f2-b95521067f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:36 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4373fc9a-d753-4332-b84a-3723868c8458 tempest-VolumesListTestJSON-1762966689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac50f0b5-9f75-4533-82f2-b95521067f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:41:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1218012048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d474f7a-c15b-4544-8280-100c7d19b64f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cfa86c06e7874ae1afaeca72a58c3b44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:41:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:41:37Z,use_quota=True,user_id='4af9dbbeecaf444e81dd664d088adda0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:36 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4373fc9a-d753-4332-b84a-3723868c8458 tempest-VolumesListTestJSON-1762966689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e20f600d-5f4f-487f-b7a6-f00f1e77dbcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:36 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4373fc9a-d753-4332-b84a-3723868c8458 tempest-VolumesListTestJSON-1762966689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e20f600d-5f4f-487f-b7a6-f00f1e77dbcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:36 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4373fc9a-d753-4332-b84a-3723868c8458 tempest-VolumesListTestJSON-1762966689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e8a823c-73a5-4c80-a7fa-4bfda001f6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:37 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4373fc9a-d753-4332-b84a-3723868c8458 tempest-VolumesListTestJSON-1762966689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e8a823c-73a5-4c80-a7fa-4bfda001f6a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d474f7a-c15b-4544-8280-100c7d19b64f', 'volume_name': 'volume-4d474f7a-c15b-4544-8280-100c7d19b64f', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:37 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4373fc9a-d753-4332-b84a-3723868c8458 tempest-VolumesListTestJSON-1762966689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2009a86d-8433-4ab4-8065-50858d88fe16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:37 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4373fc9a-d753-4332-b84a-3723868c8458 tempest-VolumesListTestJSON-1762966689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2009a86d-8433-4ab4-8065-50858d88fe16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:37 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4373fc9a-d753-4332-b84a-3723868c8458 tempest-VolumesListTestJSON-1762966689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27673ddd-2f71-4a70-abe8-ee9cee52ff09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:37 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-4373fc9a-d753-4332-b84a-3723868c8458 tempest-VolumesListTestJSON-1762966689 None] Volume 4d474f7a-c15b-4544-8280-100c7d19b64f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d474f7a-c15b-4544-8280-100c7d19b64f', 'volume_size': 1} Jun 23 16:41:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-4373fc9a-d753-4332-b84a-3723868c8458 tempest-VolumesListTestJSON-1762966689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:41:37 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-3d04728e-08b6-4d07-b2b1-1415e271519a tempest-CreateVolumesFromImageTest-554272876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-739605ab-d157-496e-b27f-fa24396e8a73" returned: 0 in 0.790s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:37 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-3d04728e-08b6-4d07-b2b1-1415e271519a tempest-CreateVolumesFromImageTest-554272876 None] <== create_volume: return (1910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:41:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-3d04728e-08b6-4d07-b2b1-1415e271519a tempest-CreateVolumesFromImageTest-554272876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.913s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:41:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-2547eaf7-7f19-4dd5-ad9a-47e06b228030 tempest-VolumesNegativeTest-1121631231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.822s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:41:37 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-2547eaf7-7f19-4dd5-ad9a-47e06b228030 tempest-VolumesNegativeTest-1121631231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1844542798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e8c60b2-8b4e-4be3-a79a-0e71c2b5e86f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08a23f0dee354fc2bd38584056837a3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:41:30Z,use_quota=True,user_id='b40b6e6c283146d0b562f1671e477eaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:41:37 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-2547eaf7-7f19-4dd5-ad9a-47e06b228030 tempest-VolumesNegativeTest-1121631231 None] Creating volume 2e8c60b2-8b4e-4be3-a79a-0e71c2b5e86f {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:41:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-2547eaf7-7f19-4dd5-ad9a-47e06b228030 tempest-VolumesNegativeTest-1121631231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:41:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-2547eaf7-7f19-4dd5-ad9a-47e06b228030 tempest-VolumesNegativeTest-1121631231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:41:37 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-2547eaf7-7f19-4dd5-ad9a-47e06b228030 tempest-VolumesNegativeTest-1121631231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:41:37 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-2547eaf7-7f19-4dd5-ad9a-47e06b228030 tempest-VolumesNegativeTest-1121631231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:41:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-2547eaf7-7f19-4dd5-ad9a-47e06b228030 tempest-VolumesNegativeTest-1121631231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:41:37 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-2547eaf7-7f19-4dd5-ad9a-47e06b228030 tempest-VolumesNegativeTest-1121631231 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:41:37 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-2547eaf7-7f19-4dd5-ad9a-47e06b228030 tempest-VolumesNegativeTest-1121631231 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:41:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2547eaf7-7f19-4dd5-ad9a-47e06b228030 tempest-VolumesNegativeTest-1121631231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2e8c60b2-8b4e-4be3-a79a-0e71c2b5e86f 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:37 devstack sudo[107566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2e8c60b2-8b4e-4be3-a79a-0e71c2b5e86f 1073741824 Jun 23 16:41:37 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:37 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-3d04728e-08b6-4d07-b2b1-1415e271519a tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d48d909-f364-4fd1-a65b-c8debfb5b0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-739605ab-d157-496e-b27f-fa24396e8a73', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:37 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-3d04728e-08b6-4d07-b2b1-1415e271519a tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (386ebf03-ea59-4836-b4c1-ae8ff982a3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:37 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-3d04728e-08b6-4d07-b2b1-1415e271519a tempest-CreateVolumesFromImageTest-554272876 None] Volume volume-739605ab-d157-496e-b27f-fa24396e8a73 (739605ab-d157-496e-b27f-fa24396e8a73): created successfully Jun 23 16:41:37 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-3d04728e-08b6-4d07-b2b1-1415e271519a tempest-CreateVolumesFromImageTest-554272876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (386ebf03-ea59-4836-b4c1-ae8ff982a3f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:37 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-3d04728e-08b6-4d07-b2b1-1415e271519a tempest-CreateVolumesFromImageTest-554272876 None] Flow 'volume_create_manager' (d03768c4-6182-4909-8ce2-453370807c23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:41:37 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-3d04728e-08b6-4d07-b2b1-1415e271519a tempest-CreateVolumesFromImageTest-554272876 None] Created volume successfully. Jun 23 16:41:37 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-294b0a50-3787-48fd-a78f-52b7f40c60b5 tempest-CreateVolumesFromImageTest-554272876 None] Acquiring lock "cinder-739605ab-d157-496e-b27f-fa24396e8a73-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:41:37 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-294b0a50-3787-48fd-a78f-52b7f40c60b5 tempest-CreateVolumesFromImageTest-554272876 None] Lock "cinder-739605ab-d157-496e-b27f-fa24396e8a73-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:41:37 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-294b0a50-3787-48fd-a78f-52b7f40c60b5 tempest-CreateVolumesFromImageTest-554272876 None] Acquiring lock "cinder-quobyte-739605ab-d157-496e-b27f-fa24396e8a73" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:41:38 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-294b0a50-3787-48fd-a78f-52b7f40c60b5 tempest-CreateVolumesFromImageTest-554272876 None] Lock "cinder-quobyte-739605ab-d157-496e-b27f-fa24396e8a73" acquired by "delete_volume" :: waited 0.019s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:41:38 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[9856f4f1-cdff-49f8-a9d5-545a0b9beddb]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:41:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-294b0a50-3787-48fd-a78f-52b7f40c60b5 tempest-CreateVolumesFromImageTest-554272876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-739605ab-d157-496e-b27f-fa24396e8a73 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:38 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-739605ab-d157-496e-b27f-fa24396e8a73 Jun 23 16:41:38 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:38 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2547eaf7-7f19-4dd5-ad9a-47e06b228030 tempest-VolumesNegativeTest-1121631231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2e8c60b2-8b4e-4be3-a79a-0e71c2b5e86f 1073741824" returned: 0 in 0.948s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2547eaf7-7f19-4dd5-ad9a-47e06b228030 tempest-VolumesNegativeTest-1121631231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2e8c60b2-8b4e-4be3-a79a-0e71c2b5e86f {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:38 devstack sudo[107574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2e8c60b2-8b4e-4be3-a79a-0e71c2b5e86f Jun 23 16:41:38 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:38 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:38 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-294b0a50-3787-48fd-a78f-52b7f40c60b5 tempest-CreateVolumesFromImageTest-554272876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-739605ab-d157-496e-b27f-fa24396e8a73" returned: 0 in 0.881s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-294b0a50-3787-48fd-a78f-52b7f40c60b5 tempest-CreateVolumesFromImageTest-554272876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-739605ab-d157-496e-b27f-fa24396e8a73 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2547eaf7-7f19-4dd5-ad9a-47e06b228030 tempest-VolumesNegativeTest-1121631231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2e8c60b2-8b4e-4be3-a79a-0e71c2b5e86f" returned: 0 in 0.721s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:38 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-2547eaf7-7f19-4dd5-ad9a-47e06b228030 tempest-VolumesNegativeTest-1121631231 None] <== create_volume: return (1731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:41:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-2547eaf7-7f19-4dd5-ad9a-47e06b228030 tempest-VolumesNegativeTest-1121631231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.734s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:41:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-4373fc9a-d753-4332-b84a-3723868c8458 tempest-VolumesListTestJSON-1762966689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.927s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:41:38 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-4373fc9a-d753-4332-b84a-3723868c8458 tempest-VolumesListTestJSON-1762966689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:41:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1218012048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d474f7a-c15b-4544-8280-100c7d19b64f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cfa86c06e7874ae1afaeca72a58c3b44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:41:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:41:37Z,use_quota=True,user_id='4af9dbbeecaf444e81dd664d088adda0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:41:38 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-4373fc9a-d753-4332-b84a-3723868c8458 tempest-VolumesListTestJSON-1762966689 None] Creating volume 4d474f7a-c15b-4544-8280-100c7d19b64f {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:41:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-4373fc9a-d753-4332-b84a-3723868c8458 tempest-VolumesListTestJSON-1762966689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:41:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-4373fc9a-d753-4332-b84a-3723868c8458 tempest-VolumesListTestJSON-1762966689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:41:38 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-4373fc9a-d753-4332-b84a-3723868c8458 tempest-VolumesListTestJSON-1762966689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:41:38 devstack sudo[107581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-739605ab-d157-496e-b27f-fa24396e8a73 Jun 23 16:41:38 devstack sudo[107581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:38 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-4373fc9a-d753-4332-b84a-3723868c8458 tempest-VolumesListTestJSON-1762966689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:41:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-4373fc9a-d753-4332-b84a-3723868c8458 tempest-VolumesListTestJSON-1762966689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:41:38 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-4373fc9a-d753-4332-b84a-3723868c8458 tempest-VolumesListTestJSON-1762966689 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:41:38 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-4373fc9a-d753-4332-b84a-3723868c8458 tempest-VolumesListTestJSON-1762966689 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:41:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4373fc9a-d753-4332-b84a-3723868c8458 tempest-VolumesListTestJSON-1762966689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4d474f7a-c15b-4544-8280-100c7d19b64f 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:38 devstack sudo[107583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4d474f7a-c15b-4544-8280-100c7d19b64f 1073741824 Jun 23 16:41:38 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2547eaf7-7f19-4dd5-ad9a-47e06b228030 tempest-VolumesNegativeTest-1121631231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8671523f-c922-4e73-89a1-3316ace31dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e8c60b2-8b4e-4be3-a79a-0e71c2b5e86f', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:38 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:39 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2547eaf7-7f19-4dd5-ad9a-47e06b228030 tempest-VolumesNegativeTest-1121631231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f19887a-0165-4232-882a-526cfe024c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:39 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-2547eaf7-7f19-4dd5-ad9a-47e06b228030 tempest-VolumesNegativeTest-1121631231 None] Volume volume-2e8c60b2-8b4e-4be3-a79a-0e71c2b5e86f (2e8c60b2-8b4e-4be3-a79a-0e71c2b5e86f): created successfully Jun 23 16:41:39 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2547eaf7-7f19-4dd5-ad9a-47e06b228030 tempest-VolumesNegativeTest-1121631231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f19887a-0165-4232-882a-526cfe024c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:39 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2547eaf7-7f19-4dd5-ad9a-47e06b228030 tempest-VolumesNegativeTest-1121631231 None] Flow 'volume_create_manager' (51f39a76-afb8-4384-9fae-e42d88068956) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:41:39 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-2547eaf7-7f19-4dd5-ad9a-47e06b228030 tempest-VolumesNegativeTest-1121631231 None] Created volume successfully. Jun 23 16:41:39 devstack sudo[107581]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-294b0a50-3787-48fd-a78f-52b7f40c60b5 tempest-CreateVolumesFromImageTest-554272876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-739605ab-d157-496e-b27f-fa24396e8a73" returned: 0 in 0.690s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:39 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-294b0a50-3787-48fd-a78f-52b7f40c60b5 tempest-CreateVolumesFromImageTest-554272876 None] Lock "cinder-quobyte-739605ab-d157-496e-b27f-fa24396e8a73" released by "delete_volume" :: held 1.615s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:41:39 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:UPDATE=154,cinder:SELECT=140,cinder:INSERT=45,cinder:DELETE=14 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:41:39 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-294b0a50-3787-48fd-a78f-52b7f40c60b5 tempest-CreateVolumesFromImageTest-554272876 None] Created reservations ['a207b044-ecc0-4531-bc1e-664af4a652f4', '7c89f6e4-a50f-4861-b634-94ce40e2fc19', '45eac1ea-cd58-4c27-8107-3a4696733b3a', 'af59be27-d043-4c08-9120-e22cf6f1750f'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:41:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-294b0a50-3787-48fd-a78f-52b7f40c60b5 tempest-CreateVolumesFromImageTest-554272876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:41:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-294b0a50-3787-48fd-a78f-52b7f40c60b5 tempest-CreateVolumesFromImageTest-554272876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:41:39 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-294b0a50-3787-48fd-a78f-52b7f40c60b5 tempest-CreateVolumesFromImageTest-554272876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:41:39 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-294b0a50-3787-48fd-a78f-52b7f40c60b5 tempest-CreateVolumesFromImageTest-554272876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:41:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-294b0a50-3787-48fd-a78f-52b7f40c60b5 tempest-CreateVolumesFromImageTest-554272876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:41:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-294b0a50-3787-48fd-a78f-52b7f40c60b5 tempest-CreateVolumesFromImageTest-554272876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:39 devstack sudo[107590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:41:39 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:40 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4373fc9a-d753-4332-b84a-3723868c8458 tempest-VolumesListTestJSON-1762966689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4d474f7a-c15b-4544-8280-100c7d19b64f 1073741824" returned: 0 in 1.165s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4373fc9a-d753-4332-b84a-3723868c8458 tempest-VolumesListTestJSON-1762966689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4d474f7a-c15b-4544-8280-100c7d19b64f {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:40 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e0fb69d4-1a0a-4e2f-8e0f-18d11f763aaf tempest-CreateVolumesFromImageTest-554272876 None] Acquiring lock "cinder-38d30448-6bd2-41e7-baa6-e6b78531c105-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:41:40 devstack sudo[107592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4d474f7a-c15b-4544-8280-100c7d19b64f Jun 23 16:41:40 devstack sudo[107592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:40 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e0fb69d4-1a0a-4e2f-8e0f-18d11f763aaf tempest-CreateVolumesFromImageTest-554272876 None] Lock "cinder-38d30448-6bd2-41e7-baa6-e6b78531c105-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:41:40 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e0fb69d4-1a0a-4e2f-8e0f-18d11f763aaf tempest-CreateVolumesFromImageTest-554272876 None] Acquiring lock "cinder-quobyte-38d30448-6bd2-41e7-baa6-e6b78531c105" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:41:40 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e0fb69d4-1a0a-4e2f-8e0f-18d11f763aaf tempest-CreateVolumesFromImageTest-554272876 None] Lock "cinder-quobyte-38d30448-6bd2-41e7-baa6-e6b78531c105" acquired by "delete_volume" :: waited 0.019s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:41:40 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f957ed7-cb7e-4778-b2a5-4f7c679a63d3]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:41:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e0fb69d4-1a0a-4e2f-8e0f-18d11f763aaf tempest-CreateVolumesFromImageTest-554272876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-38d30448-6bd2-41e7-baa6-e6b78531c105 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:40 devstack sudo[107594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-38d30448-6bd2-41e7-baa6-e6b78531c105 Jun 23 16:41:40 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:40 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-294b0a50-3787-48fd-a78f-52b7f40c60b5 tempest-CreateVolumesFromImageTest-554272876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.018s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:40 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-294b0a50-3787-48fd-a78f-52b7f40c60b5 tempest-CreateVolumesFromImageTest-554272876 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:41:40 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-294b0a50-3787-48fd-a78f-52b7f40c60b5 tempest-CreateVolumesFromImageTest-554272876 None] Deleted volume successfully. Jun 23 16:41:40 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-294b0a50-3787-48fd-a78f-52b7f40c60b5 tempest-CreateVolumesFromImageTest-554272876 None] Lock "cinder-739605ab-d157-496e-b27f-fa24396e8a73-delete_volume" released by "delete_volume" :: held 2.931s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:41:41 devstack sudo[107592]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4373fc9a-d753-4332-b84a-3723868c8458 tempest-VolumesListTestJSON-1762966689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4d474f7a-c15b-4544-8280-100c7d19b64f" returned: 0 in 1.136s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:41 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-4373fc9a-d753-4332-b84a-3723868c8458 tempest-VolumesListTestJSON-1762966689 None] <== create_volume: return (2400ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:41:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-4373fc9a-d753-4332-b84a-3723868c8458 tempest-VolumesListTestJSON-1762966689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.406s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:41:41 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4373fc9a-d753-4332-b84a-3723868c8458 tempest-VolumesListTestJSON-1762966689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27673ddd-2f71-4a70-abe8-ee9cee52ff09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d474f7a-c15b-4544-8280-100c7d19b64f', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:41 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4373fc9a-d753-4332-b84a-3723868c8458 tempest-VolumesListTestJSON-1762966689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeeee506-74f0-4cbf-9a2e-4b06a4ae2a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:41 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e0fb69d4-1a0a-4e2f-8e0f-18d11f763aaf tempest-CreateVolumesFromImageTest-554272876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-38d30448-6bd2-41e7-baa6-e6b78531c105" returned: 0 in 0.989s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e0fb69d4-1a0a-4e2f-8e0f-18d11f763aaf tempest-CreateVolumesFromImageTest-554272876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-38d30448-6bd2-41e7-baa6-e6b78531c105 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:41 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-4373fc9a-d753-4332-b84a-3723868c8458 tempest-VolumesListTestJSON-1762966689 None] Volume volume-4d474f7a-c15b-4544-8280-100c7d19b64f (4d474f7a-c15b-4544-8280-100c7d19b64f): created successfully Jun 23 16:41:41 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4373fc9a-d753-4332-b84a-3723868c8458 tempest-VolumesListTestJSON-1762966689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeeee506-74f0-4cbf-9a2e-4b06a4ae2a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:41 devstack sudo[107604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-38d30448-6bd2-41e7-baa6-e6b78531c105 Jun 23 16:41:41 devstack sudo[107604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:41 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4373fc9a-d753-4332-b84a-3723868c8458 tempest-VolumesListTestJSON-1762966689 None] Flow 'volume_create_manager' (dfed6722-ae49-47c6-a880-c145db908461) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:41:41 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-4373fc9a-d753-4332-b84a-3723868c8458 tempest-VolumesListTestJSON-1762966689 None] Created volume successfully. Jun 23 16:41:42 devstack sudo[107604]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:42 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e0fb69d4-1a0a-4e2f-8e0f-18d11f763aaf tempest-CreateVolumesFromImageTest-554272876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-38d30448-6bd2-41e7-baa6-e6b78531c105" returned: 0 in 0.808s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:42 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e0fb69d4-1a0a-4e2f-8e0f-18d11f763aaf tempest-CreateVolumesFromImageTest-554272876 None] Lock "cinder-quobyte-38d30448-6bd2-41e7-baa6-e6b78531c105" released by "delete_volume" :: held 1.855s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:41:42 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-e0fb69d4-1a0a-4e2f-8e0f-18d11f763aaf tempest-CreateVolumesFromImageTest-554272876 None] Created reservations ['a470a818-db3c-4afc-97a9-f219782a761e', '8d565ae2-79f3-4593-b80b-274e91e00de7', '165c932d-c947-4298-ae19-2b9f4e7ba2b4', '776c17e6-06cb-4ed0-aa85-11e8aac403b7'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:41:42 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e0fb69d4-1a0a-4e2f-8e0f-18d11f763aaf tempest-CreateVolumesFromImageTest-554272876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:41:42 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e0fb69d4-1a0a-4e2f-8e0f-18d11f763aaf tempest-CreateVolumesFromImageTest-554272876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:41:42 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e0fb69d4-1a0a-4e2f-8e0f-18d11f763aaf tempest-CreateVolumesFromImageTest-554272876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:41:42 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e0fb69d4-1a0a-4e2f-8e0f-18d11f763aaf tempest-CreateVolumesFromImageTest-554272876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:41:42 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e0fb69d4-1a0a-4e2f-8e0f-18d11f763aaf tempest-CreateVolumesFromImageTest-554272876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:41:42 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e0fb69d4-1a0a-4e2f-8e0f-18d11f763aaf tempest-CreateVolumesFromImageTest-554272876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:42 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:41:42 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:42 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-a0eeb339-69f9-48ff-bac0-43afdaf51620 tempest-CreateVolumesFromImageTest-554272876 None] Acquiring lock "cinder-68e7255a-ce4b-4712-9cfb-cf8754afc6e2-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:41:42 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-a0eeb339-69f9-48ff-bac0-43afdaf51620 tempest-CreateVolumesFromImageTest-554272876 None] Lock "cinder-68e7255a-ce4b-4712-9cfb-cf8754afc6e2-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:41:42 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-a0eeb339-69f9-48ff-bac0-43afdaf51620 tempest-CreateVolumesFromImageTest-554272876 None] Acquiring lock "cinder-quobyte-68e7255a-ce4b-4712-9cfb-cf8754afc6e2" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:41:42 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-a0eeb339-69f9-48ff-bac0-43afdaf51620 tempest-CreateVolumesFromImageTest-554272876 None] Lock "cinder-quobyte-68e7255a-ce4b-4712-9cfb-cf8754afc6e2" acquired by "delete_volume" :: waited 0.015s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:41:42 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7f7605-bd79-44d2-8060-ae14d4fce336]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:41:42 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a0eeb339-69f9-48ff-bac0-43afdaf51620 tempest-CreateVolumesFromImageTest-554272876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-68e7255a-ce4b-4712-9cfb-cf8754afc6e2 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:42 devstack sudo[107609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-68e7255a-ce4b-4712-9cfb-cf8754afc6e2 Jun 23 16:41:42 devstack sudo[107609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:43 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-911633d8-2db0-4a2f-9b48-4790eca0331c tempest-VolumesListTestJSON-1762966689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:41:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-911633d8-2db0-4a2f-9b48-4790eca0331c tempest-VolumesListTestJSON-1762966689 None] Flow 'volume_create_manager' (e5577423-0d4a-4ca4-ba76-19a2973dc208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:41:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-911633d8-2db0-4a2f-9b48-4790eca0331c tempest-VolumesListTestJSON-1762966689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4403e8b7-5f59-470a-a57b-064d77c68ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-911633d8-2db0-4a2f-9b48-4790eca0331c tempest-VolumesListTestJSON-1762966689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4403e8b7-5f59-470a-a57b-064d77c68ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1646695621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e8dc3e6-39cb-4dff-b832-20a0e64a63f3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cfa86c06e7874ae1afaeca72a58c3b44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:41:43Z,use_quota=True,user_id='4af9dbbeecaf444e81dd664d088adda0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-911633d8-2db0-4a2f-9b48-4790eca0331c tempest-VolumesListTestJSON-1762966689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cc8c5a3-907f-4f98-9809-000d8d85a769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-911633d8-2db0-4a2f-9b48-4790eca0331c tempest-VolumesListTestJSON-1762966689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cc8c5a3-907f-4f98-9809-000d8d85a769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-911633d8-2db0-4a2f-9b48-4790eca0331c tempest-VolumesListTestJSON-1762966689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8043c8e-23b4-451a-9812-460b0efdc236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-911633d8-2db0-4a2f-9b48-4790eca0331c tempest-VolumesListTestJSON-1762966689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8043c8e-23b4-451a-9812-460b0efdc236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e8dc3e6-39cb-4dff-b832-20a0e64a63f3', 'volume_name': 'volume-3e8dc3e6-39cb-4dff-b832-20a0e64a63f3', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-911633d8-2db0-4a2f-9b48-4790eca0331c tempest-VolumesListTestJSON-1762966689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbdb8437-5732-4f74-8edb-bdbab5f4f4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-911633d8-2db0-4a2f-9b48-4790eca0331c tempest-VolumesListTestJSON-1762966689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbdb8437-5732-4f74-8edb-bdbab5f4f4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-911633d8-2db0-4a2f-9b48-4790eca0331c tempest-VolumesListTestJSON-1762966689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e0931f4-5057-4739-b2ec-8af2a9b5b1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:43 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-911633d8-2db0-4a2f-9b48-4790eca0331c tempest-VolumesListTestJSON-1762966689 None] Volume 3e8dc3e6-39cb-4dff-b832-20a0e64a63f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e8dc3e6-39cb-4dff-b832-20a0e64a63f3', 'volume_size': 1} Jun 23 16:41:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-911633d8-2db0-4a2f-9b48-4790eca0331c tempest-VolumesListTestJSON-1762966689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:41:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-911633d8-2db0-4a2f-9b48-4790eca0331c tempest-VolumesListTestJSON-1762966689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:41:43 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-911633d8-2db0-4a2f-9b48-4790eca0331c tempest-VolumesListTestJSON-1762966689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1646695621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e8dc3e6-39cb-4dff-b832-20a0e64a63f3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cfa86c06e7874ae1afaeca72a58c3b44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:41:43Z,use_quota=True,user_id='4af9dbbeecaf444e81dd664d088adda0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:41:43 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-911633d8-2db0-4a2f-9b48-4790eca0331c tempest-VolumesListTestJSON-1762966689 None] Creating volume 3e8dc3e6-39cb-4dff-b832-20a0e64a63f3 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:41:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-911633d8-2db0-4a2f-9b48-4790eca0331c tempest-VolumesListTestJSON-1762966689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:41:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-911633d8-2db0-4a2f-9b48-4790eca0331c tempest-VolumesListTestJSON-1762966689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:41:43 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-911633d8-2db0-4a2f-9b48-4790eca0331c tempest-VolumesListTestJSON-1762966689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:41:43 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-911633d8-2db0-4a2f-9b48-4790eca0331c tempest-VolumesListTestJSON-1762966689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:41:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-911633d8-2db0-4a2f-9b48-4790eca0331c tempest-VolumesListTestJSON-1762966689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:41:43 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-911633d8-2db0-4a2f-9b48-4790eca0331c tempest-VolumesListTestJSON-1762966689 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:41:43 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-911633d8-2db0-4a2f-9b48-4790eca0331c tempest-VolumesListTestJSON-1762966689 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:41:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-911633d8-2db0-4a2f-9b48-4790eca0331c tempest-VolumesListTestJSON-1762966689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3e8dc3e6-39cb-4dff-b832-20a0e64a63f3 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:43 devstack sudo[107612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3e8dc3e6-39cb-4dff-b832-20a0e64a63f3 1073741824 Jun 23 16:41:43 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:43 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e0fb69d4-1a0a-4e2f-8e0f-18d11f763aaf tempest-CreateVolumesFromImageTest-554272876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.002s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:43 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-e0fb69d4-1a0a-4e2f-8e0f-18d11f763aaf tempest-CreateVolumesFromImageTest-554272876 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:41:43 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-e0fb69d4-1a0a-4e2f-8e0f-18d11f763aaf tempest-CreateVolumesFromImageTest-554272876 None] Deleted volume successfully. Jun 23 16:41:43 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e0fb69d4-1a0a-4e2f-8e0f-18d11f763aaf tempest-CreateVolumesFromImageTest-554272876 None] Lock "cinder-38d30448-6bd2-41e7-baa6-e6b78531c105-delete_volume" released by "delete_volume" :: held 3.165s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:41:43 devstack sudo[107609]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a0eeb339-69f9-48ff-bac0-43afdaf51620 tempest-CreateVolumesFromImageTest-554272876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-68e7255a-ce4b-4712-9cfb-cf8754afc6e2" returned: 0 in 1.116s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a0eeb339-69f9-48ff-bac0-43afdaf51620 tempest-CreateVolumesFromImageTest-554272876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-68e7255a-ce4b-4712-9cfb-cf8754afc6e2 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:43 devstack sudo[107617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-68e7255a-ce4b-4712-9cfb-cf8754afc6e2 Jun 23 16:41:43 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:44 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-911633d8-2db0-4a2f-9b48-4790eca0331c tempest-VolumesListTestJSON-1762966689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3e8dc3e6-39cb-4dff-b832-20a0e64a63f3 1073741824" returned: 0 in 1.034s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-911633d8-2db0-4a2f-9b48-4790eca0331c tempest-VolumesListTestJSON-1762966689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3e8dc3e6-39cb-4dff-b832-20a0e64a63f3 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:44 devstack sudo[107623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3e8dc3e6-39cb-4dff-b832-20a0e64a63f3 Jun 23 16:41:44 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:44 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a0eeb339-69f9-48ff-bac0-43afdaf51620 tempest-CreateVolumesFromImageTest-554272876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-68e7255a-ce4b-4712-9cfb-cf8754afc6e2" returned: 0 in 0.802s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:44 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-a0eeb339-69f9-48ff-bac0-43afdaf51620 tempest-CreateVolumesFromImageTest-554272876 None] Lock "cinder-quobyte-68e7255a-ce4b-4712-9cfb-cf8754afc6e2" released by "delete_volume" :: held 1.987s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:41:44 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-a0eeb339-69f9-48ff-bac0-43afdaf51620 tempest-CreateVolumesFromImageTest-554272876 None] Created reservations ['fcfac19e-bda6-4214-a6b6-88384f154974', '7b9c4cc8-3ccd-4be1-9187-c16bafa33adf', '870eabd1-9449-4bd0-8eb0-f11e128a836f', '3cd12b88-f5c1-405a-a89d-c33b0f0bbd81'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:41:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a0eeb339-69f9-48ff-bac0-43afdaf51620 tempest-CreateVolumesFromImageTest-554272876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:41:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a0eeb339-69f9-48ff-bac0-43afdaf51620 tempest-CreateVolumesFromImageTest-554272876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:41:44 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-a0eeb339-69f9-48ff-bac0-43afdaf51620 tempest-CreateVolumesFromImageTest-554272876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:41:44 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-a0eeb339-69f9-48ff-bac0-43afdaf51620 tempest-CreateVolumesFromImageTest-554272876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:41:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a0eeb339-69f9-48ff-bac0-43afdaf51620 tempest-CreateVolumesFromImageTest-554272876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:41:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a0eeb339-69f9-48ff-bac0-43afdaf51620 tempest-CreateVolumesFromImageTest-554272876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:44 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:41:44 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:45 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:45 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-911633d8-2db0-4a2f-9b48-4790eca0331c tempest-VolumesListTestJSON-1762966689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3e8dc3e6-39cb-4dff-b832-20a0e64a63f3" returned: 0 in 0.729s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:45 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-911633d8-2db0-4a2f-9b48-4790eca0331c tempest-VolumesListTestJSON-1762966689 None] <== create_volume: return (1813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:41:45 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-911633d8-2db0-4a2f-9b48-4790eca0331c tempest-VolumesListTestJSON-1762966689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.817s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:41:45 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-911633d8-2db0-4a2f-9b48-4790eca0331c tempest-VolumesListTestJSON-1762966689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e0931f4-5057-4739-b2ec-8af2a9b5b1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e8dc3e6-39cb-4dff-b832-20a0e64a63f3', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:45 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-911633d8-2db0-4a2f-9b48-4790eca0331c tempest-VolumesListTestJSON-1762966689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38337715-018f-40af-b187-4427ac6f59c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:45 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-911633d8-2db0-4a2f-9b48-4790eca0331c tempest-VolumesListTestJSON-1762966689 None] Volume volume-3e8dc3e6-39cb-4dff-b832-20a0e64a63f3 (3e8dc3e6-39cb-4dff-b832-20a0e64a63f3): created successfully Jun 23 16:41:45 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-911633d8-2db0-4a2f-9b48-4790eca0331c tempest-VolumesListTestJSON-1762966689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38337715-018f-40af-b187-4427ac6f59c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:45 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-911633d8-2db0-4a2f-9b48-4790eca0331c tempest-VolumesListTestJSON-1762966689 None] Flow 'volume_create_manager' (e5577423-0d4a-4ca4-ba76-19a2973dc208) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:41:45 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-911633d8-2db0-4a2f-9b48-4790eca0331c tempest-VolumesListTestJSON-1762966689 None] Created volume successfully. Jun 23 16:41:45 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:45 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a0eeb339-69f9-48ff-bac0-43afdaf51620 tempest-CreateVolumesFromImageTest-554272876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.765s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:45 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-a0eeb339-69f9-48ff-bac0-43afdaf51620 tempest-CreateVolumesFromImageTest-554272876 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:41:45 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-a0eeb339-69f9-48ff-bac0-43afdaf51620 tempest-CreateVolumesFromImageTest-554272876 None] Deleted volume successfully. Jun 23 16:41:45 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-a0eeb339-69f9-48ff-bac0-43afdaf51620 tempest-CreateVolumesFromImageTest-554272876 None] Lock "cinder-68e7255a-ce4b-4712-9cfb-cf8754afc6e2-delete_volume" released by "delete_volume" :: held 3.083s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:41:45 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-37453c53-9108-4176-b7e5-5d4c4a193cdb tempest-CreateVolumesFromImageTest-554272876 None] Acquiring lock "cinder-43591cbe-f576-4be2-8029-8ffe9eeeae41-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:41:46 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-37453c53-9108-4176-b7e5-5d4c4a193cdb tempest-CreateVolumesFromImageTest-554272876 None] Lock "cinder-43591cbe-f576-4be2-8029-8ffe9eeeae41-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:41:46 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-37453c53-9108-4176-b7e5-5d4c4a193cdb tempest-CreateVolumesFromImageTest-554272876 None] Acquiring lock "cinder-quobyte-43591cbe-f576-4be2-8029-8ffe9eeeae41" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:41:46 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-37453c53-9108-4176-b7e5-5d4c4a193cdb tempest-CreateVolumesFromImageTest-554272876 None] Lock "cinder-quobyte-43591cbe-f576-4be2-8029-8ffe9eeeae41" acquired by "delete_volume" :: waited 0.024s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:41:46 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8958a29-a064-44d1-9d0e-43b25e64f514]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:41:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-37453c53-9108-4176-b7e5-5d4c4a193cdb tempest-CreateVolumesFromImageTest-554272876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-43591cbe-f576-4be2-8029-8ffe9eeeae41 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:46 devstack sudo[107630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-43591cbe-f576-4be2-8029-8ffe9eeeae41 Jun 23 16:41:46 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:47 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-37453c53-9108-4176-b7e5-5d4c4a193cdb tempest-CreateVolumesFromImageTest-554272876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-43591cbe-f576-4be2-8029-8ffe9eeeae41" returned: 0 in 0.993s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-37453c53-9108-4176-b7e5-5d4c4a193cdb tempest-CreateVolumesFromImageTest-554272876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-43591cbe-f576-4be2-8029-8ffe9eeeae41 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:47 devstack sudo[107641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-43591cbe-f576-4be2-8029-8ffe9eeeae41 Jun 23 16:41:47 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:47 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-37453c53-9108-4176-b7e5-5d4c4a193cdb tempest-CreateVolumesFromImageTest-554272876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-43591cbe-f576-4be2-8029-8ffe9eeeae41" returned: 0 in 0.856s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:48 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-37453c53-9108-4176-b7e5-5d4c4a193cdb tempest-CreateVolumesFromImageTest-554272876 None] Lock "cinder-quobyte-43591cbe-f576-4be2-8029-8ffe9eeeae41" released by "delete_volume" :: held 1.931s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:41:48 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-37453c53-9108-4176-b7e5-5d4c4a193cdb tempest-CreateVolumesFromImageTest-554272876 None] Created reservations ['ae617f54-8d77-4597-bca9-f101dfd72c4a', '2071c0a6-6027-49a9-b3c2-54e7ee7da4b9', '5763337f-a7a1-4dc8-98f8-9dc8d94cefc1', 'd23b37b4-bb03-482f-b830-3104337912fc'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:41:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-37453c53-9108-4176-b7e5-5d4c4a193cdb tempest-CreateVolumesFromImageTest-554272876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:41:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-37453c53-9108-4176-b7e5-5d4c4a193cdb tempest-CreateVolumesFromImageTest-554272876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:41:48 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-37453c53-9108-4176-b7e5-5d4c4a193cdb tempest-CreateVolumesFromImageTest-554272876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:41:48 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-37453c53-9108-4176-b7e5-5d4c4a193cdb tempest-CreateVolumesFromImageTest-554272876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:41:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-37453c53-9108-4176-b7e5-5d4c4a193cdb tempest-CreateVolumesFromImageTest-554272876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:41:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-37453c53-9108-4176-b7e5-5d4c4a193cdb tempest-CreateVolumesFromImageTest-554272876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:48 devstack sudo[107657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:41:48 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:48 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-bf38211e-e3fc-4a65-b546-d403aaee4e8c tempest-CreateVolumesFromImageTest-554272876 None] Acquiring lock "cinder-38d0552e-ec8c-4647-aa6d-645bb08d0dc4-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:41:48 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-bf38211e-e3fc-4a65-b546-d403aaee4e8c tempest-CreateVolumesFromImageTest-554272876 None] Lock "cinder-38d0552e-ec8c-4647-aa6d-645bb08d0dc4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:41:48 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-bf38211e-e3fc-4a65-b546-d403aaee4e8c tempest-CreateVolumesFromImageTest-554272876 None] Acquiring lock "cinder-quobyte-38d0552e-ec8c-4647-aa6d-645bb08d0dc4" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:41:48 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-bf38211e-e3fc-4a65-b546-d403aaee4e8c tempest-CreateVolumesFromImageTest-554272876 None] Lock "cinder-quobyte-38d0552e-ec8c-4647-aa6d-645bb08d0dc4" acquired by "delete_volume" :: waited 0.025s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:41:48 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec079e56-a131-4624-9d20-8528417abb36]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:41:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-bf38211e-e3fc-4a65-b546-d403aaee4e8c tempest-CreateVolumesFromImageTest-554272876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-38d0552e-ec8c-4647-aa6d-645bb08d0dc4 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:48 devstack sudo[107662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-38d0552e-ec8c-4647-aa6d-645bb08d0dc4 Jun 23 16:41:48 devstack sudo[107662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:49 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-37453c53-9108-4176-b7e5-5d4c4a193cdb tempest-CreateVolumesFromImageTest-554272876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.142s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:49 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-37453c53-9108-4176-b7e5-5d4c4a193cdb tempest-CreateVolumesFromImageTest-554272876 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:41:49 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-37453c53-9108-4176-b7e5-5d4c4a193cdb tempest-CreateVolumesFromImageTest-554272876 None] Deleted volume successfully. Jun 23 16:41:49 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-37453c53-9108-4176-b7e5-5d4c4a193cdb tempest-CreateVolumesFromImageTest-554272876 None] Lock "cinder-43591cbe-f576-4be2-8029-8ffe9eeeae41-delete_volume" released by "delete_volume" :: held 3.426s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:41:49 devstack sudo[107662]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-bf38211e-e3fc-4a65-b546-d403aaee4e8c tempest-CreateVolumesFromImageTest-554272876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-38d0552e-ec8c-4647-aa6d-645bb08d0dc4" returned: 0 in 1.271s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-bf38211e-e3fc-4a65-b546-d403aaee4e8c tempest-CreateVolumesFromImageTest-554272876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-38d0552e-ec8c-4647-aa6d-645bb08d0dc4 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:49 devstack sudo[107675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-38d0552e-ec8c-4647-aa6d-645bb08d0dc4 Jun 23 16:41:49 devstack sudo[107675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:50 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-06d1df41-92a9-421e-b856-0e0980e607fc tempest-VolumesListTestJSON-1762966689 None] Acquiring lock "cinder-3e8dc3e6-39cb-4dff-b832-20a0e64a63f3-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:41:50 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-06d1df41-92a9-421e-b856-0e0980e607fc tempest-VolumesListTestJSON-1762966689 None] Lock "cinder-3e8dc3e6-39cb-4dff-b832-20a0e64a63f3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:41:50 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-06d1df41-92a9-421e-b856-0e0980e607fc tempest-VolumesListTestJSON-1762966689 None] Acquiring lock "cinder-quobyte-3e8dc3e6-39cb-4dff-b832-20a0e64a63f3" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:41:50 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-06d1df41-92a9-421e-b856-0e0980e607fc tempest-VolumesListTestJSON-1762966689 None] Lock "cinder-quobyte-3e8dc3e6-39cb-4dff-b832-20a0e64a63f3" acquired by "delete_volume" :: waited 0.015s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:41:50 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ce0eab-348c-4ecc-9d40-9126efb7f6e7]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:41:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-06d1df41-92a9-421e-b856-0e0980e607fc tempest-VolumesListTestJSON-1762966689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3e8dc3e6-39cb-4dff-b832-20a0e64a63f3 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:50 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3e8dc3e6-39cb-4dff-b832-20a0e64a63f3 Jun 23 16:41:50 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-bf38211e-e3fc-4a65-b546-d403aaee4e8c tempest-CreateVolumesFromImageTest-554272876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-38d0552e-ec8c-4647-aa6d-645bb08d0dc4" returned: 0 in 0.760s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:50 devstack sudo[107675]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:50 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-bf38211e-e3fc-4a65-b546-d403aaee4e8c tempest-CreateVolumesFromImageTest-554272876 None] Lock "cinder-quobyte-38d0552e-ec8c-4647-aa6d-645bb08d0dc4" released by "delete_volume" :: held 2.145s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:41:50 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-bf38211e-e3fc-4a65-b546-d403aaee4e8c tempest-CreateVolumesFromImageTest-554272876 None] Created reservations ['d9c4369c-8e85-44d4-aff2-6126de50708c', '00a4e03a-301e-4db1-ae66-177c649bb029', '700793d6-8fa9-41b7-9cfc-03a17c8240cb', 'e7f30be5-e476-411b-b34a-1dcce3abd7d5'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:41:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-bf38211e-e3fc-4a65-b546-d403aaee4e8c tempest-CreateVolumesFromImageTest-554272876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:41:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-bf38211e-e3fc-4a65-b546-d403aaee4e8c tempest-CreateVolumesFromImageTest-554272876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:41:50 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-bf38211e-e3fc-4a65-b546-d403aaee4e8c tempest-CreateVolumesFromImageTest-554272876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:41:50 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-bf38211e-e3fc-4a65-b546-d403aaee4e8c tempest-CreateVolumesFromImageTest-554272876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:41:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-bf38211e-e3fc-4a65-b546-d403aaee4e8c tempest-CreateVolumesFromImageTest-554272876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:41:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-bf38211e-e3fc-4a65-b546-d403aaee4e8c tempest-CreateVolumesFromImageTest-554272876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:50 devstack sudo[107682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:41:50 devstack sudo[107682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:51 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-06d1df41-92a9-421e-b856-0e0980e607fc tempest-VolumesListTestJSON-1762966689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3e8dc3e6-39cb-4dff-b832-20a0e64a63f3" returned: 0 in 0.960s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-06d1df41-92a9-421e-b856-0e0980e607fc tempest-VolumesListTestJSON-1762966689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3e8dc3e6-39cb-4dff-b832-20a0e64a63f3 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:51 devstack sudo[107685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3e8dc3e6-39cb-4dff-b832-20a0e64a63f3 Jun 23 16:41:51 devstack sudo[107685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:51 devstack sudo[107682]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-bf38211e-e3fc-4a65-b546-d403aaee4e8c tempest-CreateVolumesFromImageTest-554272876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.829s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:51 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-bf38211e-e3fc-4a65-b546-d403aaee4e8c tempest-CreateVolumesFromImageTest-554272876 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:41:51 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-bf38211e-e3fc-4a65-b546-d403aaee4e8c tempest-CreateVolumesFromImageTest-554272876 None] Deleted volume successfully. Jun 23 16:41:51 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-bf38211e-e3fc-4a65-b546-d403aaee4e8c tempest-CreateVolumesFromImageTest-554272876 None] Lock "cinder-38d0552e-ec8c-4647-aa6d-645bb08d0dc4-delete_volume" released by "delete_volume" :: held 3.313s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:41:51 devstack sudo[107685]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-06d1df41-92a9-421e-b856-0e0980e607fc tempest-VolumesListTestJSON-1762966689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3e8dc3e6-39cb-4dff-b832-20a0e64a63f3" returned: 0 in 0.793s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:51 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-06d1df41-92a9-421e-b856-0e0980e607fc tempest-VolumesListTestJSON-1762966689 None] Lock "cinder-quobyte-3e8dc3e6-39cb-4dff-b832-20a0e64a63f3" released by "delete_volume" :: held 1.800s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:41:52 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-06d1df41-92a9-421e-b856-0e0980e607fc tempest-VolumesListTestJSON-1762966689 None] Created reservations ['0f9e702a-3b58-4b58-8dc9-cd7cdecf1d62', '1a41f154-e6a9-4670-bb98-fe1a9f98ee19', '14b90140-ad7c-41a7-9865-6d3a2de52805', '616776b3-fe27-4864-9f49-d4165316b584'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:41:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-06d1df41-92a9-421e-b856-0e0980e607fc tempest-VolumesListTestJSON-1762966689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:41:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-06d1df41-92a9-421e-b856-0e0980e607fc tempest-VolumesListTestJSON-1762966689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:41:52 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-06d1df41-92a9-421e-b856-0e0980e607fc tempest-VolumesListTestJSON-1762966689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:41:52 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-06d1df41-92a9-421e-b856-0e0980e607fc tempest-VolumesListTestJSON-1762966689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:41:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-06d1df41-92a9-421e-b856-0e0980e607fc tempest-VolumesListTestJSON-1762966689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:41:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-06d1df41-92a9-421e-b856-0e0980e607fc tempest-VolumesListTestJSON-1762966689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:52 devstack sudo[107689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:41:52 devstack sudo[107689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:52 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b73411be-6477-4ec2-a46f-ae5cbe00fff8 tempest-VolumesListTestJSON-1762966689 None] Acquiring lock "cinder-4d474f7a-c15b-4544-8280-100c7d19b64f-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:41:52 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b73411be-6477-4ec2-a46f-ae5cbe00fff8 tempest-VolumesListTestJSON-1762966689 None] Lock "cinder-4d474f7a-c15b-4544-8280-100c7d19b64f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:41:52 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b73411be-6477-4ec2-a46f-ae5cbe00fff8 tempest-VolumesListTestJSON-1762966689 None] Acquiring lock "cinder-quobyte-4d474f7a-c15b-4544-8280-100c7d19b64f" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:41:52 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b73411be-6477-4ec2-a46f-ae5cbe00fff8 tempest-VolumesListTestJSON-1762966689 None] Lock "cinder-quobyte-4d474f7a-c15b-4544-8280-100c7d19b64f" acquired by "delete_volume" :: waited 0.024s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:41:52 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d408fea1-b617-402b-8d71-f7d028323f7f]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:41:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b73411be-6477-4ec2-a46f-ae5cbe00fff8 tempest-VolumesListTestJSON-1762966689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4d474f7a-c15b-4544-8280-100c7d19b64f {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:52 devstack sudo[107691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4d474f7a-c15b-4544-8280-100c7d19b64f Jun 23 16:41:52 devstack sudo[107691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:53 devstack sudo[107689]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:53 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-06d1df41-92a9-421e-b856-0e0980e607fc tempest-VolumesListTestJSON-1762966689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.077s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:53 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-06d1df41-92a9-421e-b856-0e0980e607fc tempest-VolumesListTestJSON-1762966689 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:41:53 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-06d1df41-92a9-421e-b856-0e0980e607fc tempest-VolumesListTestJSON-1762966689 None] Deleted volume successfully. Jun 23 16:41:53 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-06d1df41-92a9-421e-b856-0e0980e607fc tempest-VolumesListTestJSON-1762966689 None] Lock "cinder-3e8dc3e6-39cb-4dff-b832-20a0e64a63f3-delete_volume" released by "delete_volume" :: held 3.171s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:41:53 devstack sudo[107691]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:53 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b73411be-6477-4ec2-a46f-ae5cbe00fff8 tempest-VolumesListTestJSON-1762966689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4d474f7a-c15b-4544-8280-100c7d19b64f" returned: 0 in 1.080s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:53 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b73411be-6477-4ec2-a46f-ae5cbe00fff8 tempest-VolumesListTestJSON-1762966689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4d474f7a-c15b-4544-8280-100c7d19b64f {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:53 devstack sudo[107701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4d474f7a-c15b-4544-8280-100c7d19b64f Jun 23 16:41:53 devstack sudo[107701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:54 devstack sudo[107701]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b73411be-6477-4ec2-a46f-ae5cbe00fff8 tempest-VolumesListTestJSON-1762966689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4d474f7a-c15b-4544-8280-100c7d19b64f" returned: 0 in 0.862s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:54 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b73411be-6477-4ec2-a46f-ae5cbe00fff8 tempest-VolumesListTestJSON-1762966689 None] Lock "cinder-quobyte-4d474f7a-c15b-4544-8280-100c7d19b64f" released by "delete_volume" :: held 2.018s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:41:54 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-b73411be-6477-4ec2-a46f-ae5cbe00fff8 tempest-VolumesListTestJSON-1762966689 None] Created reservations ['a0068870-96f8-4ee3-8d39-67d79a9df34f', 'cf393580-7bf7-474f-a3d5-32af25088a83', '989e9f8e-aec3-423b-a89a-ac843ebe3c6c', '42fec905-1588-48f1-9808-0959b4e8105f'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:41:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b73411be-6477-4ec2-a46f-ae5cbe00fff8 tempest-VolumesListTestJSON-1762966689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:41:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b73411be-6477-4ec2-a46f-ae5cbe00fff8 tempest-VolumesListTestJSON-1762966689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:41:54 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b73411be-6477-4ec2-a46f-ae5cbe00fff8 tempest-VolumesListTestJSON-1762966689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:41:54 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b73411be-6477-4ec2-a46f-ae5cbe00fff8 tempest-VolumesListTestJSON-1762966689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:41:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b73411be-6477-4ec2-a46f-ae5cbe00fff8 tempest-VolumesListTestJSON-1762966689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:41:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b73411be-6477-4ec2-a46f-ae5cbe00fff8 tempest-VolumesListTestJSON-1762966689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:54 devstack sudo[107705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:41:54 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:55 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e9541c40-d341-4730-aeeb-42f9275b2ee0 tempest-VolumesListTestJSON-1762966689 None] Acquiring lock "cinder-40cb182b-b1df-40bd-a840-6deb58151a39-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:41:55 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e9541c40-d341-4730-aeeb-42f9275b2ee0 tempest-VolumesListTestJSON-1762966689 None] Lock "cinder-40cb182b-b1df-40bd-a840-6deb58151a39-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:41:55 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e9541c40-d341-4730-aeeb-42f9275b2ee0 tempest-VolumesListTestJSON-1762966689 None] Acquiring lock "cinder-quobyte-40cb182b-b1df-40bd-a840-6deb58151a39" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:41:55 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e9541c40-d341-4730-aeeb-42f9275b2ee0 tempest-VolumesListTestJSON-1762966689 None] Lock "cinder-quobyte-40cb182b-b1df-40bd-a840-6deb58151a39" acquired by "delete_volume" :: waited 0.027s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:41:55 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[46210932-0afa-4dfb-a5b3-0dd8fc4d195c]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:41:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e9541c40-d341-4730-aeeb-42f9275b2ee0 tempest-VolumesListTestJSON-1762966689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-40cb182b-b1df-40bd-a840-6deb58151a39 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:55 devstack sudo[107712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-40cb182b-b1df-40bd-a840-6deb58151a39 Jun 23 16:41:55 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:56 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b73411be-6477-4ec2-a46f-ae5cbe00fff8 tempest-VolumesListTestJSON-1762966689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.300s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:56 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-b73411be-6477-4ec2-a46f-ae5cbe00fff8 tempest-VolumesListTestJSON-1762966689 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:41:56 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-b73411be-6477-4ec2-a46f-ae5cbe00fff8 tempest-VolumesListTestJSON-1762966689 None] Deleted volume successfully. Jun 23 16:41:56 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b73411be-6477-4ec2-a46f-ae5cbe00fff8 tempest-VolumesListTestJSON-1762966689 None] Lock "cinder-4d474f7a-c15b-4544-8280-100c7d19b64f-delete_volume" released by "delete_volume" :: held 3.726s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:41:56 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e9541c40-d341-4730-aeeb-42f9275b2ee0 tempest-VolumesListTestJSON-1762966689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-40cb182b-b1df-40bd-a840-6deb58151a39" returned: 0 in 1.395s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e9541c40-d341-4730-aeeb-42f9275b2ee0 tempest-VolumesListTestJSON-1762966689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-40cb182b-b1df-40bd-a840-6deb58151a39 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:56 devstack sudo[107777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-40cb182b-b1df-40bd-a840-6deb58151a39 Jun 23 16:41:56 devstack sudo[107777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:56 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-461ad5c9-714e-40a0-bc75-03913056ce06 tempest-CreateVolumesFromSnapshotTest-988849501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:41:56 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-461ad5c9-714e-40a0-bc75-03913056ce06 tempest-CreateVolumesFromSnapshotTest-988849501 None] Flow 'volume_create_manager' (6e51f71c-efdc-47ec-bbb5-f1fc8e9d46c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:41:56 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-461ad5c9-714e-40a0-bc75-03913056ce06 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5832449-82f4-4e5b-b41a-294b91574ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-461ad5c9-714e-40a0-bc75-03913056ce06 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5832449-82f4-4e5b-b41a-294b91574ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-259970457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6daa2f8e-f097-4897-a8c4-8a4bf430a82b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd12cb5ced2e4bd484601308723a341d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:41:57Z,use_quota=True,user_id='86487452b2d148dc9ba8b44e4852b19e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-461ad5c9-714e-40a0-bc75-03913056ce06 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4485fd5a-ca8a-4b67-85c3-beec73f13ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-461ad5c9-714e-40a0-bc75-03913056ce06 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4485fd5a-ca8a-4b67-85c3-beec73f13ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-461ad5c9-714e-40a0-bc75-03913056ce06 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02265e90-9d05-4f2a-8745-dca923608233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-461ad5c9-714e-40a0-bc75-03913056ce06 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02265e90-9d05-4f2a-8745-dca923608233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6daa2f8e-f097-4897-a8c4-8a4bf430a82b', 'volume_name': 'volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-461ad5c9-714e-40a0-bc75-03913056ce06 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46e1f667-6cab-42ae-be34-0ca3e3c5c5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-461ad5c9-714e-40a0-bc75-03913056ce06 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46e1f667-6cab-42ae-be34-0ca3e3c5c5b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-461ad5c9-714e-40a0-bc75-03913056ce06 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fe581a2-826a-4d77-92db-38ef54281372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:57 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-461ad5c9-714e-40a0-bc75-03913056ce06 tempest-CreateVolumesFromSnapshotTest-988849501 None] Volume 6daa2f8e-f097-4897-a8c4-8a4bf430a82b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b', 'volume_size': 1} Jun 23 16:41:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-461ad5c9-714e-40a0-bc75-03913056ce06 tempest-CreateVolumesFromSnapshotTest-988849501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:41:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-461ad5c9-714e-40a0-bc75-03913056ce06 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:41:57 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-461ad5c9-714e-40a0-bc75-03913056ce06 tempest-CreateVolumesFromSnapshotTest-988849501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-259970457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6daa2f8e-f097-4897-a8c4-8a4bf430a82b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd12cb5ced2e4bd484601308723a341d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:41:57Z,use_quota=True,user_id='86487452b2d148dc9ba8b44e4852b19e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:41:57 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-461ad5c9-714e-40a0-bc75-03913056ce06 tempest-CreateVolumesFromSnapshotTest-988849501 None] Creating volume 6daa2f8e-f097-4897-a8c4-8a4bf430a82b {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:41:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-461ad5c9-714e-40a0-bc75-03913056ce06 tempest-CreateVolumesFromSnapshotTest-988849501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:41:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-461ad5c9-714e-40a0-bc75-03913056ce06 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:41:57 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-461ad5c9-714e-40a0-bc75-03913056ce06 tempest-CreateVolumesFromSnapshotTest-988849501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:41:57 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-461ad5c9-714e-40a0-bc75-03913056ce06 tempest-CreateVolumesFromSnapshotTest-988849501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:41:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-461ad5c9-714e-40a0-bc75-03913056ce06 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:41:57 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-461ad5c9-714e-40a0-bc75-03913056ce06 tempest-CreateVolumesFromSnapshotTest-988849501 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:41:57 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-461ad5c9-714e-40a0-bc75-03913056ce06 tempest-CreateVolumesFromSnapshotTest-988849501 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:41:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-461ad5c9-714e-40a0-bc75-03913056ce06 tempest-CreateVolumesFromSnapshotTest-988849501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:57 devstack sudo[107790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b 1073741824 Jun 23 16:41:57 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:57 devstack sudo[107777]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e9541c40-d341-4730-aeeb-42f9275b2ee0 tempest-VolumesListTestJSON-1762966689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-40cb182b-b1df-40bd-a840-6deb58151a39" returned: 0 in 1.019s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:57 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e9541c40-d341-4730-aeeb-42f9275b2ee0 tempest-VolumesListTestJSON-1762966689 None] Lock "cinder-quobyte-40cb182b-b1df-40bd-a840-6deb58151a39" released by "delete_volume" :: held 2.506s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:41:57 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-e9541c40-d341-4730-aeeb-42f9275b2ee0 tempest-VolumesListTestJSON-1762966689 None] Created reservations ['a0c58688-c2c0-4a36-9b59-eec4dc785552', '6abbfa86-5366-4918-861b-034ed32542e4', '68eaff2c-5c5f-4e7d-8774-336aa3e17973', '153216e4-3a4d-4022-b19b-c199fe58ff6d'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:41:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e9541c40-d341-4730-aeeb-42f9275b2ee0 tempest-VolumesListTestJSON-1762966689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:41:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e9541c40-d341-4730-aeeb-42f9275b2ee0 tempest-VolumesListTestJSON-1762966689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:41:57 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e9541c40-d341-4730-aeeb-42f9275b2ee0 tempest-VolumesListTestJSON-1762966689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:41:57 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e9541c40-d341-4730-aeeb-42f9275b2ee0 tempest-VolumesListTestJSON-1762966689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:41:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e9541c40-d341-4730-aeeb-42f9275b2ee0 tempest-VolumesListTestJSON-1762966689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:41:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e9541c40-d341-4730-aeeb-42f9275b2ee0 tempest-VolumesListTestJSON-1762966689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:57 devstack sudo[107795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:41:57 devstack sudo[107795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:58 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-461ad5c9-714e-40a0-bc75-03913056ce06 tempest-CreateVolumesFromSnapshotTest-988849501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b 1073741824" returned: 0 in 1.101s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-461ad5c9-714e-40a0-bc75-03913056ce06 tempest-CreateVolumesFromSnapshotTest-988849501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:41:58 devstack sudo[107801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b Jun 23 16:41:58 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:41:58 devstack sudo[107795]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e9541c40-d341-4730-aeeb-42f9275b2ee0 tempest-VolumesListTestJSON-1762966689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.731s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:58 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-e9541c40-d341-4730-aeeb-42f9275b2ee0 tempest-VolumesListTestJSON-1762966689 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:41:58 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-e9541c40-d341-4730-aeeb-42f9275b2ee0 tempest-VolumesListTestJSON-1762966689 None] Deleted volume successfully. Jun 23 16:41:58 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e9541c40-d341-4730-aeeb-42f9275b2ee0 tempest-VolumesListTestJSON-1762966689 None] Lock "cinder-40cb182b-b1df-40bd-a840-6deb58151a39-delete_volume" released by "delete_volume" :: held 3.582s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:41:59 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root Jun 23 16:41:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-461ad5c9-714e-40a0-bc75-03913056ce06 tempest-CreateVolumesFromSnapshotTest-988849501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b" returned: 0 in 0.808s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:41:59 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-461ad5c9-714e-40a0-bc75-03913056ce06 tempest-CreateVolumesFromSnapshotTest-988849501 None] <== create_volume: return (1970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:41:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-461ad5c9-714e-40a0-bc75-03913056ce06 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.975s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:41:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-461ad5c9-714e-40a0-bc75-03913056ce06 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fe581a2-826a-4d77-92db-38ef54281372) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-461ad5c9-714e-40a0-bc75-03913056ce06 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (765b6b6f-6ea8-471b-8f3f-e8bf51ba2da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:41:59 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-461ad5c9-714e-40a0-bc75-03913056ce06 tempest-CreateVolumesFromSnapshotTest-988849501 None] Volume volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b (6daa2f8e-f097-4897-a8c4-8a4bf430a82b): created successfully Jun 23 16:41:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-461ad5c9-714e-40a0-bc75-03913056ce06 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (765b6b6f-6ea8-471b-8f3f-e8bf51ba2da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:41:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-461ad5c9-714e-40a0-bc75-03913056ce06 tempest-CreateVolumesFromSnapshotTest-988849501 None] Flow 'volume_create_manager' (6e51f71c-efdc-47ec-bbb5-f1fc8e9d46c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:41:59 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-461ad5c9-714e-40a0-bc75-03913056ce06 tempest-CreateVolumesFromSnapshotTest-988849501 None] Created volume successfully. Jun 23 16:42:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5a91b088-b624-4366-8e9c-398d0e9c2d83 tempest-CreateVolumesFromSnapshotTest-988849501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:42:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5a91b088-b624-4366-8e9c-398d0e9c2d83 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:42:00 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-5a91b088-b624-4366-8e9c-398d0e9c2d83 tempest-CreateVolumesFromSnapshotTest-988849501 None] Creating offline snapshot 6c427e41-223c-4027-88f4-7fadf161e778 of volume 6daa2f8e-f097-4897-a8c4-8a4bf430a82b {{(pid=93788) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:42:00 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[351d4492-ba48-4101-b204-cca0ab39f97a]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:42:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5a91b088-b624-4366-8e9c-398d0e9c2d83 tempest-CreateVolumesFromSnapshotTest-988849501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:00 devstack sudo[107806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b Jun 23 16:42:00 devstack sudo[107806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:01 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:42:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:42:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:42:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:42:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:42:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:42:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:01 devstack sudo[107811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:42:01 devstack sudo[107811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:01 devstack sudo[107806]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5a91b088-b624-4366-8e9c-398d0e9c2d83 tempest-CreateVolumesFromSnapshotTest-988849501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b" returned: 0 in 1.428s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5a91b088-b624-4366-8e9c-398d0e9c2d83 tempest-CreateVolumesFromSnapshotTest-988849501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b.6c427e41-223c-4027-88f4-7fadf161e778 1G {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:01 devstack sudo[107817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b.6c427e41-223c-4027-88f4-7fadf161e778 1G Jun 23 16:42:01 devstack sudo[107817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:02 devstack sudo[107811]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.221s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:02 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:42:02 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager._thread_info {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:42:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread count: 28 {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 16:42:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread info: [<_MainThread(MainThread, started 126303828988032)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 16:42:03 devstack sudo[107817]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5a91b088-b624-4366-8e9c-398d0e9c2d83 tempest-CreateVolumesFromSnapshotTest-988849501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b.6c427e41-223c-4027-88f4-7fadf161e778 1G" returned: 0 in 1.965s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5a91b088-b624-4366-8e9c-398d0e9c2d83 tempest-CreateVolumesFromSnapshotTest-988849501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b.6c427e41-223c-4027-88f4-7fadf161e778 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:03 devstack sudo[107824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b.6c427e41-223c-4027-88f4-7fadf161e778 Jun 23 16:42:03 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:04 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5a91b088-b624-4366-8e9c-398d0e9c2d83 tempest-CreateVolumesFromSnapshotTest-988849501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b.6c427e41-223c-4027-88f4-7fadf161e778" returned: 0 in 1.150s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:04 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-5a91b088-b624-4366-8e9c-398d0e9c2d83 tempest-CreateVolumesFromSnapshotTest-988849501 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b.6c427e41-223c-4027-88f4-7fadf161e778 is being set with open permissions: ugo+rw Jun 23 16:42:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5a91b088-b624-4366-8e9c-398d0e9c2d83 tempest-CreateVolumesFromSnapshotTest-988849501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b.6c427e41-223c-4027-88f4-7fadf161e778 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:04 devstack sudo[107829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b.6c427e41-223c-4027-88f4-7fadf161e778 Jun 23 16:42:05 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:06 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5a91b088-b624-4366-8e9c-398d0e9c2d83 tempest-CreateVolumesFromSnapshotTest-988849501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b.6c427e41-223c-4027-88f4-7fadf161e778" returned: 0 in 1.210s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5a91b088-b624-4366-8e9c-398d0e9c2d83 tempest-CreateVolumesFromSnapshotTest-988849501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:06 devstack sudo[107832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b.info Jun 23 16:42:06 devstack sudo[107832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:07 devstack sudo[107832]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5a91b088-b624-4366-8e9c-398d0e9c2d83 tempest-CreateVolumesFromSnapshotTest-988849501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b.info" returned: 0 in 1.140s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:07 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-5a91b088-b624-4366-8e9c-398d0e9c2d83 tempest-CreateVolumesFromSnapshotTest-988849501 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b.info is being set with open permissions: ugo+rw Jun 23 16:42:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5a91b088-b624-4366-8e9c-398d0e9c2d83 tempest-CreateVolumesFromSnapshotTest-988849501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:07 devstack sudo[107835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b.info Jun 23 16:42:07 devstack sudo[107835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:08 devstack sudo[107835]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5a91b088-b624-4366-8e9c-398d0e9c2d83 tempest-CreateVolumesFromSnapshotTest-988849501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b.info" returned: 0 in 1.092s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5a91b088-b624-4366-8e9c-398d0e9c2d83 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.134s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:42:08 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-5a91b088-b624-4366-8e9c-398d0e9c2d83 tempest-CreateVolumesFromSnapshotTest-988849501 None] Create snapshot completed successfully Jun 23 16:42:10 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-0510962a-07e0-4330-9eab-ee1acc2f6f64 tempest-CreateVolumesFromSnapshotTest-988849501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:42:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0510962a-07e0-4330-9eab-ee1acc2f6f64 tempest-CreateVolumesFromSnapshotTest-988849501 None] Flow 'volume_create_manager' (669d61c6-e89a-49b2-8667-c53ee223a021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:42:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0510962a-07e0-4330-9eab-ee1acc2f6f64 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6e02503-6a19-437a-a025-cabf0e7f18f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0510962a-07e0-4330-9eab-ee1acc2f6f64 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6e02503-6a19-437a-a025-cabf0e7f18f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-85396731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75b26984-c608-43b8-8222-7f510583cdad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd12cb5ced2e4bd484601308723a341d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:42:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:42:10Z,use_quota=True,user_id='86487452b2d148dc9ba8b44e4852b19e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0510962a-07e0-4330-9eab-ee1acc2f6f64 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fadfa431-6771-4221-bfb0-31136aec04c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0510962a-07e0-4330-9eab-ee1acc2f6f64 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fadfa431-6771-4221-bfb0-31136aec04c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0510962a-07e0-4330-9eab-ee1acc2f6f64 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26ddaa44-39ec-42e5-8d68-4571a3201dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0510962a-07e0-4330-9eab-ee1acc2f6f64 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26ddaa44-39ec-42e5-8d68-4571a3201dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75b26984-c608-43b8-8222-7f510583cdad', 'volume_name': 'volume-75b26984-c608-43b8-8222-7f510583cdad', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0510962a-07e0-4330-9eab-ee1acc2f6f64 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (481500bc-25e9-4637-8446-e1d52a8791ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0510962a-07e0-4330-9eab-ee1acc2f6f64 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (481500bc-25e9-4637-8446-e1d52a8791ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0510962a-07e0-4330-9eab-ee1acc2f6f64 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffeb6f18-b082-4c93-841f-b9f0bfce62d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:10 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-0510962a-07e0-4330-9eab-ee1acc2f6f64 tempest-CreateVolumesFromSnapshotTest-988849501 None] Volume 75b26984-c608-43b8-8222-7f510583cdad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75b26984-c608-43b8-8222-7f510583cdad', 'volume_size': 1} Jun 23 16:42:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-0510962a-07e0-4330-9eab-ee1acc2f6f64 tempest-CreateVolumesFromSnapshotTest-988849501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:42:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-0510962a-07e0-4330-9eab-ee1acc2f6f64 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:42:10 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-0510962a-07e0-4330-9eab-ee1acc2f6f64 tempest-CreateVolumesFromSnapshotTest-988849501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-85396731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75b26984-c608-43b8-8222-7f510583cdad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd12cb5ced2e4bd484601308723a341d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:42:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:42:10Z,use_quota=True,user_id='86487452b2d148dc9ba8b44e4852b19e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:42:10 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-0510962a-07e0-4330-9eab-ee1acc2f6f64 tempest-CreateVolumesFromSnapshotTest-988849501 None] Creating volume 75b26984-c608-43b8-8222-7f510583cdad {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:42:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-0510962a-07e0-4330-9eab-ee1acc2f6f64 tempest-CreateVolumesFromSnapshotTest-988849501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:42:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-0510962a-07e0-4330-9eab-ee1acc2f6f64 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:42:10 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-0510962a-07e0-4330-9eab-ee1acc2f6f64 tempest-CreateVolumesFromSnapshotTest-988849501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:42:10 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-0510962a-07e0-4330-9eab-ee1acc2f6f64 tempest-CreateVolumesFromSnapshotTest-988849501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:42:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-0510962a-07e0-4330-9eab-ee1acc2f6f64 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:42:10 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-0510962a-07e0-4330-9eab-ee1acc2f6f64 tempest-CreateVolumesFromSnapshotTest-988849501 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:42:10 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-0510962a-07e0-4330-9eab-ee1acc2f6f64 tempest-CreateVolumesFromSnapshotTest-988849501 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:42:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0510962a-07e0-4330-9eab-ee1acc2f6f64 tempest-CreateVolumesFromSnapshotTest-988849501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-75b26984-c608-43b8-8222-7f510583cdad 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:10 devstack sudo[107839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-75b26984-c608-43b8-8222-7f510583cdad 1073741824 Jun 23 16:42:10 devstack sudo[107839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:10 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6c53ea6-a121-4676-8a32-76d553a13ae0 tempest-CreateVolumesFromSnapshotTest-988849501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:42:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e6c53ea6-a121-4676-8a32-76d553a13ae0 tempest-CreateVolumesFromSnapshotTest-988849501 None] Flow 'volume_create_manager' (f66be6a4-5473-4916-b0ef-659e83cc9352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:42:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e6c53ea6-a121-4676-8a32-76d553a13ae0 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d61101cc-8179-42ed-aa36-cf7740cb2844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e6c53ea6-a121-4676-8a32-76d553a13ae0 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d61101cc-8179-42ed-aa36-cf7740cb2844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:42:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-584524779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b8f847e-9a7f-4c70-91f2-2c1c714f489c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd12cb5ced2e4bd484601308723a341d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:42:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:42:11Z,use_quota=True,user_id='86487452b2d148dc9ba8b44e4852b19e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e6c53ea6-a121-4676-8a32-76d553a13ae0 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98da5ca8-95b7-4351-939e-e50d38a44939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e6c53ea6-a121-4676-8a32-76d553a13ae0 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98da5ca8-95b7-4351-939e-e50d38a44939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e6c53ea6-a121-4676-8a32-76d553a13ae0 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b142297d-1b22-419c-8782-cdaafbec5365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e6c53ea6-a121-4676-8a32-76d553a13ae0 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b142297d-1b22-419c-8782-cdaafbec5365) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b8f847e-9a7f-4c70-91f2-2c1c714f489c', 'volume_name': 'volume-2b8f847e-9a7f-4c70-91f2-2c1c714f489c', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e6c53ea6-a121-4676-8a32-76d553a13ae0 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a027b598-799a-45a2-a2c8-95205ecacba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e6c53ea6-a121-4676-8a32-76d553a13ae0 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a027b598-799a-45a2-a2c8-95205ecacba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e6c53ea6-a121-4676-8a32-76d553a13ae0 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27cb48e2-60b6-41e2-a55e-20de8c2c9503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:10 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-e6c53ea6-a121-4676-8a32-76d553a13ae0 tempest-CreateVolumesFromSnapshotTest-988849501 None] Volume 2b8f847e-9a7f-4c70-91f2-2c1c714f489c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b8f847e-9a7f-4c70-91f2-2c1c714f489c', 'volume_size': 1} Jun 23 16:42:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e6c53ea6-a121-4676-8a32-76d553a13ae0 tempest-CreateVolumesFromSnapshotTest-988849501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:42:11 devstack sudo[107839]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0510962a-07e0-4330-9eab-ee1acc2f6f64 tempest-CreateVolumesFromSnapshotTest-988849501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-75b26984-c608-43b8-8222-7f510583cdad 1073741824" returned: 0 in 1.558s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0510962a-07e0-4330-9eab-ee1acc2f6f64 tempest-CreateVolumesFromSnapshotTest-988849501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-75b26984-c608-43b8-8222-7f510583cdad {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:11 devstack sudo[107888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-75b26984-c608-43b8-8222-7f510583cdad Jun 23 16:42:11 devstack sudo[107888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:12 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-d55b4f38-a188-4900-8f7a-1bd2617c96ec tempest-CreateVolumesFromSnapshotTest-988849501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:42:12 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d55b4f38-a188-4900-8f7a-1bd2617c96ec tempest-CreateVolumesFromSnapshotTest-988849501 None] Flow 'volume_create_manager' (75a9b5d8-df03-443e-a030-27e7c6e5d895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:42:12 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d55b4f38-a188-4900-8f7a-1bd2617c96ec tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e10dc85-71f3-414b-9f2b-fc2c136a86c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:12 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d55b4f38-a188-4900-8f7a-1bd2617c96ec tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e10dc85-71f3-414b-9f2b-fc2c136a86c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2006668846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d54ede86-f1f7-4ba1-ae0d-78fb90d102bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd12cb5ced2e4bd484601308723a341d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:42:12Z,use_quota=True,user_id='86487452b2d148dc9ba8b44e4852b19e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:12 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d55b4f38-a188-4900-8f7a-1bd2617c96ec tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4f851f8-ecc8-4c44-bd8f-75e7f55698f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:12 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d55b4f38-a188-4900-8f7a-1bd2617c96ec tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4f851f8-ecc8-4c44-bd8f-75e7f55698f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:12 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d55b4f38-a188-4900-8f7a-1bd2617c96ec tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ad56efd-ffdb-4aba-b738-4ecf79a5c860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:12 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d55b4f38-a188-4900-8f7a-1bd2617c96ec tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ad56efd-ffdb-4aba-b738-4ecf79a5c860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd54ede86-f1f7-4ba1-ae0d-78fb90d102bb', 'volume_name': 'volume-d54ede86-f1f7-4ba1-ae0d-78fb90d102bb', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:12 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d55b4f38-a188-4900-8f7a-1bd2617c96ec tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf91779d-2914-49f7-9117-028ce3548f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:12 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d55b4f38-a188-4900-8f7a-1bd2617c96ec tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf91779d-2914-49f7-9117-028ce3548f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:12 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d55b4f38-a188-4900-8f7a-1bd2617c96ec tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (663c0c47-1260-4d60-bbf1-ccc11076d63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:12 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-d55b4f38-a188-4900-8f7a-1bd2617c96ec tempest-CreateVolumesFromSnapshotTest-988849501 None] Volume d54ede86-f1f7-4ba1-ae0d-78fb90d102bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d54ede86-f1f7-4ba1-ae0d-78fb90d102bb', 'volume_size': 1} Jun 23 16:42:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d55b4f38-a188-4900-8f7a-1bd2617c96ec tempest-CreateVolumesFromSnapshotTest-988849501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:42:12 devstack sudo[107888]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0510962a-07e0-4330-9eab-ee1acc2f6f64 tempest-CreateVolumesFromSnapshotTest-988849501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-75b26984-c608-43b8-8222-7f510583cdad" returned: 0 in 0.970s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:12 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-0510962a-07e0-4330-9eab-ee1acc2f6f64 tempest-CreateVolumesFromSnapshotTest-988849501 None] <== create_volume: return (2635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:42:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-0510962a-07e0-4330-9eab-ee1acc2f6f64 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.638s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:42:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e6c53ea6-a121-4676-8a32-76d553a13ae0 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.901s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:42:12 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e6c53ea6-a121-4676-8a32-76d553a13ae0 tempest-CreateVolumesFromSnapshotTest-988849501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:42:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-584524779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b8f847e-9a7f-4c70-91f2-2c1c714f489c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd12cb5ced2e4bd484601308723a341d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:42:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:42:11Z,use_quota=True,user_id='86487452b2d148dc9ba8b44e4852b19e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:42:12 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-e6c53ea6-a121-4676-8a32-76d553a13ae0 tempest-CreateVolumesFromSnapshotTest-988849501 None] Creating volume 2b8f847e-9a7f-4c70-91f2-2c1c714f489c {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:42:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e6c53ea6-a121-4676-8a32-76d553a13ae0 tempest-CreateVolumesFromSnapshotTest-988849501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:42:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e6c53ea6-a121-4676-8a32-76d553a13ae0 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:42:12 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e6c53ea6-a121-4676-8a32-76d553a13ae0 tempest-CreateVolumesFromSnapshotTest-988849501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:42:12 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e6c53ea6-a121-4676-8a32-76d553a13ae0 tempest-CreateVolumesFromSnapshotTest-988849501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:42:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e6c53ea6-a121-4676-8a32-76d553a13ae0 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:42:12 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e6c53ea6-a121-4676-8a32-76d553a13ae0 tempest-CreateVolumesFromSnapshotTest-988849501 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:42:12 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-e6c53ea6-a121-4676-8a32-76d553a13ae0 tempest-CreateVolumesFromSnapshotTest-988849501 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:42:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e6c53ea6-a121-4676-8a32-76d553a13ae0 tempest-CreateVolumesFromSnapshotTest-988849501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2b8f847e-9a7f-4c70-91f2-2c1c714f489c 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:12 devstack sudo[107895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2b8f847e-9a7f-4c70-91f2-2c1c714f489c 1073741824 Jun 23 16:42:12 devstack sudo[107895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:12 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0510962a-07e0-4330-9eab-ee1acc2f6f64 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffeb6f18-b082-4c93-841f-b9f0bfce62d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75b26984-c608-43b8-8222-7f510583cdad', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:12 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0510962a-07e0-4330-9eab-ee1acc2f6f64 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d2fb875-4820-49b6-9876-d88484cff6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:12 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-0510962a-07e0-4330-9eab-ee1acc2f6f64 tempest-CreateVolumesFromSnapshotTest-988849501 None] Volume volume-75b26984-c608-43b8-8222-7f510583cdad (75b26984-c608-43b8-8222-7f510583cdad): created successfully Jun 23 16:42:12 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0510962a-07e0-4330-9eab-ee1acc2f6f64 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d2fb875-4820-49b6-9876-d88484cff6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:12 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0510962a-07e0-4330-9eab-ee1acc2f6f64 tempest-CreateVolumesFromSnapshotTest-988849501 None] Flow 'volume_create_manager' (669d61c6-e89a-49b2-8667-c53ee223a021) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:42:12 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-0510962a-07e0-4330-9eab-ee1acc2f6f64 tempest-CreateVolumesFromSnapshotTest-988849501 None] Created volume successfully. Jun 23 16:42:13 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-f97279e2-b0cc-4062-9a64-7d7fbd7b6b49 tempest-TestServerVolumeAttachmentScenario-12948084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:42:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f97279e2-b0cc-4062-9a64-7d7fbd7b6b49 tempest-TestServerVolumeAttachmentScenario-12948084 None] Flow 'volume_create_manager' (8bc43628-274e-4f07-9d9c-8aba7254f5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:42:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f97279e2-b0cc-4062-9a64-7d7fbd7b6b49 tempest-TestServerVolumeAttachmentScenario-12948084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc300b06-797b-4b72-a122-eae9a4e0b93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f97279e2-b0cc-4062-9a64-7d7fbd7b6b49 tempest-TestServerVolumeAttachmentScenario-12948084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc300b06-797b-4b72-a122-eae9a4e0b93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1631896851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40ea7b4e-cdef-4b1b-b367-4151f8eb4a61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='233f65f881b64bf89bd18f45f39484ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:42:13Z,use_quota=True,user_id='db663531ff9c4a4888b3b927ca16f3d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f97279e2-b0cc-4062-9a64-7d7fbd7b6b49 tempest-TestServerVolumeAttachmentScenario-12948084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (790888bb-9910-4247-91ff-735693778a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f97279e2-b0cc-4062-9a64-7d7fbd7b6b49 tempest-TestServerVolumeAttachmentScenario-12948084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (790888bb-9910-4247-91ff-735693778a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f97279e2-b0cc-4062-9a64-7d7fbd7b6b49 tempest-TestServerVolumeAttachmentScenario-12948084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (909c4b9f-1474-4612-9f31-e797cd634ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f97279e2-b0cc-4062-9a64-7d7fbd7b6b49 tempest-TestServerVolumeAttachmentScenario-12948084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (909c4b9f-1474-4612-9f31-e797cd634ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40ea7b4e-cdef-4b1b-b367-4151f8eb4a61', 'volume_name': 'volume-40ea7b4e-cdef-4b1b-b367-4151f8eb4a61', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f97279e2-b0cc-4062-9a64-7d7fbd7b6b49 tempest-TestServerVolumeAttachmentScenario-12948084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b4c3029-8a63-4207-9480-0be3e55fff50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f97279e2-b0cc-4062-9a64-7d7fbd7b6b49 tempest-TestServerVolumeAttachmentScenario-12948084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b4c3029-8a63-4207-9480-0be3e55fff50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f97279e2-b0cc-4062-9a64-7d7fbd7b6b49 tempest-TestServerVolumeAttachmentScenario-12948084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbc698bc-cc50-4af8-8cb4-89184e9fe60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:13 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-f97279e2-b0cc-4062-9a64-7d7fbd7b6b49 tempest-TestServerVolumeAttachmentScenario-12948084 None] Volume 40ea7b4e-cdef-4b1b-b367-4151f8eb4a61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40ea7b4e-cdef-4b1b-b367-4151f8eb4a61', 'volume_size': 1} Jun 23 16:42:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f97279e2-b0cc-4062-9a64-7d7fbd7b6b49 tempest-TestServerVolumeAttachmentScenario-12948084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:42:13 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-80e06ef2-90c9-4745-a475-19e84e733901 tempest-TestServerVolumeAttachmentScenario-12948084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:42:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-80e06ef2-90c9-4745-a475-19e84e733901 tempest-TestServerVolumeAttachmentScenario-12948084 None] Flow 'volume_create_manager' (d3729706-eb74-4799-86e9-740976515cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:42:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-80e06ef2-90c9-4745-a475-19e84e733901 tempest-TestServerVolumeAttachmentScenario-12948084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0db68a6d-1155-4f58-9f3c-814e0796b562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-80e06ef2-90c9-4745-a475-19e84e733901 tempest-TestServerVolumeAttachmentScenario-12948084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0db68a6d-1155-4f58-9f3c-814e0796b562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-979261352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69e2cdcc-ab99-4639-9be2-f15d69f6358e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='233f65f881b64bf89bd18f45f39484ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:42:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:42:14Z,use_quota=True,user_id='db663531ff9c4a4888b3b927ca16f3d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-80e06ef2-90c9-4745-a475-19e84e733901 tempest-TestServerVolumeAttachmentScenario-12948084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc638cd7-2c42-4b67-b5e5-7824afdb761d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-80e06ef2-90c9-4745-a475-19e84e733901 tempest-TestServerVolumeAttachmentScenario-12948084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc638cd7-2c42-4b67-b5e5-7824afdb761d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-80e06ef2-90c9-4745-a475-19e84e733901 tempest-TestServerVolumeAttachmentScenario-12948084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f312773f-760e-40ef-b94a-1c12b1d9668a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-80e06ef2-90c9-4745-a475-19e84e733901 tempest-TestServerVolumeAttachmentScenario-12948084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f312773f-760e-40ef-b94a-1c12b1d9668a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69e2cdcc-ab99-4639-9be2-f15d69f6358e', 'volume_name': 'volume-69e2cdcc-ab99-4639-9be2-f15d69f6358e', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-80e06ef2-90c9-4745-a475-19e84e733901 tempest-TestServerVolumeAttachmentScenario-12948084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6c26b99-827d-4f3d-81d7-4fca5a66d641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-80e06ef2-90c9-4745-a475-19e84e733901 tempest-TestServerVolumeAttachmentScenario-12948084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6c26b99-827d-4f3d-81d7-4fca5a66d641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-80e06ef2-90c9-4745-a475-19e84e733901 tempest-TestServerVolumeAttachmentScenario-12948084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49b28edb-d802-4fbe-afce-22879ce1b778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:13 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-80e06ef2-90c9-4745-a475-19e84e733901 tempest-TestServerVolumeAttachmentScenario-12948084 None] Volume 69e2cdcc-ab99-4639-9be2-f15d69f6358e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69e2cdcc-ab99-4639-9be2-f15d69f6358e', 'volume_size': 1} Jun 23 16:42:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-80e06ef2-90c9-4745-a475-19e84e733901 tempest-TestServerVolumeAttachmentScenario-12948084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:42:13 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6cdfcea-e71d-4389-abcd-2f431ba803d2 tempest-CreateVolumesFromSnapshotTest-988849501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:42:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c6cdfcea-e71d-4389-abcd-2f431ba803d2 tempest-CreateVolumesFromSnapshotTest-988849501 None] Flow 'volume_create_manager' (645ba733-0f19-4031-aa8f-ba2b8ce2b464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:42:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c6cdfcea-e71d-4389-abcd-2f431ba803d2 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b628667a-874b-4351-85b7-cf089fa23263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:13 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4ff219c-8639-4a04-abe3-b81f44a4d764 tempest-CreateVolumesFromSnapshotTest-988849501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:42:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e4ff219c-8639-4a04-abe3-b81f44a4d764 tempest-CreateVolumesFromSnapshotTest-988849501 None] Flow 'volume_create_manager' (fec48198-b8d4-454a-8980-f0f55ff999bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:42:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e4ff219c-8639-4a04-abe3-b81f44a4d764 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (474ef556-78d0-481d-9ea7-ec3f48bc81c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c6cdfcea-e71d-4389-abcd-2f431ba803d2 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b628667a-874b-4351-85b7-cf089fa23263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-763051638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aadcc51-7ea6-40b7-853d-1f6afcc7a66f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd12cb5ced2e4bd484601308723a341d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:42:14Z,use_quota=True,user_id='86487452b2d148dc9ba8b44e4852b19e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c6cdfcea-e71d-4389-abcd-2f431ba803d2 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf57cb0e-f78c-46f6-8f95-66e80e796a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c6cdfcea-e71d-4389-abcd-2f431ba803d2 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf57cb0e-f78c-46f6-8f95-66e80e796a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c6cdfcea-e71d-4389-abcd-2f431ba803d2 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f781f81-e605-4605-b913-d67757c5ff4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c6cdfcea-e71d-4389-abcd-2f431ba803d2 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f781f81-e605-4605-b913-d67757c5ff4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6aadcc51-7ea6-40b7-853d-1f6afcc7a66f', 'volume_name': 'volume-6aadcc51-7ea6-40b7-853d-1f6afcc7a66f', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c6cdfcea-e71d-4389-abcd-2f431ba803d2 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0a443c1-cbaf-496b-b9b8-66c99d4068fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c6cdfcea-e71d-4389-abcd-2f431ba803d2 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0a443c1-cbaf-496b-b9b8-66c99d4068fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c6cdfcea-e71d-4389-abcd-2f431ba803d2 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65ee544c-82e7-4d0f-b113-ed7aa06533d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:13 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-c6cdfcea-e71d-4389-abcd-2f431ba803d2 tempest-CreateVolumesFromSnapshotTest-988849501 None] Volume 6aadcc51-7ea6-40b7-853d-1f6afcc7a66f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6aadcc51-7ea6-40b7-853d-1f6afcc7a66f', 'volume_size': 1} Jun 23 16:42:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-c6cdfcea-e71d-4389-abcd-2f431ba803d2 tempest-CreateVolumesFromSnapshotTest-988849501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:42:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e4ff219c-8639-4a04-abe3-b81f44a4d764 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (474ef556-78d0-481d-9ea7-ec3f48bc81c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-583833940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09d42f0f-c55a-493b-91b9-4cf8e4c73180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd12cb5ced2e4bd484601308723a341d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:42:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:42:14Z,use_quota=True,user_id='86487452b2d148dc9ba8b44e4852b19e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e4ff219c-8639-4a04-abe3-b81f44a4d764 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2de17a3-c42a-45cb-a601-baa5c78fc180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e4ff219c-8639-4a04-abe3-b81f44a4d764 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2de17a3-c42a-45cb-a601-baa5c78fc180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:14 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e4ff219c-8639-4a04-abe3-b81f44a4d764 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da32a01a-4c7d-458b-9e9f-9043284515a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:14 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e4ff219c-8639-4a04-abe3-b81f44a4d764 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da32a01a-4c7d-458b-9e9f-9043284515a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09d42f0f-c55a-493b-91b9-4cf8e4c73180', 'volume_name': 'volume-09d42f0f-c55a-493b-91b9-4cf8e4c73180', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:14 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e4ff219c-8639-4a04-abe3-b81f44a4d764 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dee19b95-75d5-4509-aa11-adc4d5b052b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:14 devstack sudo[107895]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:14 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e4ff219c-8639-4a04-abe3-b81f44a4d764 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dee19b95-75d5-4509-aa11-adc4d5b052b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:14 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e4ff219c-8639-4a04-abe3-b81f44a4d764 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7d939fc-eca7-4bf6-bfa8-3ef091f56dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:14 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-e4ff219c-8639-4a04-abe3-b81f44a4d764 tempest-CreateVolumesFromSnapshotTest-988849501 None] Volume 09d42f0f-c55a-493b-91b9-4cf8e4c73180: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09d42f0f-c55a-493b-91b9-4cf8e4c73180', 'volume_size': 1} Jun 23 16:42:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e4ff219c-8639-4a04-abe3-b81f44a4d764 tempest-CreateVolumesFromSnapshotTest-988849501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:42:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e6c53ea6-a121-4676-8a32-76d553a13ae0 tempest-CreateVolumesFromSnapshotTest-988849501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2b8f847e-9a7f-4c70-91f2-2c1c714f489c 1073741824" returned: 0 in 1.219s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e6c53ea6-a121-4676-8a32-76d553a13ae0 tempest-CreateVolumesFromSnapshotTest-988849501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2b8f847e-9a7f-4c70-91f2-2c1c714f489c {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:14 devstack sudo[107906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2b8f847e-9a7f-4c70-91f2-2c1c714f489c Jun 23 16:42:14 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:15 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e6c53ea6-a121-4676-8a32-76d553a13ae0 tempest-CreateVolumesFromSnapshotTest-988849501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2b8f847e-9a7f-4c70-91f2-2c1c714f489c" returned: 0 in 0.983s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:15 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e6c53ea6-a121-4676-8a32-76d553a13ae0 tempest-CreateVolumesFromSnapshotTest-988849501 None] <== create_volume: return (2255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:42:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e6c53ea6-a121-4676-8a32-76d553a13ae0 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.258s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:42:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d55b4f38-a188-4900-8f7a-1bd2617c96ec tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.955s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:42:15 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-d55b4f38-a188-4900-8f7a-1bd2617c96ec tempest-CreateVolumesFromSnapshotTest-988849501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2006668846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d54ede86-f1f7-4ba1-ae0d-78fb90d102bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd12cb5ced2e4bd484601308723a341d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:42:12Z,use_quota=True,user_id='86487452b2d148dc9ba8b44e4852b19e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:42:15 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-d55b4f38-a188-4900-8f7a-1bd2617c96ec tempest-CreateVolumesFromSnapshotTest-988849501 None] Creating volume d54ede86-f1f7-4ba1-ae0d-78fb90d102bb {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:42:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d55b4f38-a188-4900-8f7a-1bd2617c96ec tempest-CreateVolumesFromSnapshotTest-988849501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:42:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d55b4f38-a188-4900-8f7a-1bd2617c96ec tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:42:15 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-d55b4f38-a188-4900-8f7a-1bd2617c96ec tempest-CreateVolumesFromSnapshotTest-988849501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:42:15 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-d55b4f38-a188-4900-8f7a-1bd2617c96ec tempest-CreateVolumesFromSnapshotTest-988849501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:42:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d55b4f38-a188-4900-8f7a-1bd2617c96ec tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:42:15 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-d55b4f38-a188-4900-8f7a-1bd2617c96ec tempest-CreateVolumesFromSnapshotTest-988849501 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:42:15 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-d55b4f38-a188-4900-8f7a-1bd2617c96ec tempest-CreateVolumesFromSnapshotTest-988849501 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:42:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d55b4f38-a188-4900-8f7a-1bd2617c96ec tempest-CreateVolumesFromSnapshotTest-988849501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d54ede86-f1f7-4ba1-ae0d-78fb90d102bb 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:15 devstack sudo[107911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d54ede86-f1f7-4ba1-ae0d-78fb90d102bb 1073741824 Jun 23 16:42:15 devstack sudo[107911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:15 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e6c53ea6-a121-4676-8a32-76d553a13ae0 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27cb48e2-60b6-41e2-a55e-20de8c2c9503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b8f847e-9a7f-4c70-91f2-2c1c714f489c', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:15 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e6c53ea6-a121-4676-8a32-76d553a13ae0 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d685376b-78c2-4d44-9884-8a0a93077840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:15 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-e6c53ea6-a121-4676-8a32-76d553a13ae0 tempest-CreateVolumesFromSnapshotTest-988849501 None] Volume volume-2b8f847e-9a7f-4c70-91f2-2c1c714f489c (2b8f847e-9a7f-4c70-91f2-2c1c714f489c): created successfully Jun 23 16:42:15 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e6c53ea6-a121-4676-8a32-76d553a13ae0 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d685376b-78c2-4d44-9884-8a0a93077840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:15 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e6c53ea6-a121-4676-8a32-76d553a13ae0 tempest-CreateVolumesFromSnapshotTest-988849501 None] Flow 'volume_create_manager' (f66be6a4-5473-4916-b0ef-659e83cc9352) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:42:15 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-e6c53ea6-a121-4676-8a32-76d553a13ae0 tempest-CreateVolumesFromSnapshotTest-988849501 None] Created volume successfully. Jun 23 16:42:16 devstack sudo[107911]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d55b4f38-a188-4900-8f7a-1bd2617c96ec tempest-CreateVolumesFromSnapshotTest-988849501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d54ede86-f1f7-4ba1-ae0d-78fb90d102bb 1073741824" returned: 0 in 1.232s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d55b4f38-a188-4900-8f7a-1bd2617c96ec tempest-CreateVolumesFromSnapshotTest-988849501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d54ede86-f1f7-4ba1-ae0d-78fb90d102bb {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:16 devstack sudo[107917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d54ede86-f1f7-4ba1-ae0d-78fb90d102bb Jun 23 16:42:16 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:17 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d55b4f38-a188-4900-8f7a-1bd2617c96ec tempest-CreateVolumesFromSnapshotTest-988849501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d54ede86-f1f7-4ba1-ae0d-78fb90d102bb" returned: 0 in 0.711s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:17 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-d55b4f38-a188-4900-8f7a-1bd2617c96ec tempest-CreateVolumesFromSnapshotTest-988849501 None] <== create_volume: return (1995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:42:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d55b4f38-a188-4900-8f7a-1bd2617c96ec tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.998s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:42:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f97279e2-b0cc-4062-9a64-7d7fbd7b6b49 tempest-TestServerVolumeAttachmentScenario-12948084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.692s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:42:17 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-f97279e2-b0cc-4062-9a64-7d7fbd7b6b49 tempest-TestServerVolumeAttachmentScenario-12948084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1631896851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40ea7b4e-cdef-4b1b-b367-4151f8eb4a61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='233f65f881b64bf89bd18f45f39484ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:42:13Z,use_quota=True,user_id='db663531ff9c4a4888b3b927ca16f3d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:42:17 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-f97279e2-b0cc-4062-9a64-7d7fbd7b6b49 tempest-TestServerVolumeAttachmentScenario-12948084 None] Creating volume 40ea7b4e-cdef-4b1b-b367-4151f8eb4a61 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:42:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f97279e2-b0cc-4062-9a64-7d7fbd7b6b49 tempest-TestServerVolumeAttachmentScenario-12948084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:42:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f97279e2-b0cc-4062-9a64-7d7fbd7b6b49 tempest-TestServerVolumeAttachmentScenario-12948084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:42:17 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-f97279e2-b0cc-4062-9a64-7d7fbd7b6b49 tempest-TestServerVolumeAttachmentScenario-12948084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:42:17 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-f97279e2-b0cc-4062-9a64-7d7fbd7b6b49 tempest-TestServerVolumeAttachmentScenario-12948084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:42:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f97279e2-b0cc-4062-9a64-7d7fbd7b6b49 tempest-TestServerVolumeAttachmentScenario-12948084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:42:17 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-f97279e2-b0cc-4062-9a64-7d7fbd7b6b49 tempest-TestServerVolumeAttachmentScenario-12948084 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:42:17 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-f97279e2-b0cc-4062-9a64-7d7fbd7b6b49 tempest-TestServerVolumeAttachmentScenario-12948084 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:42:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f97279e2-b0cc-4062-9a64-7d7fbd7b6b49 tempest-TestServerVolumeAttachmentScenario-12948084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-40ea7b4e-cdef-4b1b-b367-4151f8eb4a61 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:17 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d55b4f38-a188-4900-8f7a-1bd2617c96ec tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (663c0c47-1260-4d60-bbf1-ccc11076d63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d54ede86-f1f7-4ba1-ae0d-78fb90d102bb', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:17 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d55b4f38-a188-4900-8f7a-1bd2617c96ec tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5172e938-9e5f-4e59-a01c-0de7218fffa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:17 devstack sudo[107920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-40ea7b4e-cdef-4b1b-b367-4151f8eb4a61 1073741824 Jun 23 16:42:17 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:17 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-d55b4f38-a188-4900-8f7a-1bd2617c96ec tempest-CreateVolumesFromSnapshotTest-988849501 None] Volume volume-d54ede86-f1f7-4ba1-ae0d-78fb90d102bb (d54ede86-f1f7-4ba1-ae0d-78fb90d102bb): created successfully Jun 23 16:42:17 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d55b4f38-a188-4900-8f7a-1bd2617c96ec tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5172e938-9e5f-4e59-a01c-0de7218fffa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:17 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d55b4f38-a188-4900-8f7a-1bd2617c96ec tempest-CreateVolumesFromSnapshotTest-988849501 None] Flow 'volume_create_manager' (75a9b5d8-df03-443e-a030-27e7c6e5d895) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:42:17 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-d55b4f38-a188-4900-8f7a-1bd2617c96ec tempest-CreateVolumesFromSnapshotTest-988849501 None] Created volume successfully. Jun 23 16:42:18 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:18 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f97279e2-b0cc-4062-9a64-7d7fbd7b6b49 tempest-TestServerVolumeAttachmentScenario-12948084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-40ea7b4e-cdef-4b1b-b367-4151f8eb4a61 1073741824" returned: 0 in 1.129s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:18 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f97279e2-b0cc-4062-9a64-7d7fbd7b6b49 tempest-TestServerVolumeAttachmentScenario-12948084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-40ea7b4e-cdef-4b1b-b367-4151f8eb4a61 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:18 devstack sudo[107926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-40ea7b4e-cdef-4b1b-b367-4151f8eb4a61 Jun 23 16:42:18 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:19 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:19 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f97279e2-b0cc-4062-9a64-7d7fbd7b6b49 tempest-TestServerVolumeAttachmentScenario-12948084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-40ea7b4e-cdef-4b1b-b367-4151f8eb4a61" returned: 0 in 0.779s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:19 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-f97279e2-b0cc-4062-9a64-7d7fbd7b6b49 tempest-TestServerVolumeAttachmentScenario-12948084 None] <== create_volume: return (1964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:42:19 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f97279e2-b0cc-4062-9a64-7d7fbd7b6b49 tempest-TestServerVolumeAttachmentScenario-12948084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.970s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:42:19 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-80e06ef2-90c9-4745-a475-19e84e733901 tempest-TestServerVolumeAttachmentScenario-12948084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.277s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:42:19 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-80e06ef2-90c9-4745-a475-19e84e733901 tempest-TestServerVolumeAttachmentScenario-12948084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-979261352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69e2cdcc-ab99-4639-9be2-f15d69f6358e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='233f65f881b64bf89bd18f45f39484ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:42:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:42:14Z,use_quota=True,user_id='db663531ff9c4a4888b3b927ca16f3d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:42:19 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-80e06ef2-90c9-4745-a475-19e84e733901 tempest-TestServerVolumeAttachmentScenario-12948084 None] Creating volume 69e2cdcc-ab99-4639-9be2-f15d69f6358e {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:42:19 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-80e06ef2-90c9-4745-a475-19e84e733901 tempest-TestServerVolumeAttachmentScenario-12948084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:42:19 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-80e06ef2-90c9-4745-a475-19e84e733901 tempest-TestServerVolumeAttachmentScenario-12948084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:42:19 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-80e06ef2-90c9-4745-a475-19e84e733901 tempest-TestServerVolumeAttachmentScenario-12948084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:42:19 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-80e06ef2-90c9-4745-a475-19e84e733901 tempest-TestServerVolumeAttachmentScenario-12948084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:42:19 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-80e06ef2-90c9-4745-a475-19e84e733901 tempest-TestServerVolumeAttachmentScenario-12948084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:42:19 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-80e06ef2-90c9-4745-a475-19e84e733901 tempest-TestServerVolumeAttachmentScenario-12948084 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:42:19 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-80e06ef2-90c9-4745-a475-19e84e733901 tempest-TestServerVolumeAttachmentScenario-12948084 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:42:19 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-80e06ef2-90c9-4745-a475-19e84e733901 tempest-TestServerVolumeAttachmentScenario-12948084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69e2cdcc-ab99-4639-9be2-f15d69f6358e 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:19 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f97279e2-b0cc-4062-9a64-7d7fbd7b6b49 tempest-TestServerVolumeAttachmentScenario-12948084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbc698bc-cc50-4af8-8cb4-89184e9fe60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40ea7b4e-cdef-4b1b-b367-4151f8eb4a61', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:19 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f97279e2-b0cc-4062-9a64-7d7fbd7b6b49 tempest-TestServerVolumeAttachmentScenario-12948084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cae4df81-95c2-4395-a048-55da9f1aa09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:19 devstack sudo[107930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69e2cdcc-ab99-4639-9be2-f15d69f6358e 1073741824 Jun 23 16:42:19 devstack sudo[107930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:19 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-f97279e2-b0cc-4062-9a64-7d7fbd7b6b49 tempest-TestServerVolumeAttachmentScenario-12948084 None] Volume volume-40ea7b4e-cdef-4b1b-b367-4151f8eb4a61 (40ea7b4e-cdef-4b1b-b367-4151f8eb4a61): created successfully Jun 23 16:42:19 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f97279e2-b0cc-4062-9a64-7d7fbd7b6b49 tempest-TestServerVolumeAttachmentScenario-12948084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cae4df81-95c2-4395-a048-55da9f1aa09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:19 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f97279e2-b0cc-4062-9a64-7d7fbd7b6b49 tempest-TestServerVolumeAttachmentScenario-12948084 None] Flow 'volume_create_manager' (8bc43628-274e-4f07-9d9c-8aba7254f5ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:42:19 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-f97279e2-b0cc-4062-9a64-7d7fbd7b6b49 tempest-TestServerVolumeAttachmentScenario-12948084 None] Created volume successfully. Jun 23 16:42:19 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-8360d8f0-70f8-4f4c-8785-f8abe3d35d78 tempest-VolumesSnapshotTestJSON-1537803418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:42:19 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8360d8f0-70f8-4f4c-8785-f8abe3d35d78 tempest-VolumesSnapshotTestJSON-1537803418 None] Flow 'volume_create_manager' (08380d49-e388-4bec-b004-e07f1b0e299b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:42:20 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8360d8f0-70f8-4f4c-8785-f8abe3d35d78 tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ac80b97-eda6-4071-8441-401009d7c216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:20 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8360d8f0-70f8-4f4c-8785-f8abe3d35d78 tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ac80b97-eda6-4071-8441-401009d7c216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1528435945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4df677b-2c51-4af8-99b5-1f0ff9644df2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd0b61ecd544df9a4720fb512a61494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:42:20Z,use_quota=True,user_id='dc863f468a064fdca543394f9e0a10c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:20 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8360d8f0-70f8-4f4c-8785-f8abe3d35d78 tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d7c1a9-b7ed-4fc3-a2cb-c959041a977a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:20 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8360d8f0-70f8-4f4c-8785-f8abe3d35d78 tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d7c1a9-b7ed-4fc3-a2cb-c959041a977a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:20 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8360d8f0-70f8-4f4c-8785-f8abe3d35d78 tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (890b66f0-a61b-4409-b7c2-37fbf77f3107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:20 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8360d8f0-70f8-4f4c-8785-f8abe3d35d78 tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (890b66f0-a61b-4409-b7c2-37fbf77f3107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4df677b-2c51-4af8-99b5-1f0ff9644df2', 'volume_name': 'volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:20 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8360d8f0-70f8-4f4c-8785-f8abe3d35d78 tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb929f15-d5f0-47a7-8763-a03268d52084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:20 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8360d8f0-70f8-4f4c-8785-f8abe3d35d78 tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb929f15-d5f0-47a7-8763-a03268d52084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:20 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8360d8f0-70f8-4f4c-8785-f8abe3d35d78 tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e7f732e-5a02-4ffe-98f6-6212ee9b37f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:20 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-8360d8f0-70f8-4f4c-8785-f8abe3d35d78 tempest-VolumesSnapshotTestJSON-1537803418 None] Volume b4df677b-2c51-4af8-99b5-1f0ff9644df2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2', 'volume_size': 1} Jun 23 16:42:20 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8360d8f0-70f8-4f4c-8785-f8abe3d35d78 tempest-VolumesSnapshotTestJSON-1537803418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:42:20 devstack sudo[107930]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:20 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-80e06ef2-90c9-4745-a475-19e84e733901 tempest-TestServerVolumeAttachmentScenario-12948084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69e2cdcc-ab99-4639-9be2-f15d69f6358e 1073741824" returned: 0 in 1.502s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:20 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:SELECT=94,cinder:INSERT=36,cinder:UPDATE=136,cinder:DELETE=17 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:42:20 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-80e06ef2-90c9-4745-a475-19e84e733901 tempest-TestServerVolumeAttachmentScenario-12948084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69e2cdcc-ab99-4639-9be2-f15d69f6358e {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:20 devstack sudo[107939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69e2cdcc-ab99-4639-9be2-f15d69f6358e Jun 23 16:42:20 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:21 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-80e06ef2-90c9-4745-a475-19e84e733901 tempest-TestServerVolumeAttachmentScenario-12948084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69e2cdcc-ab99-4639-9be2-f15d69f6358e" returned: 0 in 0.796s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:21 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-80e06ef2-90c9-4745-a475-19e84e733901 tempest-TestServerVolumeAttachmentScenario-12948084 None] <== create_volume: return (2351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:42:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-80e06ef2-90c9-4745-a475-19e84e733901 tempest-TestServerVolumeAttachmentScenario-12948084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.356s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:42:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-c6cdfcea-e71d-4389-abcd-2f431ba803d2 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.484s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:42:21 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-c6cdfcea-e71d-4389-abcd-2f431ba803d2 tempest-CreateVolumesFromSnapshotTest-988849501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-763051638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aadcc51-7ea6-40b7-853d-1f6afcc7a66f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd12cb5ced2e4bd484601308723a341d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:42:14Z,use_quota=True,user_id='86487452b2d148dc9ba8b44e4852b19e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:42:21 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-c6cdfcea-e71d-4389-abcd-2f431ba803d2 tempest-CreateVolumesFromSnapshotTest-988849501 None] Creating volume 6aadcc51-7ea6-40b7-853d-1f6afcc7a66f {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:42:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-c6cdfcea-e71d-4389-abcd-2f431ba803d2 tempest-CreateVolumesFromSnapshotTest-988849501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:42:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-c6cdfcea-e71d-4389-abcd-2f431ba803d2 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:42:21 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-c6cdfcea-e71d-4389-abcd-2f431ba803d2 tempest-CreateVolumesFromSnapshotTest-988849501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:42:21 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-c6cdfcea-e71d-4389-abcd-2f431ba803d2 tempest-CreateVolumesFromSnapshotTest-988849501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:42:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-c6cdfcea-e71d-4389-abcd-2f431ba803d2 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:42:21 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-c6cdfcea-e71d-4389-abcd-2f431ba803d2 tempest-CreateVolumesFromSnapshotTest-988849501 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:42:21 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-c6cdfcea-e71d-4389-abcd-2f431ba803d2 tempest-CreateVolumesFromSnapshotTest-988849501 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:42:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c6cdfcea-e71d-4389-abcd-2f431ba803d2 tempest-CreateVolumesFromSnapshotTest-988849501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6aadcc51-7ea6-40b7-853d-1f6afcc7a66f 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:21 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-80e06ef2-90c9-4745-a475-19e84e733901 tempest-TestServerVolumeAttachmentScenario-12948084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49b28edb-d802-4fbe-afce-22879ce1b778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69e2cdcc-ab99-4639-9be2-f15d69f6358e', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:21 devstack sudo[107942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6aadcc51-7ea6-40b7-853d-1f6afcc7a66f 1073741824 Jun 23 16:42:21 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-80e06ef2-90c9-4745-a475-19e84e733901 tempest-TestServerVolumeAttachmentScenario-12948084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebe7e5b5-457d-4356-a261-49f80a5875a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:21 devstack sudo[107942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:21 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-80e06ef2-90c9-4745-a475-19e84e733901 tempest-TestServerVolumeAttachmentScenario-12948084 None] Volume volume-69e2cdcc-ab99-4639-9be2-f15d69f6358e (69e2cdcc-ab99-4639-9be2-f15d69f6358e): created successfully Jun 23 16:42:21 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-80e06ef2-90c9-4745-a475-19e84e733901 tempest-TestServerVolumeAttachmentScenario-12948084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebe7e5b5-457d-4356-a261-49f80a5875a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:21 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-80e06ef2-90c9-4745-a475-19e84e733901 tempest-TestServerVolumeAttachmentScenario-12948084 None] Flow 'volume_create_manager' (d3729706-eb74-4799-86e9-740976515cba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:42:21 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-80e06ef2-90c9-4745-a475-19e84e733901 tempest-TestServerVolumeAttachmentScenario-12948084 None] Created volume successfully. Jun 23 16:42:22 devstack sudo[107942]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c6cdfcea-e71d-4389-abcd-2f431ba803d2 tempest-CreateVolumesFromSnapshotTest-988849501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6aadcc51-7ea6-40b7-853d-1f6afcc7a66f 1073741824" returned: 0 in 0.933s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c6cdfcea-e71d-4389-abcd-2f431ba803d2 tempest-CreateVolumesFromSnapshotTest-988849501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6aadcc51-7ea6-40b7-853d-1f6afcc7a66f {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:22 devstack sudo[107950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6aadcc51-7ea6-40b7-853d-1f6afcc7a66f Jun 23 16:42:22 devstack sudo[107950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:23 devstack sudo[107950]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c6cdfcea-e71d-4389-abcd-2f431ba803d2 tempest-CreateVolumesFromSnapshotTest-988849501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6aadcc51-7ea6-40b7-853d-1f6afcc7a66f" returned: 0 in 0.707s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:23 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-c6cdfcea-e71d-4389-abcd-2f431ba803d2 tempest-CreateVolumesFromSnapshotTest-988849501 None] <== create_volume: return (1682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:42:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-c6cdfcea-e71d-4389-abcd-2f431ba803d2 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.686s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:42:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e4ff219c-8639-4a04-abe3-b81f44a4d764 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.071s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:42:23 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e4ff219c-8639-4a04-abe3-b81f44a4d764 tempest-CreateVolumesFromSnapshotTest-988849501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-583833940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09d42f0f-c55a-493b-91b9-4cf8e4c73180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd12cb5ced2e4bd484601308723a341d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:42:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:42:14Z,use_quota=True,user_id='86487452b2d148dc9ba8b44e4852b19e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:42:23 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-e4ff219c-8639-4a04-abe3-b81f44a4d764 tempest-CreateVolumesFromSnapshotTest-988849501 None] Creating volume 09d42f0f-c55a-493b-91b9-4cf8e4c73180 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:42:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e4ff219c-8639-4a04-abe3-b81f44a4d764 tempest-CreateVolumesFromSnapshotTest-988849501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:42:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e4ff219c-8639-4a04-abe3-b81f44a4d764 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:42:23 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e4ff219c-8639-4a04-abe3-b81f44a4d764 tempest-CreateVolumesFromSnapshotTest-988849501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:42:23 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e4ff219c-8639-4a04-abe3-b81f44a4d764 tempest-CreateVolumesFromSnapshotTest-988849501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:42:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e4ff219c-8639-4a04-abe3-b81f44a4d764 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:42:23 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e4ff219c-8639-4a04-abe3-b81f44a4d764 tempest-CreateVolumesFromSnapshotTest-988849501 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:42:23 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-e4ff219c-8639-4a04-abe3-b81f44a4d764 tempest-CreateVolumesFromSnapshotTest-988849501 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:42:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e4ff219c-8639-4a04-abe3-b81f44a4d764 tempest-CreateVolumesFromSnapshotTest-988849501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-09d42f0f-c55a-493b-91b9-4cf8e4c73180 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:23 devstack sudo[107953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-09d42f0f-c55a-493b-91b9-4cf8e4c73180 1073741824 Jun 23 16:42:23 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:23 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c6cdfcea-e71d-4389-abcd-2f431ba803d2 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65ee544c-82e7-4d0f-b113-ed7aa06533d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6aadcc51-7ea6-40b7-853d-1f6afcc7a66f', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:23 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c6cdfcea-e71d-4389-abcd-2f431ba803d2 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99e68051-4341-40c4-95cd-1605eb554d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:23 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-c6cdfcea-e71d-4389-abcd-2f431ba803d2 tempest-CreateVolumesFromSnapshotTest-988849501 None] Volume volume-6aadcc51-7ea6-40b7-853d-1f6afcc7a66f (6aadcc51-7ea6-40b7-853d-1f6afcc7a66f): created successfully Jun 23 16:42:23 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c6cdfcea-e71d-4389-abcd-2f431ba803d2 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99e68051-4341-40c4-95cd-1605eb554d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:23 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c6cdfcea-e71d-4389-abcd-2f431ba803d2 tempest-CreateVolumesFromSnapshotTest-988849501 None] Flow 'volume_create_manager' (645ba733-0f19-4031-aa8f-ba2b8ce2b464) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:42:23 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-c6cdfcea-e71d-4389-abcd-2f431ba803d2 tempest-CreateVolumesFromSnapshotTest-988849501 None] Created volume successfully. Jun 23 16:42:24 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e4ff219c-8639-4a04-abe3-b81f44a4d764 tempest-CreateVolumesFromSnapshotTest-988849501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-09d42f0f-c55a-493b-91b9-4cf8e4c73180 1073741824" returned: 0 in 0.930s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e4ff219c-8639-4a04-abe3-b81f44a4d764 tempest-CreateVolumesFromSnapshotTest-988849501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-09d42f0f-c55a-493b-91b9-4cf8e4c73180 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:24 devstack sudo[107959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-09d42f0f-c55a-493b-91b9-4cf8e4c73180 Jun 23 16:42:24 devstack sudo[107959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:24 devstack sudo[107959]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e4ff219c-8639-4a04-abe3-b81f44a4d764 tempest-CreateVolumesFromSnapshotTest-988849501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-09d42f0f-c55a-493b-91b9-4cf8e4c73180" returned: 0 in 0.678s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:24 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e4ff219c-8639-4a04-abe3-b81f44a4d764 tempest-CreateVolumesFromSnapshotTest-988849501 None] <== create_volume: return (1650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:42:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e4ff219c-8639-4a04-abe3-b81f44a4d764 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.653s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:42:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8360d8f0-70f8-4f4c-8785-f8abe3d35d78 tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.684s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:42:24 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-8360d8f0-70f8-4f4c-8785-f8abe3d35d78 tempest-VolumesSnapshotTestJSON-1537803418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1528435945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4df677b-2c51-4af8-99b5-1f0ff9644df2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd0b61ecd544df9a4720fb512a61494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:42:20Z,use_quota=True,user_id='dc863f468a064fdca543394f9e0a10c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:42:24 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-8360d8f0-70f8-4f4c-8785-f8abe3d35d78 tempest-VolumesSnapshotTestJSON-1537803418 None] Creating volume b4df677b-2c51-4af8-99b5-1f0ff9644df2 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:42:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8360d8f0-70f8-4f4c-8785-f8abe3d35d78 tempest-VolumesSnapshotTestJSON-1537803418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:42:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8360d8f0-70f8-4f4c-8785-f8abe3d35d78 tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:42:24 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-8360d8f0-70f8-4f4c-8785-f8abe3d35d78 tempest-VolumesSnapshotTestJSON-1537803418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:42:24 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-8360d8f0-70f8-4f4c-8785-f8abe3d35d78 tempest-VolumesSnapshotTestJSON-1537803418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:42:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8360d8f0-70f8-4f4c-8785-f8abe3d35d78 tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:42:24 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-8360d8f0-70f8-4f4c-8785-f8abe3d35d78 tempest-VolumesSnapshotTestJSON-1537803418 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:42:24 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-8360d8f0-70f8-4f4c-8785-f8abe3d35d78 tempest-VolumesSnapshotTestJSON-1537803418 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:42:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8360d8f0-70f8-4f4c-8785-f8abe3d35d78 tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:24 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e4ff219c-8639-4a04-abe3-b81f44a4d764 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7d939fc-eca7-4bf6-bfa8-3ef091f56dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09d42f0f-c55a-493b-91b9-4cf8e4c73180', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:24 devstack sudo[107962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2 1073741824 Jun 23 16:42:24 devstack sudo[107962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:24 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e4ff219c-8639-4a04-abe3-b81f44a4d764 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73c1e40e-5877-4c4e-beb7-bd25034f96aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:24 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-e4ff219c-8639-4a04-abe3-b81f44a4d764 tempest-CreateVolumesFromSnapshotTest-988849501 None] Volume volume-09d42f0f-c55a-493b-91b9-4cf8e4c73180 (09d42f0f-c55a-493b-91b9-4cf8e4c73180): created successfully Jun 23 16:42:24 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e4ff219c-8639-4a04-abe3-b81f44a4d764 tempest-CreateVolumesFromSnapshotTest-988849501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73c1e40e-5877-4c4e-beb7-bd25034f96aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:24 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e4ff219c-8639-4a04-abe3-b81f44a4d764 tempest-CreateVolumesFromSnapshotTest-988849501 None] Flow 'volume_create_manager' (fec48198-b8d4-454a-8980-f0f55ff999bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:42:24 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-e4ff219c-8639-4a04-abe3-b81f44a4d764 tempest-CreateVolumesFromSnapshotTest-988849501 None] Created volume successfully. Jun 23 16:42:25 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5ff90a14-9e64-44a1-a9c6-aa6c34c92ef8 tempest-CreateVolumesFromSnapshotTest-988849501 None] Acquiring lock "cinder-09d42f0f-c55a-493b-91b9-4cf8e4c73180-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:42:25 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5ff90a14-9e64-44a1-a9c6-aa6c34c92ef8 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "cinder-09d42f0f-c55a-493b-91b9-4cf8e4c73180-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:42:25 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5ff90a14-9e64-44a1-a9c6-aa6c34c92ef8 tempest-CreateVolumesFromSnapshotTest-988849501 None] Acquiring lock "cinder-quobyte-09d42f0f-c55a-493b-91b9-4cf8e4c73180" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:42:25 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5ff90a14-9e64-44a1-a9c6-aa6c34c92ef8 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "cinder-quobyte-09d42f0f-c55a-493b-91b9-4cf8e4c73180" acquired by "delete_volume" :: waited 0.019s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:42:25 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c39686-88fb-40b6-82e6-4373be7ca81d]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:42:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5ff90a14-9e64-44a1-a9c6-aa6c34c92ef8 tempest-CreateVolumesFromSnapshotTest-988849501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-09d42f0f-c55a-493b-91b9-4cf8e4c73180 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:25 devstack sudo[107964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-09d42f0f-c55a-493b-91b9-4cf8e4c73180 Jun 23 16:42:25 devstack sudo[107964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:26 devstack sudo[107962]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8360d8f0-70f8-4f4c-8785-f8abe3d35d78 tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2 1073741824" returned: 0 in 1.586s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8360d8f0-70f8-4f4c-8785-f8abe3d35d78 tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:26 devstack sudo[107972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2 Jun 23 16:42:26 devstack sudo[107972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:26 devstack sudo[107964]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5ff90a14-9e64-44a1-a9c6-aa6c34c92ef8 tempest-CreateVolumesFromSnapshotTest-988849501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-09d42f0f-c55a-493b-91b9-4cf8e4c73180" returned: 0 in 1.334s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5ff90a14-9e64-44a1-a9c6-aa6c34c92ef8 tempest-CreateVolumesFromSnapshotTest-988849501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-09d42f0f-c55a-493b-91b9-4cf8e4c73180 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:26 devstack sudo[107974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-09d42f0f-c55a-493b-91b9-4cf8e4c73180 Jun 23 16:42:26 devstack sudo[107974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:26 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-fe357603-541e-41ea-9458-081ebf06888f tempest-VolumesNegativeTest-1121631231 None] Acquiring lock "cinder-2e8c60b2-8b4e-4be3-a79a-0e71c2b5e86f-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:42:26 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-fe357603-541e-41ea-9458-081ebf06888f tempest-VolumesNegativeTest-1121631231 None] Lock "cinder-2e8c60b2-8b4e-4be3-a79a-0e71c2b5e86f-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:42:26 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-fe357603-541e-41ea-9458-081ebf06888f tempest-VolumesNegativeTest-1121631231 None] Acquiring lock "cinder-quobyte-2e8c60b2-8b4e-4be3-a79a-0e71c2b5e86f" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:42:26 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-fe357603-541e-41ea-9458-081ebf06888f tempest-VolumesNegativeTest-1121631231 None] Lock "cinder-quobyte-2e8c60b2-8b4e-4be3-a79a-0e71c2b5e86f" acquired by "delete_volume" :: waited 0.027s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:42:26 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[10940bbb-d804-4995-b818-8d438ca5145a]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:42:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-fe357603-541e-41ea-9458-081ebf06888f tempest-VolumesNegativeTest-1121631231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2e8c60b2-8b4e-4be3-a79a-0e71c2b5e86f {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:27 devstack sudo[107977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2e8c60b2-8b4e-4be3-a79a-0e71c2b5e86f Jun 23 16:42:27 devstack sudo[107977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:27 devstack sudo[107972]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8360d8f0-70f8-4f4c-8785-f8abe3d35d78 tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2" returned: 0 in 0.925s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:27 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-8360d8f0-70f8-4f4c-8785-f8abe3d35d78 tempest-VolumesSnapshotTestJSON-1537803418 None] <== create_volume: return (2583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:42:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8360d8f0-70f8-4f4c-8785-f8abe3d35d78 tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.588s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:42:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8360d8f0-70f8-4f4c-8785-f8abe3d35d78 tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e7f732e-5a02-4ffe-98f6-6212ee9b37f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8360d8f0-70f8-4f4c-8785-f8abe3d35d78 tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7deda09c-d877-42d8-8594-b942e5e6bb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:27 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-8360d8f0-70f8-4f4c-8785-f8abe3d35d78 tempest-VolumesSnapshotTestJSON-1537803418 None] Volume volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2 (b4df677b-2c51-4af8-99b5-1f0ff9644df2): created successfully Jun 23 16:42:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8360d8f0-70f8-4f4c-8785-f8abe3d35d78 tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7deda09c-d877-42d8-8594-b942e5e6bb94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8360d8f0-70f8-4f4c-8785-f8abe3d35d78 tempest-VolumesSnapshotTestJSON-1537803418 None] Flow 'volume_create_manager' (08380d49-e388-4bec-b004-e07f1b0e299b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:42:27 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-8360d8f0-70f8-4f4c-8785-f8abe3d35d78 tempest-VolumesSnapshotTestJSON-1537803418 None] Created volume successfully. Jun 23 16:42:27 devstack sudo[107974]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5ff90a14-9e64-44a1-a9c6-aa6c34c92ef8 tempest-CreateVolumesFromSnapshotTest-988849501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-09d42f0f-c55a-493b-91b9-4cf8e4c73180" returned: 0 in 1.079s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:27 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5ff90a14-9e64-44a1-a9c6-aa6c34c92ef8 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "cinder-quobyte-09d42f0f-c55a-493b-91b9-4cf8e4c73180" released by "delete_volume" :: held 2.522s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:42:27 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-5ff90a14-9e64-44a1-a9c6-aa6c34c92ef8 tempest-CreateVolumesFromSnapshotTest-988849501 None] Created reservations ['b19d404e-0326-4c74-b02d-fe7477047e8b', 'bdc33cf2-1aa2-4563-a37b-92c2ab489eaa', '32da0898-bcdd-40e5-a0a1-00e56f42af26', '74f3df19-f079-4496-acd5-cb823a4d5a30'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:42:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5ff90a14-9e64-44a1-a9c6-aa6c34c92ef8 tempest-CreateVolumesFromSnapshotTest-988849501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:42:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5ff90a14-9e64-44a1-a9c6-aa6c34c92ef8 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:42:27 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-5ff90a14-9e64-44a1-a9c6-aa6c34c92ef8 tempest-CreateVolumesFromSnapshotTest-988849501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:42:27 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-5ff90a14-9e64-44a1-a9c6-aa6c34c92ef8 tempest-CreateVolumesFromSnapshotTest-988849501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:42:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5ff90a14-9e64-44a1-a9c6-aa6c34c92ef8 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:42:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5ff90a14-9e64-44a1-a9c6-aa6c34c92ef8 tempest-CreateVolumesFromSnapshotTest-988849501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:27 devstack sudo[108001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:42:27 devstack sudo[108001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:28 devstack sudo[107977]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-fe357603-541e-41ea-9458-081ebf06888f tempest-VolumesNegativeTest-1121631231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2e8c60b2-8b4e-4be3-a79a-0e71c2b5e86f" returned: 0 in 1.044s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-fe357603-541e-41ea-9458-081ebf06888f tempest-VolumesNegativeTest-1121631231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2e8c60b2-8b4e-4be3-a79a-0e71c2b5e86f {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:28 devstack sudo[108003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2e8c60b2-8b4e-4be3-a79a-0e71c2b5e86f Jun 23 16:42:28 devstack sudo[108003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:28 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-729cc3a2-4898-48f0-b139-a718e4f55284 tempest-CreateVolumesFromSnapshotTest-988849501 None] Acquiring lock "cinder-6aadcc51-7ea6-40b7-853d-1f6afcc7a66f-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:42:28 devstack sudo[108001]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5ff90a14-9e64-44a1-a9c6-aa6c34c92ef8 tempest-CreateVolumesFromSnapshotTest-988849501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.794s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:28 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-5ff90a14-9e64-44a1-a9c6-aa6c34c92ef8 tempest-CreateVolumesFromSnapshotTest-988849501 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:42:28 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-729cc3a2-4898-48f0-b139-a718e4f55284 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "cinder-6aadcc51-7ea6-40b7-853d-1f6afcc7a66f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:42:28 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-5ff90a14-9e64-44a1-a9c6-aa6c34c92ef8 tempest-CreateVolumesFromSnapshotTest-988849501 None] Deleted volume successfully. Jun 23 16:42:28 devstack sudo[108003]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-fe357603-541e-41ea-9458-081ebf06888f tempest-VolumesNegativeTest-1121631231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2e8c60b2-8b4e-4be3-a79a-0e71c2b5e86f" returned: 0 in 0.731s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:28 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-fe357603-541e-41ea-9458-081ebf06888f tempest-VolumesNegativeTest-1121631231 None] Lock "cinder-quobyte-2e8c60b2-8b4e-4be3-a79a-0e71c2b5e86f" released by "delete_volume" :: held 1.840s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:42:28 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-729cc3a2-4898-48f0-b139-a718e4f55284 tempest-CreateVolumesFromSnapshotTest-988849501 None] Acquiring lock "cinder-quobyte-6aadcc51-7ea6-40b7-853d-1f6afcc7a66f" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:42:28 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5ff90a14-9e64-44a1-a9c6-aa6c34c92ef8 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "cinder-09d42f0f-c55a-493b-91b9-4cf8e4c73180-delete_volume" released by "delete_volume" :: held 3.718s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:42:28 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-729cc3a2-4898-48f0-b139-a718e4f55284 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "cinder-quobyte-6aadcc51-7ea6-40b7-853d-1f6afcc7a66f" acquired by "delete_volume" :: waited 0.031s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:42:28 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb80b4d-08d7-41ac-b665-95eea17bc22d]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:42:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-729cc3a2-4898-48f0-b139-a718e4f55284 tempest-CreateVolumesFromSnapshotTest-988849501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6aadcc51-7ea6-40b7-853d-1f6afcc7a66f {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:28 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-fe357603-541e-41ea-9458-081ebf06888f tempest-VolumesNegativeTest-1121631231 None] Created reservations ['1a73e461-7095-4fb4-8b0e-fb6917634c6f', 'b3e989a7-6914-4802-a6d0-df30298ac7cc', '298de94d-2739-4e7e-88db-33e829768cd3', '8d11ad56-bdf1-40c8-98f5-e2b22b2bc0d9'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:42:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-4ad92e84-16ea-4491-8d14-c13d59a44626 tempest-VolumesSnapshotTestJSON-1537803418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:42:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-4ad92e84-16ea-4491-8d14-c13d59a44626 tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:42:29 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-4ad92e84-16ea-4491-8d14-c13d59a44626 tempest-VolumesSnapshotTestJSON-1537803418 None] Creating offline snapshot 11b867fc-c9c1-4a70-ac44-3eb205bf77ee of volume b4df677b-2c51-4af8-99b5-1f0ff9644df2 {{(pid=93788) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:42:29 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e4570f-5457-48a1-9ed9-cc073ff0e153]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:42:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4ad92e84-16ea-4491-8d14-c13d59a44626 tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:29 devstack sudo[108009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6aadcc51-7ea6-40b7-853d-1f6afcc7a66f Jun 23 16:42:29 devstack sudo[108009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-fe357603-541e-41ea-9458-081ebf06888f tempest-VolumesNegativeTest-1121631231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:42:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-fe357603-541e-41ea-9458-081ebf06888f tempest-VolumesNegativeTest-1121631231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:42:29 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-fe357603-541e-41ea-9458-081ebf06888f tempest-VolumesNegativeTest-1121631231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:42:29 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-fe357603-541e-41ea-9458-081ebf06888f tempest-VolumesNegativeTest-1121631231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:42:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-fe357603-541e-41ea-9458-081ebf06888f tempest-VolumesNegativeTest-1121631231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:42:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-fe357603-541e-41ea-9458-081ebf06888f tempest-VolumesNegativeTest-1121631231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:29 devstack sudo[108012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:42:29 devstack sudo[108012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:29 devstack sudo[108011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2 Jun 23 16:42:29 devstack sudo[108011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:30 devstack sudo[108012]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-fe357603-541e-41ea-9458-081ebf06888f tempest-VolumesNegativeTest-1121631231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.860s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:30 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-fe357603-541e-41ea-9458-081ebf06888f tempest-VolumesNegativeTest-1121631231 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:42:30 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-fe357603-541e-41ea-9458-081ebf06888f tempest-VolumesNegativeTest-1121631231 None] Deleted volume successfully. Jun 23 16:42:30 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-fe357603-541e-41ea-9458-081ebf06888f tempest-VolumesNegativeTest-1121631231 None] Lock "cinder-2e8c60b2-8b4e-4be3-a79a-0e71c2b5e86f-delete_volume" released by "delete_volume" :: held 3.186s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:42:30 devstack sudo[108009]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-729cc3a2-4898-48f0-b139-a718e4f55284 tempest-CreateVolumesFromSnapshotTest-988849501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6aadcc51-7ea6-40b7-853d-1f6afcc7a66f" returned: 0 in 1.196s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-729cc3a2-4898-48f0-b139-a718e4f55284 tempest-CreateVolumesFromSnapshotTest-988849501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6aadcc51-7ea6-40b7-853d-1f6afcc7a66f {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:30 devstack sudo[108011]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4ad92e84-16ea-4491-8d14-c13d59a44626 tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2" returned: 0 in 1.027s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4ad92e84-16ea-4491-8d14-c13d59a44626 tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2.11b867fc-c9c1-4a70-ac44-3eb205bf77ee 1G {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:30 devstack sudo[108024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6aadcc51-7ea6-40b7-853d-1f6afcc7a66f Jun 23 16:42:30 devstack sudo[108024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:30 devstack sudo[108026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2.11b867fc-c9c1-4a70-ac44-3eb205bf77ee 1G Jun 23 16:42:30 devstack sudo[108026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:31 devstack sudo[108024]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:31 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-729cc3a2-4898-48f0-b139-a718e4f55284 tempest-CreateVolumesFromSnapshotTest-988849501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6aadcc51-7ea6-40b7-853d-1f6afcc7a66f" returned: 0 in 0.919s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:31 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-729cc3a2-4898-48f0-b139-a718e4f55284 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "cinder-quobyte-6aadcc51-7ea6-40b7-853d-1f6afcc7a66f" released by "delete_volume" :: held 2.181s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:42:31 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-729cc3a2-4898-48f0-b139-a718e4f55284 tempest-CreateVolumesFromSnapshotTest-988849501 None] Created reservations ['02da3806-c730-4846-8a53-1c1c99b99ae0', '9a5ea060-3e30-4f66-9abd-6b78e1858219', '60b1b59a-f8c5-4660-a145-91bda724722f', '08c0e1d7-293a-4647-8eb4-29d14445f763'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:42:31 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-729cc3a2-4898-48f0-b139-a718e4f55284 tempest-CreateVolumesFromSnapshotTest-988849501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:42:31 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-729cc3a2-4898-48f0-b139-a718e4f55284 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:42:31 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-729cc3a2-4898-48f0-b139-a718e4f55284 tempest-CreateVolumesFromSnapshotTest-988849501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:42:31 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-729cc3a2-4898-48f0-b139-a718e4f55284 tempest-CreateVolumesFromSnapshotTest-988849501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:42:31 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-729cc3a2-4898-48f0-b139-a718e4f55284 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:42:31 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-729cc3a2-4898-48f0-b139-a718e4f55284 tempest-CreateVolumesFromSnapshotTest-988849501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:31 devstack sudo[108033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:42:31 devstack sudo[108033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:31 devstack sudo[108026]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:31 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4ad92e84-16ea-4491-8d14-c13d59a44626 tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2.11b867fc-c9c1-4a70-ac44-3eb205bf77ee 1G" returned: 0 in 1.122s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:31 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4ad92e84-16ea-4491-8d14-c13d59a44626 tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2.11b867fc-c9c1-4a70-ac44-3eb205bf77ee {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:31 devstack sudo[108035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2.11b867fc-c9c1-4a70-ac44-3eb205bf77ee Jun 23 16:42:31 devstack sudo[108035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:32 devstack sudo[108033]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-729cc3a2-4898-48f0-b139-a718e4f55284 tempest-CreateVolumesFromSnapshotTest-988849501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.848s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:32 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-729cc3a2-4898-48f0-b139-a718e4f55284 tempest-CreateVolumesFromSnapshotTest-988849501 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:42:32 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-729cc3a2-4898-48f0-b139-a718e4f55284 tempest-CreateVolumesFromSnapshotTest-988849501 None] Deleted volume successfully. Jun 23 16:42:32 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-729cc3a2-4898-48f0-b139-a718e4f55284 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "cinder-6aadcc51-7ea6-40b7-853d-1f6afcc7a66f-delete_volume" released by "delete_volume" :: held 3.371s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:42:32 devstack sudo[108035]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4ad92e84-16ea-4491-8d14-c13d59a44626 tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2.11b867fc-c9c1-4a70-ac44-3eb205bf77ee" returned: 0 in 0.867s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:32 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-4ad92e84-16ea-4491-8d14-c13d59a44626 tempest-VolumesSnapshotTestJSON-1537803418 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2.11b867fc-c9c1-4a70-ac44-3eb205bf77ee is being set with open permissions: ugo+rw Jun 23 16:42:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4ad92e84-16ea-4491-8d14-c13d59a44626 tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2.11b867fc-c9c1-4a70-ac44-3eb205bf77ee {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:32 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d59bbee6-4778-4238-bd27-c38e9076d956 tempest-CreateVolumesFromSnapshotTest-988849501 None] Acquiring lock "cinder-d54ede86-f1f7-4ba1-ae0d-78fb90d102bb-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:42:32 devstack sudo[108044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2.11b867fc-c9c1-4a70-ac44-3eb205bf77ee Jun 23 16:42:32 devstack sudo[108044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:32 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d59bbee6-4778-4238-bd27-c38e9076d956 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "cinder-d54ede86-f1f7-4ba1-ae0d-78fb90d102bb-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:42:32 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d59bbee6-4778-4238-bd27-c38e9076d956 tempest-CreateVolumesFromSnapshotTest-988849501 None] Acquiring lock "cinder-quobyte-d54ede86-f1f7-4ba1-ae0d-78fb90d102bb" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:42:32 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d59bbee6-4778-4238-bd27-c38e9076d956 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "cinder-quobyte-d54ede86-f1f7-4ba1-ae0d-78fb90d102bb" acquired by "delete_volume" :: waited 0.021s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:42:32 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e52c84-2125-4177-8f7e-6a3e93a13519]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:42:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d59bbee6-4778-4238-bd27-c38e9076d956 tempest-CreateVolumesFromSnapshotTest-988849501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d54ede86-f1f7-4ba1-ae0d-78fb90d102bb {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:32 devstack sudo[108046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d54ede86-f1f7-4ba1-ae0d-78fb90d102bb Jun 23 16:42:32 devstack sudo[108046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:32 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb87c586-3cce-4a60-8fa2-e3f264063367 tempest-VolumesSnapshotListTestJSON-1859349725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:42:32 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-cb87c586-3cce-4a60-8fa2-e3f264063367 tempest-VolumesSnapshotListTestJSON-1859349725 None] Flow 'volume_create_manager' (7ec9db2c-5e00-4cf2-a616-f8ef1034ad85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:42:32 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-cb87c586-3cce-4a60-8fa2-e3f264063367 tempest-VolumesSnapshotListTestJSON-1859349725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad8e9809-59e8-4bfe-b572-f3d38b81bb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:32 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-cb87c586-3cce-4a60-8fa2-e3f264063367 tempest-VolumesSnapshotListTestJSON-1859349725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad8e9809-59e8-4bfe-b572-f3d38b81bb09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1492313741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0775578-9730-4128-a566-9dc7226fc2fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ca529a59f95474eb5698d32d90132ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:42:33Z,use_quota=True,user_id='6bcef50314a94541959236d54f0db20f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:32 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-cb87c586-3cce-4a60-8fa2-e3f264063367 tempest-VolumesSnapshotListTestJSON-1859349725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a241906-b20a-4afe-b560-15972316cd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:32 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-cb87c586-3cce-4a60-8fa2-e3f264063367 tempest-VolumesSnapshotListTestJSON-1859349725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a241906-b20a-4afe-b560-15972316cd54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:32 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-cb87c586-3cce-4a60-8fa2-e3f264063367 tempest-VolumesSnapshotListTestJSON-1859349725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b96f762-413d-4a59-80a2-3fa867759c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:32 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-cb87c586-3cce-4a60-8fa2-e3f264063367 tempest-VolumesSnapshotListTestJSON-1859349725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b96f762-413d-4a59-80a2-3fa867759c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0775578-9730-4128-a566-9dc7226fc2fa', 'volume_name': 'volume-e0775578-9730-4128-a566-9dc7226fc2fa', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:32 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-cb87c586-3cce-4a60-8fa2-e3f264063367 tempest-VolumesSnapshotListTestJSON-1859349725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba370545-1da4-45a3-92e3-2510ccce3872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:32 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-cb87c586-3cce-4a60-8fa2-e3f264063367 tempest-VolumesSnapshotListTestJSON-1859349725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba370545-1da4-45a3-92e3-2510ccce3872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:32 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-cb87c586-3cce-4a60-8fa2-e3f264063367 tempest-VolumesSnapshotListTestJSON-1859349725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a29ebc1c-1978-412e-9db7-5a96c9eadca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:32 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-cb87c586-3cce-4a60-8fa2-e3f264063367 tempest-VolumesSnapshotListTestJSON-1859349725 None] Volume e0775578-9730-4128-a566-9dc7226fc2fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0775578-9730-4128-a566-9dc7226fc2fa', 'volume_size': 1} Jun 23 16:42:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-cb87c586-3cce-4a60-8fa2-e3f264063367 tempest-VolumesSnapshotListTestJSON-1859349725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:42:32 devstack sudo[108044]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4ad92e84-16ea-4491-8d14-c13d59a44626 tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2.11b867fc-c9c1-4a70-ac44-3eb205bf77ee" returned: 0 in 0.735s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4ad92e84-16ea-4491-8d14-c13d59a44626 tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:32 devstack sudo[108049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2.info Jun 23 16:42:32 devstack sudo[108049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:33 devstack sudo[108046]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:33 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d59bbee6-4778-4238-bd27-c38e9076d956 tempest-CreateVolumesFromSnapshotTest-988849501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d54ede86-f1f7-4ba1-ae0d-78fb90d102bb" returned: 0 in 0.877s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:33 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d59bbee6-4778-4238-bd27-c38e9076d956 tempest-CreateVolumesFromSnapshotTest-988849501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d54ede86-f1f7-4ba1-ae0d-78fb90d102bb {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:33 devstack sudo[108054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d54ede86-f1f7-4ba1-ae0d-78fb90d102bb Jun 23 16:42:33 devstack sudo[108054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:33 devstack sudo[108049]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:33 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4ad92e84-16ea-4491-8d14-c13d59a44626 tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2.info" returned: 0 in 0.732s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:33 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-4ad92e84-16ea-4491-8d14-c13d59a44626 tempest-VolumesSnapshotTestJSON-1537803418 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2.info is being set with open permissions: ugo+rw Jun 23 16:42:33 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4ad92e84-16ea-4491-8d14-c13d59a44626 tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:33 devstack sudo[108061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2.info Jun 23 16:42:33 devstack sudo[108061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:33 devstack sudo[108054]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:33 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d59bbee6-4778-4238-bd27-c38e9076d956 tempest-CreateVolumesFromSnapshotTest-988849501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-d54ede86-f1f7-4ba1-ae0d-78fb90d102bb" returned: 0 in 0.792s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:33 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d59bbee6-4778-4238-bd27-c38e9076d956 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "cinder-quobyte-d54ede86-f1f7-4ba1-ae0d-78fb90d102bb" released by "delete_volume" :: held 1.731s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:42:34 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-d59bbee6-4778-4238-bd27-c38e9076d956 tempest-CreateVolumesFromSnapshotTest-988849501 None] Created reservations ['e72a7b2d-2ff1-4acd-b496-99bbbe8649bf', '3ca3325a-1d97-4421-b79a-ffda1e7b8417', '63d89142-3bfd-424f-b733-0be92393c1ca', '31462845-fc0b-4749-88ed-5991845f28e3'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:42:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d59bbee6-4778-4238-bd27-c38e9076d956 tempest-CreateVolumesFromSnapshotTest-988849501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:42:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d59bbee6-4778-4238-bd27-c38e9076d956 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:42:34 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-d59bbee6-4778-4238-bd27-c38e9076d956 tempest-CreateVolumesFromSnapshotTest-988849501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:42:34 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-d59bbee6-4778-4238-bd27-c38e9076d956 tempest-CreateVolumesFromSnapshotTest-988849501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:42:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d59bbee6-4778-4238-bd27-c38e9076d956 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:42:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d59bbee6-4778-4238-bd27-c38e9076d956 tempest-CreateVolumesFromSnapshotTest-988849501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:34 devstack sudo[108089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:42:34 devstack sudo[108089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:34 devstack sudo[108061]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4ad92e84-16ea-4491-8d14-c13d59a44626 tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2.info" returned: 0 in 0.898s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-4ad92e84-16ea-4491-8d14-c13d59a44626 tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.549s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:42:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-cb87c586-3cce-4a60-8fa2-e3f264063367 tempest-VolumesSnapshotListTestJSON-1859349725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.851s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:42:34 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-cb87c586-3cce-4a60-8fa2-e3f264063367 tempest-VolumesSnapshotListTestJSON-1859349725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1492313741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0775578-9730-4128-a566-9dc7226fc2fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ca529a59f95474eb5698d32d90132ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:42:33Z,use_quota=True,user_id='6bcef50314a94541959236d54f0db20f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:42:34 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-cb87c586-3cce-4a60-8fa2-e3f264063367 tempest-VolumesSnapshotListTestJSON-1859349725 None] Creating volume e0775578-9730-4128-a566-9dc7226fc2fa {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:42:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-cb87c586-3cce-4a60-8fa2-e3f264063367 tempest-VolumesSnapshotListTestJSON-1859349725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:42:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-cb87c586-3cce-4a60-8fa2-e3f264063367 tempest-VolumesSnapshotListTestJSON-1859349725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:42:34 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-cb87c586-3cce-4a60-8fa2-e3f264063367 tempest-VolumesSnapshotListTestJSON-1859349725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:42:34 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-cb87c586-3cce-4a60-8fa2-e3f264063367 tempest-VolumesSnapshotListTestJSON-1859349725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:42:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-cb87c586-3cce-4a60-8fa2-e3f264063367 tempest-VolumesSnapshotListTestJSON-1859349725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:42:34 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-cb87c586-3cce-4a60-8fa2-e3f264063367 tempest-VolumesSnapshotListTestJSON-1859349725 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:42:34 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-cb87c586-3cce-4a60-8fa2-e3f264063367 tempest-VolumesSnapshotListTestJSON-1859349725 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:42:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-cb87c586-3cce-4a60-8fa2-e3f264063367 tempest-VolumesSnapshotListTestJSON-1859349725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:34 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b71d91cd-d76a-401d-805e-8310ee5593f4 tempest-CreateVolumesFromSnapshotTest-988849501 None] Acquiring lock "cinder-2b8f847e-9a7f-4c70-91f2-2c1c714f489c-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:42:34 devstack sudo[108124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa 1073741824 Jun 23 16:42:34 devstack sudo[108124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:34 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b71d91cd-d76a-401d-805e-8310ee5593f4 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "cinder-2b8f847e-9a7f-4c70-91f2-2c1c714f489c-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:42:34 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b71d91cd-d76a-401d-805e-8310ee5593f4 tempest-CreateVolumesFromSnapshotTest-988849501 None] Acquiring lock "cinder-quobyte-2b8f847e-9a7f-4c70-91f2-2c1c714f489c" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:42:34 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-4ad92e84-16ea-4491-8d14-c13d59a44626 tempest-VolumesSnapshotTestJSON-1537803418 None] Create snapshot completed successfully Jun 23 16:42:34 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b71d91cd-d76a-401d-805e-8310ee5593f4 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "cinder-quobyte-2b8f847e-9a7f-4c70-91f2-2c1c714f489c" acquired by "delete_volume" :: waited 0.045s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:42:35 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e85b3f8-11f5-44c5-9fd6-ec25abaf950d]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:42:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b71d91cd-d76a-401d-805e-8310ee5593f4 tempest-CreateVolumesFromSnapshotTest-988849501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2b8f847e-9a7f-4c70-91f2-2c1c714f489c {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:35 devstack sudo[108133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2b8f847e-9a7f-4c70-91f2-2c1c714f489c Jun 23 16:42:35 devstack sudo[108133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:35 devstack sudo[108089]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d59bbee6-4778-4238-bd27-c38e9076d956 tempest-CreateVolumesFromSnapshotTest-988849501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.566s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:35 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-d59bbee6-4778-4238-bd27-c38e9076d956 tempest-CreateVolumesFromSnapshotTest-988849501 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:42:35 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-d59bbee6-4778-4238-bd27-c38e9076d956 tempest-CreateVolumesFromSnapshotTest-988849501 None] Deleted volume successfully. Jun 23 16:42:35 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d59bbee6-4778-4238-bd27-c38e9076d956 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "cinder-d54ede86-f1f7-4ba1-ae0d-78fb90d102bb-delete_volume" released by "delete_volume" :: held 3.587s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:42:35 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-93a37d5c-9522-4f38-9eb2-78eb101203d8 tempest-VolumesSnapshotTestJSON-1537803418 None] Acquiring lock "cinder-11b867fc-c9c1-4a70-ac44-3eb205bf77ee-delete_snapshot" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:42:36 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-93a37d5c-9522-4f38-9eb2-78eb101203d8 tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "cinder-11b867fc-c9c1-4a70-ac44-3eb205bf77ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:42:36 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-93a37d5c-9522-4f38-9eb2-78eb101203d8 tempest-VolumesSnapshotTestJSON-1537803418 None] Acquiring lock "cinder-quobyte-b4df677b-2c51-4af8-99b5-1f0ff9644df2" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:42:36 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-93a37d5c-9522-4f38-9eb2-78eb101203d8 tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "cinder-quobyte-b4df677b-2c51-4af8-99b5-1f0ff9644df2" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:42:36 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-93a37d5c-9522-4f38-9eb2-78eb101203d8 tempest-VolumesSnapshotTestJSON-1537803418 None] Acquiring lock "cinder-quobyte-11b867fc-c9c1-4a70-ac44-3eb205bf77ee" by "_delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:42:36 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-93a37d5c-9522-4f38-9eb2-78eb101203d8 tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "cinder-quobyte-11b867fc-c9c1-4a70-ac44-3eb205bf77ee" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:42:36 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-93a37d5c-9522-4f38-9eb2-78eb101203d8 tempest-VolumesSnapshotTestJSON-1537803418 None] Deleting offline snapshot 11b867fc-c9c1-4a70-ac44-3eb205bf77ee of volume b4df677b-2c51-4af8-99b5-1f0ff9644df2 {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:42:36 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-93a37d5c-9522-4f38-9eb2-78eb101203d8 tempest-VolumesSnapshotTestJSON-1537803418 None] snapshot_file for this snap is: volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2.11b867fc-c9c1-4a70-ac44-3eb205bf77ee {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:42:36 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fb6d71-1a54-4652-b47f-65d80bebcdc7]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:42:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-93a37d5c-9522-4f38-9eb2-78eb101203d8 tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2.11b867fc-c9c1-4a70-ac44-3eb205bf77ee {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:36 devstack sudo[108188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2.11b867fc-c9c1-4a70-ac44-3eb205bf77ee Jun 23 16:42:36 devstack sudo[108188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:36 devstack sudo[108133]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b71d91cd-d76a-401d-805e-8310ee5593f4 tempest-CreateVolumesFromSnapshotTest-988849501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2b8f847e-9a7f-4c70-91f2-2c1c714f489c" returned: 0 in 1.535s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b71d91cd-d76a-401d-805e-8310ee5593f4 tempest-CreateVolumesFromSnapshotTest-988849501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2b8f847e-9a7f-4c70-91f2-2c1c714f489c {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:36 devstack sudo[108195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2b8f847e-9a7f-4c70-91f2-2c1c714f489c Jun 23 16:42:36 devstack sudo[108195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:36 devstack sudo[108124]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-cb87c586-3cce-4a60-8fa2-e3f264063367 tempest-VolumesSnapshotListTestJSON-1859349725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa 1073741824" returned: 0 in 2.124s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-cb87c586-3cce-4a60-8fa2-e3f264063367 tempest-VolumesSnapshotListTestJSON-1859349725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:36 devstack sudo[108197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa Jun 23 16:42:36 devstack sudo[108197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:37 devstack sudo[108188]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-93a37d5c-9522-4f38-9eb2-78eb101203d8 tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2.11b867fc-c9c1-4a70-ac44-3eb205bf77ee" returned: 0 in 1.330s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:37 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-93a37d5c-9522-4f38-9eb2-78eb101203d8 tempest-VolumesSnapshotTestJSON-1537803418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:42:37 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e067cc51-df93-4e72-922a-c32dadf43358]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:42:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-93a37d5c-9522-4f38-9eb2-78eb101203d8 tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:37 devstack sudo[108195]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b71d91cd-d76a-401d-805e-8310ee5593f4 tempest-CreateVolumesFromSnapshotTest-988849501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2b8f847e-9a7f-4c70-91f2-2c1c714f489c" returned: 0 in 1.135s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:37 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b71d91cd-d76a-401d-805e-8310ee5593f4 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "cinder-quobyte-2b8f847e-9a7f-4c70-91f2-2c1c714f489c" released by "delete_volume" :: held 2.752s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:42:37 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-b71d91cd-d76a-401d-805e-8310ee5593f4 tempest-CreateVolumesFromSnapshotTest-988849501 None] Created reservations ['211f2265-3ac6-4fb8-a714-893dbe46c0bf', '257c59e4-187f-46cd-83d1-4e7ed005a0de', 'b713a6e1-4e9a-4c22-b922-59738ffd41ed', '5f900217-3b9c-4d01-a4c9-472838977295'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:42:37 devstack sudo[108203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2 Jun 23 16:42:37 devstack sudo[108203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b71d91cd-d76a-401d-805e-8310ee5593f4 tempest-CreateVolumesFromSnapshotTest-988849501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:42:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b71d91cd-d76a-401d-805e-8310ee5593f4 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:42:37 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b71d91cd-d76a-401d-805e-8310ee5593f4 tempest-CreateVolumesFromSnapshotTest-988849501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:42:37 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b71d91cd-d76a-401d-805e-8310ee5593f4 tempest-CreateVolumesFromSnapshotTest-988849501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:42:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b71d91cd-d76a-401d-805e-8310ee5593f4 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:42:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b71d91cd-d76a-401d-805e-8310ee5593f4 tempest-CreateVolumesFromSnapshotTest-988849501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:37 devstack sudo[108197]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-cb87c586-3cce-4a60-8fa2-e3f264063367 tempest-VolumesSnapshotListTestJSON-1859349725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa" returned: 0 in 1.121s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:37 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-cb87c586-3cce-4a60-8fa2-e3f264063367 tempest-VolumesSnapshotListTestJSON-1859349725 None] <== create_volume: return (3358ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:42:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-cb87c586-3cce-4a60-8fa2-e3f264063367 tempest-VolumesSnapshotListTestJSON-1859349725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.363s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:42:37 devstack sudo[108206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:42:37 devstack sudo[108206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:37 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-cb87c586-3cce-4a60-8fa2-e3f264063367 tempest-VolumesSnapshotListTestJSON-1859349725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a29ebc1c-1978-412e-9db7-5a96c9eadca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0775578-9730-4128-a566-9dc7226fc2fa', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:37 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-cb87c586-3cce-4a60-8fa2-e3f264063367 tempest-VolumesSnapshotListTestJSON-1859349725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5dc629e-487b-4489-aa10-e3e78dd4d544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:38 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-cb87c586-3cce-4a60-8fa2-e3f264063367 tempest-VolumesSnapshotListTestJSON-1859349725 None] Volume volume-e0775578-9730-4128-a566-9dc7226fc2fa (e0775578-9730-4128-a566-9dc7226fc2fa): created successfully Jun 23 16:42:38 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-cb87c586-3cce-4a60-8fa2-e3f264063367 tempest-VolumesSnapshotListTestJSON-1859349725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5dc629e-487b-4489-aa10-e3e78dd4d544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:38 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-cb87c586-3cce-4a60-8fa2-e3f264063367 tempest-VolumesSnapshotListTestJSON-1859349725 None] Flow 'volume_create_manager' (7ec9db2c-5e00-4cf2-a616-f8ef1034ad85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:42:38 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-cb87c586-3cce-4a60-8fa2-e3f264063367 tempest-VolumesSnapshotListTestJSON-1859349725 None] Created volume successfully. Jun 23 16:42:38 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-67f57039-6de3-44ff-a631-5e9eb22cc0a0 tempest-CreateVolumesFromSnapshotTest-988849501 None] Acquiring lock "cinder-75b26984-c608-43b8-8222-7f510583cdad-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:42:38 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-67f57039-6de3-44ff-a631-5e9eb22cc0a0 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "cinder-75b26984-c608-43b8-8222-7f510583cdad-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:42:38 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-67f57039-6de3-44ff-a631-5e9eb22cc0a0 tempest-CreateVolumesFromSnapshotTest-988849501 None] Acquiring lock "cinder-quobyte-75b26984-c608-43b8-8222-7f510583cdad" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:42:38 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-67f57039-6de3-44ff-a631-5e9eb22cc0a0 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "cinder-quobyte-75b26984-c608-43b8-8222-7f510583cdad" acquired by "delete_volume" :: waited 0.043s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:42:38 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb7de0e-6a00-459f-9253-e3a04061576c]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:42:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-67f57039-6de3-44ff-a631-5e9eb22cc0a0 tempest-CreateVolumesFromSnapshotTest-988849501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-75b26984-c608-43b8-8222-7f510583cdad {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-4ee59cb4-fe18-4ab9-a72b-1ff35191d799 tempest-VolumesSnapshotListTestJSON-1859349725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:42:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-4ee59cb4-fe18-4ab9-a72b-1ff35191d799 tempest-VolumesSnapshotListTestJSON-1859349725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:42:38 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-4ee59cb4-fe18-4ab9-a72b-1ff35191d799 tempest-VolumesSnapshotListTestJSON-1859349725 None] Creating offline snapshot 6898da04-f841-4f9a-86e6-71e6fd2f39b8 of volume e0775578-9730-4128-a566-9dc7226fc2fa {{(pid=93788) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:42:38 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a3b127-0619-42e0-907e-1d4356afac71]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:42:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4ee59cb4-fe18-4ab9-a72b-1ff35191d799 tempest-VolumesSnapshotListTestJSON-1859349725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:39 devstack sudo[108208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-75b26984-c608-43b8-8222-7f510583cdad Jun 23 16:42:39 devstack sudo[108208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:39 devstack sudo[108206]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b71d91cd-d76a-401d-805e-8310ee5593f4 tempest-CreateVolumesFromSnapshotTest-988849501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.123s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:39 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-b71d91cd-d76a-401d-805e-8310ee5593f4 tempest-CreateVolumesFromSnapshotTest-988849501 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:42:39 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-b71d91cd-d76a-401d-805e-8310ee5593f4 tempest-CreateVolumesFromSnapshotTest-988849501 None] Deleted volume successfully. Jun 23 16:42:39 devstack sudo[108213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa Jun 23 16:42:39 devstack sudo[108213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:39 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b71d91cd-d76a-401d-805e-8310ee5593f4 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "cinder-2b8f847e-9a7f-4c70-91f2-2c1c714f489c-delete_volume" released by "delete_volume" :: held 4.330s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:42:39 devstack sudo[108203]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-93a37d5c-9522-4f38-9eb2-78eb101203d8 tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2" returned: 0 in 1.601s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-93a37d5c-9522-4f38-9eb2-78eb101203d8 tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2.11b867fc-c9c1-4a70-ac44-3eb205bf77ee {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:39 devstack sudo[108217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2.11b867fc-c9c1-4a70-ac44-3eb205bf77ee Jun 23 16:42:39 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:39 devstack sudo[108208]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-67f57039-6de3-44ff-a631-5e9eb22cc0a0 tempest-CreateVolumesFromSnapshotTest-988849501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-75b26984-c608-43b8-8222-7f510583cdad" returned: 0 in 1.259s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-67f57039-6de3-44ff-a631-5e9eb22cc0a0 tempest-CreateVolumesFromSnapshotTest-988849501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-75b26984-c608-43b8-8222-7f510583cdad {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:39 devstack sudo[108213]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4ee59cb4-fe18-4ab9-a72b-1ff35191d799 tempest-VolumesSnapshotListTestJSON-1859349725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa" returned: 0 in 1.043s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4ee59cb4-fe18-4ab9-a72b-1ff35191d799 tempest-VolumesSnapshotListTestJSON-1859349725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.6898da04-f841-4f9a-86e6-71e6fd2f39b8 1G {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:39 devstack sudo[108225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-75b26984-c608-43b8-8222-7f510583cdad Jun 23 16:42:39 devstack sudo[108225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:40 devstack sudo[108226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.6898da04-f841-4f9a-86e6-71e6fd2f39b8 1G Jun 23 16:42:40 devstack sudo[108226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:40 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-93a37d5c-9522-4f38-9eb2-78eb101203d8 tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2.11b867fc-c9c1-4a70-ac44-3eb205bf77ee" returned: 0 in 1.420s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-93a37d5c-9522-4f38-9eb2-78eb101203d8 tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2.11b867fc-c9c1-4a70-ac44-3eb205bf77ee {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:40 devstack sudo[108233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2.11b867fc-c9c1-4a70-ac44-3eb205bf77ee Jun 23 16:42:40 devstack sudo[108233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:41 devstack sudo[108225]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-67f57039-6de3-44ff-a631-5e9eb22cc0a0 tempest-CreateVolumesFromSnapshotTest-988849501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-75b26984-c608-43b8-8222-7f510583cdad" returned: 0 in 1.132s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:41 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-67f57039-6de3-44ff-a631-5e9eb22cc0a0 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "cinder-quobyte-75b26984-c608-43b8-8222-7f510583cdad" released by "delete_volume" :: held 2.481s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:42:41 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:SELECT=95,cinder:INSERT=35,cinder:UPDATE=152,cinder:DELETE=12 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:42:41 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-67f57039-6de3-44ff-a631-5e9eb22cc0a0 tempest-CreateVolumesFromSnapshotTest-988849501 None] Created reservations ['fd6518b9-de17-4af9-be1a-4332a698e664', 'b96cd5c2-9b89-447d-8bae-e2cfd541009b', '63b74a11-1399-40fc-99b9-22a8929fc11c', 'c6c05f30-122e-4d60-8b93-c300d1735f7b'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:42:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-67f57039-6de3-44ff-a631-5e9eb22cc0a0 tempest-CreateVolumesFromSnapshotTest-988849501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:42:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-67f57039-6de3-44ff-a631-5e9eb22cc0a0 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:42:41 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-67f57039-6de3-44ff-a631-5e9eb22cc0a0 tempest-CreateVolumesFromSnapshotTest-988849501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:42:41 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-67f57039-6de3-44ff-a631-5e9eb22cc0a0 tempest-CreateVolumesFromSnapshotTest-988849501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:42:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-67f57039-6de3-44ff-a631-5e9eb22cc0a0 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:42:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-67f57039-6de3-44ff-a631-5e9eb22cc0a0 tempest-CreateVolumesFromSnapshotTest-988849501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:41 devstack sudo[108241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:42:41 devstack sudo[108241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:41 devstack sudo[108226]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4ee59cb4-fe18-4ab9-a72b-1ff35191d799 tempest-VolumesSnapshotListTestJSON-1859349725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.6898da04-f841-4f9a-86e6-71e6fd2f39b8 1G" returned: 0 in 1.339s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4ee59cb4-fe18-4ab9-a72b-1ff35191d799 tempest-VolumesSnapshotListTestJSON-1859349725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0775578-9730-4128-a566-9dc7226fc2fa -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.6898da04-f841-4f9a-86e6-71e6fd2f39b8 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:41 devstack sudo[108243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0775578-9730-4128-a566-9dc7226fc2fa -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.6898da04-f841-4f9a-86e6-71e6fd2f39b8 Jun 23 16:42:41 devstack sudo[108243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:41 devstack sudo[108233]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-93a37d5c-9522-4f38-9eb2-78eb101203d8 tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2.11b867fc-c9c1-4a70-ac44-3eb205bf77ee" returned: 0 in 1.126s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:41 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-93a37d5c-9522-4f38-9eb2-78eb101203d8 tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "cinder-quobyte-11b867fc-c9c1-4a70-ac44-3eb205bf77ee" released by "_delete_snapshot" :: held 5.667s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:42:41 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-93a37d5c-9522-4f38-9eb2-78eb101203d8 tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "cinder-quobyte-b4df677b-2c51-4af8-99b5-1f0ff9644df2" released by "delete_snapshot" :: held 5.729s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:42:42 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-93a37d5c-9522-4f38-9eb2-78eb101203d8 tempest-VolumesSnapshotTestJSON-1537803418 None] Created reservations ['45785883-7967-40fa-bb76-a20894e735b7', 'd51e4ee7-96c2-4207-9bec-b2dd72f3df8a', '50e3e4fd-fcdf-4148-8d18-15fe84c66cba', '8e56d5df-639d-4541-8baa-024c75df1759'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:42:42 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d6fb3baf-efe4-44e3-b89c-64c09bde4c5f tempest-CreateVolumesFromSnapshotTest-988849501 None] Acquiring lock "cinder-6c427e41-223c-4027-88f4-7fadf161e778-delete_snapshot" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:42:42 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d6fb3baf-efe4-44e3-b89c-64c09bde4c5f tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "cinder-6c427e41-223c-4027-88f4-7fadf161e778-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:42:42 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d6fb3baf-efe4-44e3-b89c-64c09bde4c5f tempest-CreateVolumesFromSnapshotTest-988849501 None] Acquiring lock "cinder-quobyte-6daa2f8e-f097-4897-a8c4-8a4bf430a82b" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:42:42 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d6fb3baf-efe4-44e3-b89c-64c09bde4c5f tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "cinder-quobyte-6daa2f8e-f097-4897-a8c4-8a4bf430a82b" acquired by "delete_snapshot" :: waited 0.032s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:42:42 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d6fb3baf-efe4-44e3-b89c-64c09bde4c5f tempest-CreateVolumesFromSnapshotTest-988849501 None] Acquiring lock "cinder-quobyte-6c427e41-223c-4027-88f4-7fadf161e778" by "_delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:42:42 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-93a37d5c-9522-4f38-9eb2-78eb101203d8 tempest-VolumesSnapshotTestJSON-1537803418 None] Delete snapshot completed successfully. Jun 23 16:42:42 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d6fb3baf-efe4-44e3-b89c-64c09bde4c5f tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "cinder-quobyte-6c427e41-223c-4027-88f4-7fadf161e778" acquired by "_delete_snapshot" :: waited 0.055s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:42:42 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-d6fb3baf-efe4-44e3-b89c-64c09bde4c5f tempest-CreateVolumesFromSnapshotTest-988849501 None] Deleting offline snapshot 6c427e41-223c-4027-88f4-7fadf161e778 of volume 6daa2f8e-f097-4897-a8c4-8a4bf430a82b {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:42:42 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-d6fb3baf-efe4-44e3-b89c-64c09bde4c5f tempest-CreateVolumesFromSnapshotTest-988849501 None] snapshot_file for this snap is: volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b.6c427e41-223c-4027-88f4-7fadf161e778 {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:42:42 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-93a37d5c-9522-4f38-9eb2-78eb101203d8 tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "cinder-11b867fc-c9c1-4a70-ac44-3eb205bf77ee-delete_snapshot" released by "delete_snapshot" :: held 6.189s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:42:42 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f424fb84-8038-4594-9925-a925e676b184]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:42:42 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d6fb3baf-efe4-44e3-b89c-64c09bde4c5f tempest-CreateVolumesFromSnapshotTest-988849501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b.6c427e41-223c-4027-88f4-7fadf161e778 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:42 devstack sudo[108251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b.6c427e41-223c-4027-88f4-7fadf161e778 Jun 23 16:42:42 devstack sudo[108251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:42 devstack sudo[108241]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:42 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-67f57039-6de3-44ff-a631-5e9eb22cc0a0 tempest-CreateVolumesFromSnapshotTest-988849501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.170s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:42 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-67f57039-6de3-44ff-a631-5e9eb22cc0a0 tempest-CreateVolumesFromSnapshotTest-988849501 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:42:42 devstack sudo[108243]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:42 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-67f57039-6de3-44ff-a631-5e9eb22cc0a0 tempest-CreateVolumesFromSnapshotTest-988849501 None] Deleted volume successfully. Jun 23 16:42:42 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4ee59cb4-fe18-4ab9-a72b-1ff35191d799 tempest-VolumesSnapshotListTestJSON-1859349725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0775578-9730-4128-a566-9dc7226fc2fa -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.6898da04-f841-4f9a-86e6-71e6fd2f39b8" returned: 0 in 1.148s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:42 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-4ee59cb4-fe18-4ab9-a72b-1ff35191d799 tempest-VolumesSnapshotListTestJSON-1859349725 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.6898da04-f841-4f9a-86e6-71e6fd2f39b8 is being set with open permissions: ugo+rw Jun 23 16:42:42 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4ee59cb4-fe18-4ab9-a72b-1ff35191d799 tempest-VolumesSnapshotListTestJSON-1859349725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.6898da04-f841-4f9a-86e6-71e6fd2f39b8 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:42 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-67f57039-6de3-44ff-a631-5e9eb22cc0a0 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "cinder-75b26984-c608-43b8-8222-7f510583cdad-delete_volume" released by "delete_volume" :: held 4.071s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:42:42 devstack sudo[108253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.6898da04-f841-4f9a-86e6-71e6fd2f39b8 Jun 23 16:42:42 devstack sudo[108253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:43 devstack sudo[108251]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d6fb3baf-efe4-44e3-b89c-64c09bde4c5f tempest-CreateVolumesFromSnapshotTest-988849501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b.6c427e41-223c-4027-88f4-7fadf161e778" returned: 0 in 0.993s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:43 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-d6fb3baf-efe4-44e3-b89c-64c09bde4c5f tempest-CreateVolumesFromSnapshotTest-988849501 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:42:43 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f1426a-5e0d-4014-b0bc-a0e5723929ea]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:42:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d6fb3baf-efe4-44e3-b89c-64c09bde4c5f tempest-CreateVolumesFromSnapshotTest-988849501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:43 devstack sudo[108253]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4ee59cb4-fe18-4ab9-a72b-1ff35191d799 tempest-VolumesSnapshotListTestJSON-1859349725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.6898da04-f841-4f9a-86e6-71e6fd2f39b8" returned: 0 in 0.934s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:43 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fd5782f-2eb0-4780-b63e-74c85bb9c5cd tempest-VolumesSnapshotTestJSON-1537803418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:42:43 devstack sudo[108261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b Jun 23 16:42:43 devstack sudo[108261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-7fd5782f-2eb0-4780-b63e-74c85bb9c5cd tempest-VolumesSnapshotTestJSON-1537803418 None] Flow 'volume_create_manager' (b3da8fd4-1ba2-40c9-84b0-b280411b7c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:42:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-7fd5782f-2eb0-4780-b63e-74c85bb9c5cd tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84731a35-3874-46a7-a465-927687ae1991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4ee59cb4-fe18-4ab9-a72b-1ff35191d799 tempest-VolumesSnapshotListTestJSON-1859349725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-7fd5782f-2eb0-4780-b63e-74c85bb9c5cd tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84731a35-3874-46a7-a465-927687ae1991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-976784092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8f9d6e3-cfcb-4d59-a3a9-ce707606935c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd0b61ecd544df9a4720fb512a61494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:42:43Z,use_quota=True,user_id='dc863f468a064fdca543394f9e0a10c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-7fd5782f-2eb0-4780-b63e-74c85bb9c5cd tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a187178-9d87-45c8-b2f7-41213f22def9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-7fd5782f-2eb0-4780-b63e-74c85bb9c5cd tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a187178-9d87-45c8-b2f7-41213f22def9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-7fd5782f-2eb0-4780-b63e-74c85bb9c5cd tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3d5695d-5c22-4aa3-82ae-9a90440ae57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:43 devstack sudo[108263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.info Jun 23 16:42:43 devstack sudo[108263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-7fd5782f-2eb0-4780-b63e-74c85bb9c5cd tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3d5695d-5c22-4aa3-82ae-9a90440ae57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8f9d6e3-cfcb-4d59-a3a9-ce707606935c', 'volume_name': 'volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-7fd5782f-2eb0-4780-b63e-74c85bb9c5cd tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af250433-d734-4827-a58a-3eeec5a7df6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-7fd5782f-2eb0-4780-b63e-74c85bb9c5cd tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af250433-d734-4827-a58a-3eeec5a7df6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-7fd5782f-2eb0-4780-b63e-74c85bb9c5cd tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eaf5186-7234-435c-b0f0-e5b68d2635c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:43 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-7fd5782f-2eb0-4780-b63e-74c85bb9c5cd tempest-VolumesSnapshotTestJSON-1537803418 None] Volume e8f9d6e3-cfcb-4d59-a3a9-ce707606935c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c', 'volume_size': 1} Jun 23 16:42:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-7fd5782f-2eb0-4780-b63e-74c85bb9c5cd tempest-VolumesSnapshotTestJSON-1537803418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:42:44 devstack sudo[108261]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d6fb3baf-efe4-44e3-b89c-64c09bde4c5f tempest-CreateVolumesFromSnapshotTest-988849501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b" returned: 0 in 0.910s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d6fb3baf-efe4-44e3-b89c-64c09bde4c5f tempest-CreateVolumesFromSnapshotTest-988849501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b.6c427e41-223c-4027-88f4-7fadf161e778 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:44 devstack sudo[108270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b.6c427e41-223c-4027-88f4-7fadf161e778 Jun 23 16:42:44 devstack sudo[108270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:44 devstack sudo[108263]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4ee59cb4-fe18-4ab9-a72b-1ff35191d799 tempest-VolumesSnapshotListTestJSON-1859349725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.info" returned: 0 in 0.808s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:44 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-4ee59cb4-fe18-4ab9-a72b-1ff35191d799 tempest-VolumesSnapshotListTestJSON-1859349725 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.info is being set with open permissions: ugo+rw Jun 23 16:42:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4ee59cb4-fe18-4ab9-a72b-1ff35191d799 tempest-VolumesSnapshotListTestJSON-1859349725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:44 devstack sudo[108272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.info Jun 23 16:42:44 devstack sudo[108272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:44 devstack sudo[108272]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4ee59cb4-fe18-4ab9-a72b-1ff35191d799 tempest-VolumesSnapshotListTestJSON-1859349725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.info" returned: 0 in 0.701s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:44 devstack sudo[108270]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-4ee59cb4-fe18-4ab9-a72b-1ff35191d799 tempest-VolumesSnapshotListTestJSON-1859349725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.155s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:42:45 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-7fd5782f-2eb0-4780-b63e-74c85bb9c5cd tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.477s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:42:45 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-7fd5782f-2eb0-4780-b63e-74c85bb9c5cd tempest-VolumesSnapshotTestJSON-1537803418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-976784092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8f9d6e3-cfcb-4d59-a3a9-ce707606935c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd0b61ecd544df9a4720fb512a61494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:42:43Z,use_quota=True,user_id='dc863f468a064fdca543394f9e0a10c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:42:45 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-7fd5782f-2eb0-4780-b63e-74c85bb9c5cd tempest-VolumesSnapshotTestJSON-1537803418 None] Creating volume e8f9d6e3-cfcb-4d59-a3a9-ce707606935c {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:42:45 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-7fd5782f-2eb0-4780-b63e-74c85bb9c5cd tempest-VolumesSnapshotTestJSON-1537803418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:42:45 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-7fd5782f-2eb0-4780-b63e-74c85bb9c5cd tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:42:45 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-7fd5782f-2eb0-4780-b63e-74c85bb9c5cd tempest-VolumesSnapshotTestJSON-1537803418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:42:45 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-7fd5782f-2eb0-4780-b63e-74c85bb9c5cd tempest-VolumesSnapshotTestJSON-1537803418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:42:45 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-7fd5782f-2eb0-4780-b63e-74c85bb9c5cd tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:42:45 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-7fd5782f-2eb0-4780-b63e-74c85bb9c5cd tempest-VolumesSnapshotTestJSON-1537803418 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:42:45 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-7fd5782f-2eb0-4780-b63e-74c85bb9c5cd tempest-VolumesSnapshotTestJSON-1537803418 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:42:45 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-7fd5782f-2eb0-4780-b63e-74c85bb9c5cd tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:45 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d6fb3baf-efe4-44e3-b89c-64c09bde4c5f tempest-CreateVolumesFromSnapshotTest-988849501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b.6c427e41-223c-4027-88f4-7fadf161e778" returned: 0 in 0.852s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:45 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d6fb3baf-efe4-44e3-b89c-64c09bde4c5f tempest-CreateVolumesFromSnapshotTest-988849501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b.6c427e41-223c-4027-88f4-7fadf161e778 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:45 devstack sudo[108278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c 1073741824 Jun 23 16:42:45 devstack sudo[108278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:45 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-4ee59cb4-fe18-4ab9-a72b-1ff35191d799 tempest-VolumesSnapshotListTestJSON-1859349725 None] Create snapshot completed successfully Jun 23 16:42:45 devstack sudo[108279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b.6c427e41-223c-4027-88f4-7fadf161e778 Jun 23 16:42:45 devstack sudo[108279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:45 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-14bc230c-59d6-4fd4-9815-8e6e64139937 tempest-VolumesSnapshotListTestJSON-1859349725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:42:45 devstack sudo[108279]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:45 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d6fb3baf-efe4-44e3-b89c-64c09bde4c5f tempest-CreateVolumesFromSnapshotTest-988849501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b.6c427e41-223c-4027-88f4-7fadf161e778" returned: 0 in 0.870s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:45 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d6fb3baf-efe4-44e3-b89c-64c09bde4c5f tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "cinder-quobyte-6c427e41-223c-4027-88f4-7fadf161e778" released by "_delete_snapshot" :: held 3.764s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:42:45 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d6fb3baf-efe4-44e3-b89c-64c09bde4c5f tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "cinder-quobyte-6daa2f8e-f097-4897-a8c4-8a4bf430a82b" released by "delete_snapshot" :: held 3.830s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:42:46 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-d6fb3baf-efe4-44e3-b89c-64c09bde4c5f tempest-CreateVolumesFromSnapshotTest-988849501 None] Created reservations ['269ee8c6-43e4-4593-9e5e-bf42aa0236fd', '3b2853f4-3cbb-4d9e-9e81-9fdb4794b024', 'c883c827-d0d4-4c40-9f32-bb510eafccf0', 'c6b50d96-0d39-4e1e-baa2-929bdbd7ab0f'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:42:46 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-d6fb3baf-efe4-44e3-b89c-64c09bde4c5f tempest-CreateVolumesFromSnapshotTest-988849501 None] Delete snapshot completed successfully. Jun 23 16:42:46 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d6fb3baf-efe4-44e3-b89c-64c09bde4c5f tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "cinder-6c427e41-223c-4027-88f4-7fadf161e778-delete_snapshot" released by "delete_snapshot" :: held 4.006s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:42:46 devstack sudo[108278]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-7fd5782f-2eb0-4780-b63e-74c85bb9c5cd tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c 1073741824" returned: 0 in 1.153s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-7fd5782f-2eb0-4780-b63e-74c85bb9c5cd tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:46 devstack sudo[108287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c Jun 23 16:42:46 devstack sudo[108287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:46 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-17e6f63a-3875-4f8b-9801-a4923fb40758 tempest-CreateVolumesFromSnapshotTest-988849501 None] Acquiring lock "cinder-6daa2f8e-f097-4897-a8c4-8a4bf430a82b-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:42:46 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-17e6f63a-3875-4f8b-9801-a4923fb40758 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "cinder-6daa2f8e-f097-4897-a8c4-8a4bf430a82b-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:42:46 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-17e6f63a-3875-4f8b-9801-a4923fb40758 tempest-CreateVolumesFromSnapshotTest-988849501 None] Acquiring lock "cinder-quobyte-6daa2f8e-f097-4897-a8c4-8a4bf430a82b" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:42:46 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-17e6f63a-3875-4f8b-9801-a4923fb40758 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "cinder-quobyte-6daa2f8e-f097-4897-a8c4-8a4bf430a82b" acquired by "delete_volume" :: waited 0.019s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:42:46 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62d687e-9a0e-46f8-8447-955accc1fbff]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:42:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-17e6f63a-3875-4f8b-9801-a4923fb40758 tempest-CreateVolumesFromSnapshotTest-988849501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:46 devstack sudo[108289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b Jun 23 16:42:46 devstack sudo[108289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:47 devstack sudo[108287]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-7fd5782f-2eb0-4780-b63e-74c85bb9c5cd tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c" returned: 0 in 0.810s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:47 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-7fd5782f-2eb0-4780-b63e-74c85bb9c5cd tempest-VolumesSnapshotTestJSON-1537803418 None] <== create_volume: return (2008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:42:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-7fd5782f-2eb0-4780-b63e-74c85bb9c5cd tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.011s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:42:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-14bc230c-59d6-4fd4-9815-8e6e64139937 tempest-VolumesSnapshotListTestJSON-1859349725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.459s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:42:47 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-14bc230c-59d6-4fd4-9815-8e6e64139937 tempest-VolumesSnapshotListTestJSON-1859349725 None] Creating offline snapshot 3289f398-3e22-45da-ac15-5a2db1d3b965 of volume e0775578-9730-4128-a566-9dc7226fc2fa {{(pid=93788) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:42:47 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-7fd5782f-2eb0-4780-b63e-74c85bb9c5cd tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eaf5186-7234-435c-b0f0-e5b68d2635c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:47 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-7fd5782f-2eb0-4780-b63e-74c85bb9c5cd tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecdeb59f-39f6-4a94-b96d-54b8ab734484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:47 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce33670-8f7d-4d2a-bf06-7ddf86e873f4]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:42:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-14bc230c-59d6-4fd4-9815-8e6e64139937 tempest-VolumesSnapshotListTestJSON-1859349725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.6898da04-f841-4f9a-86e6-71e6fd2f39b8 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:47 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-7fd5782f-2eb0-4780-b63e-74c85bb9c5cd tempest-VolumesSnapshotTestJSON-1537803418 None] Volume volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c (e8f9d6e3-cfcb-4d59-a3a9-ce707606935c): created successfully Jun 23 16:42:47 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-7fd5782f-2eb0-4780-b63e-74c85bb9c5cd tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecdeb59f-39f6-4a94-b96d-54b8ab734484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:47 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-7fd5782f-2eb0-4780-b63e-74c85bb9c5cd tempest-VolumesSnapshotTestJSON-1537803418 None] Flow 'volume_create_manager' (b3da8fd4-1ba2-40c9-84b0-b280411b7c07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:42:47 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-7fd5782f-2eb0-4780-b63e-74c85bb9c5cd tempest-VolumesSnapshotTestJSON-1537803418 None] Created volume successfully. Jun 23 16:42:47 devstack sudo[108298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.6898da04-f841-4f9a-86e6-71e6fd2f39b8 Jun 23 16:42:47 devstack sudo[108298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:47 devstack sudo[108289]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-17e6f63a-3875-4f8b-9801-a4923fb40758 tempest-CreateVolumesFromSnapshotTest-988849501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b" returned: 0 in 0.853s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-17e6f63a-3875-4f8b-9801-a4923fb40758 tempest-CreateVolumesFromSnapshotTest-988849501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:47 devstack sudo[108304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b Jun 23 16:42:47 devstack sudo[108304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-15a8f274-ec66-4a5c-aaf7-1737d79106e8 tempest-VolumesSnapshotTestJSON-1537803418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:42:48 devstack sudo[108298]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-14bc230c-59d6-4fd4-9815-8e6e64139937 tempest-VolumesSnapshotListTestJSON-1859349725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.6898da04-f841-4f9a-86e6-71e6fd2f39b8" returned: 0 in 1.022s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:48 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-14bc230c-59d6-4fd4-9815-8e6e64139937 tempest-VolumesSnapshotListTestJSON-1859349725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0775578-9730-4128-a566-9dc7226fc2fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:42:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-14bc230c-59d6-4fd4-9815-8e6e64139937 tempest-VolumesSnapshotListTestJSON-1859349725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.6898da04-f841-4f9a-86e6-71e6fd2f39b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.3289f398-3e22-45da-ac15-5a2db1d3b965 1G {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:48 devstack sudo[108309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.6898da04-f841-4f9a-86e6-71e6fd2f39b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.3289f398-3e22-45da-ac15-5a2db1d3b965 1G Jun 23 16:42:48 devstack sudo[108309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:48 devstack sudo[108304]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-17e6f63a-3875-4f8b-9801-a4923fb40758 tempest-CreateVolumesFromSnapshotTest-988849501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6daa2f8e-f097-4897-a8c4-8a4bf430a82b" returned: 0 in 0.908s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:48 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-17e6f63a-3875-4f8b-9801-a4923fb40758 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "cinder-quobyte-6daa2f8e-f097-4897-a8c4-8a4bf430a82b" released by "delete_volume" :: held 1.831s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:42:48 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-17e6f63a-3875-4f8b-9801-a4923fb40758 tempest-CreateVolumesFromSnapshotTest-988849501 None] Created reservations ['4706f99c-d56a-49da-887d-7ad685bcaf96', '7a985014-0989-4680-984b-b39e33508e30', '565f1d65-5f8c-4496-aef1-85e76cdb52c6', '41538634-75bb-4893-81bb-e6a53cc7de7a'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:42:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-17e6f63a-3875-4f8b-9801-a4923fb40758 tempest-CreateVolumesFromSnapshotTest-988849501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:42:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-17e6f63a-3875-4f8b-9801-a4923fb40758 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:42:48 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-17e6f63a-3875-4f8b-9801-a4923fb40758 tempest-CreateVolumesFromSnapshotTest-988849501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:42:48 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-17e6f63a-3875-4f8b-9801-a4923fb40758 tempest-CreateVolumesFromSnapshotTest-988849501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:42:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-17e6f63a-3875-4f8b-9801-a4923fb40758 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:42:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-17e6f63a-3875-4f8b-9801-a4923fb40758 tempest-CreateVolumesFromSnapshotTest-988849501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:48 devstack sudo[108326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:42:48 devstack sudo[108326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:49 devstack sudo[108309]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-14bc230c-59d6-4fd4-9815-8e6e64139937 tempest-VolumesSnapshotListTestJSON-1859349725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.6898da04-f841-4f9a-86e6-71e6fd2f39b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.3289f398-3e22-45da-ac15-5a2db1d3b965 1G" returned: 0 in 1.031s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-14bc230c-59d6-4fd4-9815-8e6e64139937 tempest-VolumesSnapshotListTestJSON-1859349725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0775578-9730-4128-a566-9dc7226fc2fa.6898da04-f841-4f9a-86e6-71e6fd2f39b8 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.3289f398-3e22-45da-ac15-5a2db1d3b965 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:49 devstack sudo[108333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0775578-9730-4128-a566-9dc7226fc2fa.6898da04-f841-4f9a-86e6-71e6fd2f39b8 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.3289f398-3e22-45da-ac15-5a2db1d3b965 Jun 23 16:42:49 devstack sudo[108333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:49 devstack sudo[108326]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-17e6f63a-3875-4f8b-9801-a4923fb40758 tempest-CreateVolumesFromSnapshotTest-988849501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.707s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:49 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-17e6f63a-3875-4f8b-9801-a4923fb40758 tempest-CreateVolumesFromSnapshotTest-988849501 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:42:49 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-17e6f63a-3875-4f8b-9801-a4923fb40758 tempest-CreateVolumesFromSnapshotTest-988849501 None] Deleted volume successfully. Jun 23 16:42:49 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-17e6f63a-3875-4f8b-9801-a4923fb40758 tempest-CreateVolumesFromSnapshotTest-988849501 None] Lock "cinder-6daa2f8e-f097-4897-a8c4-8a4bf430a82b-delete_volume" released by "delete_volume" :: held 2.827s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:42:49 devstack sudo[108333]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-14bc230c-59d6-4fd4-9815-8e6e64139937 tempest-VolumesSnapshotListTestJSON-1859349725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0775578-9730-4128-a566-9dc7226fc2fa.6898da04-f841-4f9a-86e6-71e6fd2f39b8 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.3289f398-3e22-45da-ac15-5a2db1d3b965" returned: 0 in 0.781s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:49 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-14bc230c-59d6-4fd4-9815-8e6e64139937 tempest-VolumesSnapshotListTestJSON-1859349725 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.3289f398-3e22-45da-ac15-5a2db1d3b965 is being set with open permissions: ugo+rw Jun 23 16:42:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-14bc230c-59d6-4fd4-9815-8e6e64139937 tempest-VolumesSnapshotListTestJSON-1859349725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.3289f398-3e22-45da-ac15-5a2db1d3b965 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:49 devstack sudo[108339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.3289f398-3e22-45da-ac15-5a2db1d3b965 Jun 23 16:42:49 devstack sudo[108339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:50 devstack sudo[108339]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-14bc230c-59d6-4fd4-9815-8e6e64139937 tempest-VolumesSnapshotListTestJSON-1859349725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.3289f398-3e22-45da-ac15-5a2db1d3b965" returned: 0 in 0.670s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-14bc230c-59d6-4fd4-9815-8e6e64139937 tempest-VolumesSnapshotListTestJSON-1859349725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.639s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:42:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-15a8f274-ec66-4a5c-aaf7-1737d79106e8 tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.582s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:42:50 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-15a8f274-ec66-4a5c-aaf7-1737d79106e8 tempest-VolumesSnapshotTestJSON-1537803418 None] Creating offline snapshot 32a4ac7d-0a5d-4f5a-a45c-76931c1cdc5b of volume e8f9d6e3-cfcb-4d59-a3a9-ce707606935c {{(pid=93788) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:42:50 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-14bc230c-59d6-4fd4-9815-8e6e64139937 tempest-VolumesSnapshotListTestJSON-1859349725 None] Create snapshot completed successfully Jun 23 16:42:50 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[13828896-037a-432e-89f2-2d46422ca061]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:42:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-15a8f274-ec66-4a5c-aaf7-1737d79106e8 tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:50 devstack sudo[108342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c Jun 23 16:42:50 devstack sudo[108342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-0db26cae-4f0e-4f3f-b98e-d36fe21fbe2a tempest-VolumesSnapshotListTestJSON-1859349725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:42:51 devstack sudo[108342]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-15a8f274-ec66-4a5c-aaf7-1737d79106e8 tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c" returned: 0 in 0.807s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-15a8f274-ec66-4a5c-aaf7-1737d79106e8 tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c.32a4ac7d-0a5d-4f5a-a45c-76931c1cdc5b 1G {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:51 devstack sudo[108347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c.32a4ac7d-0a5d-4f5a-a45c-76931c1cdc5b 1G Jun 23 16:42:51 devstack sudo[108347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:51 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-43eb264a-eb03-42c4-a820-004f4bd64a02 tempest-VolumeDependencyTests-1788693032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:42:51 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-43eb264a-eb03-42c4-a820-004f4bd64a02 tempest-VolumeDependencyTests-1788693032 None] Flow 'volume_create_manager' (31a0d238-36fa-4df9-8ac5-f768802fbe60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:42:51 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-43eb264a-eb03-42c4-a820-004f4bd64a02 tempest-VolumeDependencyTests-1788693032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82cfd9c7-2847-4afb-95a2-0ec2ac257db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-43eb264a-eb03-42c4-a820-004f4bd64a02 tempest-VolumeDependencyTests-1788693032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82cfd9c7-2847-4afb-95a2-0ec2ac257db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1867470227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0182cd5f-4e03-4bcd-96d9-73c33ac44caf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='707addd997ef483e90e2a2760828c4e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:42:52Z,use_quota=True,user_id='0f342aa541ae4a07865a59b734021fda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-43eb264a-eb03-42c4-a820-004f4bd64a02 tempest-VolumeDependencyTests-1788693032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd74780a-2c9b-4c04-86cb-7325f6252abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-43eb264a-eb03-42c4-a820-004f4bd64a02 tempest-VolumeDependencyTests-1788693032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd74780a-2c9b-4c04-86cb-7325f6252abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-43eb264a-eb03-42c4-a820-004f4bd64a02 tempest-VolumeDependencyTests-1788693032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aedca28-6d31-475c-a841-85ed0f724822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-43eb264a-eb03-42c4-a820-004f4bd64a02 tempest-VolumeDependencyTests-1788693032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aedca28-6d31-475c-a841-85ed0f724822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0182cd5f-4e03-4bcd-96d9-73c33ac44caf', 'volume_name': 'volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-43eb264a-eb03-42c4-a820-004f4bd64a02 tempest-VolumeDependencyTests-1788693032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08d3620a-0ec0-468c-addc-3c3b9fb5d415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-43eb264a-eb03-42c4-a820-004f4bd64a02 tempest-VolumeDependencyTests-1788693032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08d3620a-0ec0-468c-addc-3c3b9fb5d415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-43eb264a-eb03-42c4-a820-004f4bd64a02 tempest-VolumeDependencyTests-1788693032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a280e79-0cd2-4ecd-838d-89b0c51ce5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:52 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-43eb264a-eb03-42c4-a820-004f4bd64a02 tempest-VolumeDependencyTests-1788693032 None] Volume 0182cd5f-4e03-4bcd-96d9-73c33ac44caf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf', 'volume_size': 1} Jun 23 16:42:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-43eb264a-eb03-42c4-a820-004f4bd64a02 tempest-VolumeDependencyTests-1788693032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:42:52 devstack sudo[108347]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-15a8f274-ec66-4a5c-aaf7-1737d79106e8 tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c.32a4ac7d-0a5d-4f5a-a45c-76931c1cdc5b 1G" returned: 0 in 0.886s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-15a8f274-ec66-4a5c-aaf7-1737d79106e8 tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c.32a4ac7d-0a5d-4f5a-a45c-76931c1cdc5b {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:52 devstack sudo[108352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c.32a4ac7d-0a5d-4f5a-a45c-76931c1cdc5b Jun 23 16:42:52 devstack sudo[108352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:53 devstack sudo[108352]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:53 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-15a8f274-ec66-4a5c-aaf7-1737d79106e8 tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c.32a4ac7d-0a5d-4f5a-a45c-76931c1cdc5b" returned: 0 in 0.723s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:53 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-15a8f274-ec66-4a5c-aaf7-1737d79106e8 tempest-VolumesSnapshotTestJSON-1537803418 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c.32a4ac7d-0a5d-4f5a-a45c-76931c1cdc5b is being set with open permissions: ugo+rw Jun 23 16:42:53 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-15a8f274-ec66-4a5c-aaf7-1737d79106e8 tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c.32a4ac7d-0a5d-4f5a-a45c-76931c1cdc5b {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:53 devstack sudo[108357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c.32a4ac7d-0a5d-4f5a-a45c-76931c1cdc5b Jun 23 16:42:53 devstack sudo[108357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:53 devstack sudo[108357]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:53 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-15a8f274-ec66-4a5c-aaf7-1737d79106e8 tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c.32a4ac7d-0a5d-4f5a-a45c-76931c1cdc5b" returned: 0 in 0.651s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:53 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-15a8f274-ec66-4a5c-aaf7-1737d79106e8 tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:53 devstack sudo[108360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c.info Jun 23 16:42:53 devstack sudo[108360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:54 devstack sudo[108360]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-15a8f274-ec66-4a5c-aaf7-1737d79106e8 tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c.info" returned: 0 in 0.659s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:54 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-15a8f274-ec66-4a5c-aaf7-1737d79106e8 tempest-VolumesSnapshotTestJSON-1537803418 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c.info is being set with open permissions: ugo+rw Jun 23 16:42:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-15a8f274-ec66-4a5c-aaf7-1737d79106e8 tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:54 devstack sudo[108363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c.info Jun 23 16:42:54 devstack sudo[108363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:55 devstack sudo[108363]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-15a8f274-ec66-4a5c-aaf7-1737d79106e8 tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c.info" returned: 0 in 0.664s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-15a8f274-ec66-4a5c-aaf7-1737d79106e8 tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.483s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:42:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-0db26cae-4f0e-4f3f-b98e-d36fe21fbe2a tempest-VolumesSnapshotListTestJSON-1859349725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.015s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:42:55 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-0db26cae-4f0e-4f3f-b98e-d36fe21fbe2a tempest-VolumesSnapshotListTestJSON-1859349725 None] Creating offline snapshot 82317c58-f962-4544-b260-6e95b9f6322b of volume e0775578-9730-4128-a566-9dc7226fc2fa {{(pid=93788) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:42:55 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c24e0eb-2d5a-40c0-902e-0b8e6a097598]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:42:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0db26cae-4f0e-4f3f-b98e-d36fe21fbe2a tempest-VolumesSnapshotListTestJSON-1859349725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.3289f398-3e22-45da-ac15-5a2db1d3b965 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:55 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-15a8f274-ec66-4a5c-aaf7-1737d79106e8 tempest-VolumesSnapshotTestJSON-1537803418 None] Create snapshot completed successfully Jun 23 16:42:55 devstack sudo[108366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.3289f398-3e22-45da-ac15-5a2db1d3b965 Jun 23 16:42:55 devstack sudo[108366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:55 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:42:55 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] Flow 'volume_create_manager' (12627b4b-3058-4f4a-8e02-cbcea1f0631a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:42:55 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eea10c83-2773-489e-b8af-062b4cb9f1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:55 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eea10c83-2773-489e-b8af-062b4cb9f1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1350816266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df4e0a34-9fac-4919-8b23-21aa3430d57f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd0b61ecd544df9a4720fb512a61494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:42:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=32a4ac7d-0a5d-4f5a-a45c-76931c1cdc5b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:42:56Z,use_quota=True,user_id='dc863f468a064fdca543394f9e0a10c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:55 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a412768-2ca9-426f-babb-1cd95bbba4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:56 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a412768-2ca9-426f-babb-1cd95bbba4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:56 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12bd4a58-828f-454a-b195-2f8816aacf85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:56 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12bd4a58-828f-454a-b195-2f8816aacf85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'df4e0a34-9fac-4919-8b23-21aa3430d57f', 'volume_name': 'volume-df4e0a34-9fac-4919-8b23-21aa3430d57f', 'volume_size': 2, 'snapshot_id': '32a4ac7d-0a5d-4f5a-a45c-76931c1cdc5b'}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:56 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8881b0a-8ad6-4636-b760-71c9ec674adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:56 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8881b0a-8ad6-4636-b760-71c9ec674adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:42:56 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49152919-b3a9-42eb-bc93-322a79e78413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:42:56 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] Volume df4e0a34-9fac-4919-8b23-21aa3430d57f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-df4e0a34-9fac-4919-8b23-21aa3430d57f', 'volume_size': 2, 'snapshot_id': '32a4ac7d-0a5d-4f5a-a45c-76931c1cdc5b'} Jun 23 16:42:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:42:56 devstack sudo[108366]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0db26cae-4f0e-4f3f-b98e-d36fe21fbe2a tempest-VolumesSnapshotListTestJSON-1859349725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.3289f398-3e22-45da-ac15-5a2db1d3b965" returned: 0 in 0.832s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:56 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-0db26cae-4f0e-4f3f-b98e-d36fe21fbe2a tempest-VolumesSnapshotListTestJSON-1859349725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0775578-9730-4128-a566-9dc7226fc2fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:42:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0db26cae-4f0e-4f3f-b98e-d36fe21fbe2a tempest-VolumesSnapshotListTestJSON-1859349725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.3289f398-3e22-45da-ac15-5a2db1d3b965,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.82317c58-f962-4544-b260-6e95b9f6322b 1G {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:56 devstack sudo[108371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.3289f398-3e22-45da-ac15-5a2db1d3b965,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.82317c58-f962-4544-b260-6e95b9f6322b 1G Jun 23 16:42:56 devstack sudo[108371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:56 devstack sudo[108371]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0db26cae-4f0e-4f3f-b98e-d36fe21fbe2a tempest-VolumesSnapshotListTestJSON-1859349725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.3289f398-3e22-45da-ac15-5a2db1d3b965,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.82317c58-f962-4544-b260-6e95b9f6322b 1G" returned: 0 in 0.944s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0db26cae-4f0e-4f3f-b98e-d36fe21fbe2a tempest-VolumesSnapshotListTestJSON-1859349725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0775578-9730-4128-a566-9dc7226fc2fa.3289f398-3e22-45da-ac15-5a2db1d3b965 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.82317c58-f962-4544-b260-6e95b9f6322b {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:57 devstack sudo[108377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0775578-9730-4128-a566-9dc7226fc2fa.3289f398-3e22-45da-ac15-5a2db1d3b965 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.82317c58-f962-4544-b260-6e95b9f6322b Jun 23 16:42:57 devstack sudo[108377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:57 devstack sudo[108377]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0db26cae-4f0e-4f3f-b98e-d36fe21fbe2a tempest-VolumesSnapshotListTestJSON-1859349725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0775578-9730-4128-a566-9dc7226fc2fa.3289f398-3e22-45da-ac15-5a2db1d3b965 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.82317c58-f962-4544-b260-6e95b9f6322b" returned: 0 in 0.742s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:57 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-0db26cae-4f0e-4f3f-b98e-d36fe21fbe2a tempest-VolumesSnapshotListTestJSON-1859349725 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.82317c58-f962-4544-b260-6e95b9f6322b is being set with open permissions: ugo+rw Jun 23 16:42:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0db26cae-4f0e-4f3f-b98e-d36fe21fbe2a tempest-VolumesSnapshotListTestJSON-1859349725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.82317c58-f962-4544-b260-6e95b9f6322b {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:57 devstack sudo[108382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.82317c58-f962-4544-b260-6e95b9f6322b Jun 23 16:42:57 devstack sudo[108382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:58 devstack sudo[108382]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0db26cae-4f0e-4f3f-b98e-d36fe21fbe2a tempest-VolumesSnapshotListTestJSON-1859349725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.82317c58-f962-4544-b260-6e95b9f6322b" returned: 0 in 0.699s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-0db26cae-4f0e-4f3f-b98e-d36fe21fbe2a tempest-VolumesSnapshotListTestJSON-1859349725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.322s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:42:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-43eb264a-eb03-42c4-a820-004f4bd64a02 tempest-VolumeDependencyTests-1788693032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.437s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:42:58 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-43eb264a-eb03-42c4-a820-004f4bd64a02 tempest-VolumeDependencyTests-1788693032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1867470227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0182cd5f-4e03-4bcd-96d9-73c33ac44caf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='707addd997ef483e90e2a2760828c4e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:42:52Z,use_quota=True,user_id='0f342aa541ae4a07865a59b734021fda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:42:58 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-43eb264a-eb03-42c4-a820-004f4bd64a02 tempest-VolumeDependencyTests-1788693032 None] Creating volume 0182cd5f-4e03-4bcd-96d9-73c33ac44caf {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:42:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-43eb264a-eb03-42c4-a820-004f4bd64a02 tempest-VolumeDependencyTests-1788693032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:42:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-43eb264a-eb03-42c4-a820-004f4bd64a02 tempest-VolumeDependencyTests-1788693032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:42:58 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-43eb264a-eb03-42c4-a820-004f4bd64a02 tempest-VolumeDependencyTests-1788693032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:42:58 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-43eb264a-eb03-42c4-a820-004f4bd64a02 tempest-VolumeDependencyTests-1788693032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:42:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-43eb264a-eb03-42c4-a820-004f4bd64a02 tempest-VolumeDependencyTests-1788693032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:42:58 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-43eb264a-eb03-42c4-a820-004f4bd64a02 tempest-VolumeDependencyTests-1788693032 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:42:58 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-43eb264a-eb03-42c4-a820-004f4bd64a02 tempest-VolumeDependencyTests-1788693032 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:42:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-43eb264a-eb03-42c4-a820-004f4bd64a02 tempest-VolumeDependencyTests-1788693032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:58 devstack sudo[108385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf 1073741824 Jun 23 16:42:58 devstack sudo[108385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:42:58 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-0db26cae-4f0e-4f3f-b98e-d36fe21fbe2a tempest-VolumesSnapshotListTestJSON-1859349725 None] Create snapshot completed successfully Jun 23 16:42:59 devstack sudo[108385]: pam_unix(sudo:session): session closed for user root Jun 23 16:42:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-43eb264a-eb03-42c4-a820-004f4bd64a02 tempest-VolumeDependencyTests-1788693032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf 1073741824" returned: 0 in 0.826s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:42:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-43eb264a-eb03-42c4-a820-004f4bd64a02 tempest-VolumeDependencyTests-1788693032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:42:59 devstack sudo[108393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf Jun 23 16:42:59 devstack sudo[108393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:00 devstack sudo[108393]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-43eb264a-eb03-42c4-a820-004f4bd64a02 tempest-VolumeDependencyTests-1788693032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf" returned: 0 in 0.708s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:00 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-43eb264a-eb03-42c4-a820-004f4bd64a02 tempest-VolumeDependencyTests-1788693032 None] <== create_volume: return (1585ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:43:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-43eb264a-eb03-42c4-a820-004f4bd64a02 tempest-VolumeDependencyTests-1788693032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.588s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:43:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.025s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:43:00 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] Acquiring lock "cinder-quobyte-32a4ac7d-0a5d-4f5a-a45c-76931c1cdc5b-df4e0a34-9fac-4919-8b23-21aa3430d57f" by "_create_volume_from_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:43:00 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-43eb264a-eb03-42c4-a820-004f4bd64a02 tempest-VolumeDependencyTests-1788693032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a280e79-0cd2-4ecd-838d-89b0c51ce5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:43:00 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-43eb264a-eb03-42c4-a820-004f4bd64a02 tempest-VolumeDependencyTests-1788693032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cfeb3d1-50f1-4658-bbe7-bdd56d819839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:43:00 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "cinder-quobyte-32a4ac7d-0a5d-4f5a-a45c-76931c1cdc5b-df4e0a34-9fac-4919-8b23-21aa3430d57f" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:43:00 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] Creating volume df4e0a34-9fac-4919-8b23-21aa3430d57f from snapshot 32a4ac7d-0a5d-4f5a-a45c-76931c1cdc5b {{(pid=93788) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 16:43:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:43:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:43:00 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:43:00 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:43:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:43:00 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:43:00 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] Acquiring lock "cinder-quobyte-df4e0a34-9fac-4919-8b23-21aa3430d57f" by "_copy_volume_from_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:43:00 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-43eb264a-eb03-42c4-a820-004f4bd64a02 tempest-VolumeDependencyTests-1788693032 None] Volume volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf (0182cd5f-4e03-4bcd-96d9-73c33ac44caf): created successfully Jun 23 16:43:00 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-43eb264a-eb03-42c4-a820-004f4bd64a02 tempest-VolumeDependencyTests-1788693032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cfeb3d1-50f1-4658-bbe7-bdd56d819839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:43:00 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-43eb264a-eb03-42c4-a820-004f4bd64a02 tempest-VolumeDependencyTests-1788693032 None] Flow 'volume_create_manager' (31a0d238-36fa-4df9-8ac5-f768802fbe60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:43:00 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "cinder-quobyte-df4e0a34-9fac-4919-8b23-21aa3430d57f" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:43:00 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] snapshot: 32a4ac7d-0a5d-4f5a-a45c-76931c1cdc5b, volume: df4e0a34-9fac-4919-8b23-21aa3430d57f, {{(pid=93788) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 16:43:00 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-43eb264a-eb03-42c4-a820-004f4bd64a02 tempest-VolumeDependencyTests-1788693032 None] Created volume successfully. Jun 23 16:43:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:43:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:43:00 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:43:00 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:43:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:43:00 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-678886bc-52a6-4511-8da7-0d55bc7f6aa9 tempest-VolumesSnapshotListTestJSON-1859349725 None] Acquiring lock "cinder-82317c58-f962-4544-b260-6e95b9f6322b-delete_snapshot" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:43:00 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e6bb38-19e2-4ed5-8379-324982b2680d]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:43:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c.32a4ac7d-0a5d-4f5a-a45c-76931c1cdc5b {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:00 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-678886bc-52a6-4511-8da7-0d55bc7f6aa9 tempest-VolumesSnapshotListTestJSON-1859349725 None] Lock "cinder-82317c58-f962-4544-b260-6e95b9f6322b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:43:00 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-678886bc-52a6-4511-8da7-0d55bc7f6aa9 tempest-VolumesSnapshotListTestJSON-1859349725 None] Acquiring lock "cinder-quobyte-e0775578-9730-4128-a566-9dc7226fc2fa" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:43:00 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-678886bc-52a6-4511-8da7-0d55bc7f6aa9 tempest-VolumesSnapshotListTestJSON-1859349725 None] Lock "cinder-quobyte-e0775578-9730-4128-a566-9dc7226fc2fa" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:43:00 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-678886bc-52a6-4511-8da7-0d55bc7f6aa9 tempest-VolumesSnapshotListTestJSON-1859349725 None] Acquiring lock "cinder-quobyte-82317c58-f962-4544-b260-6e95b9f6322b" by "_delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:43:00 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-678886bc-52a6-4511-8da7-0d55bc7f6aa9 tempest-VolumesSnapshotListTestJSON-1859349725 None] Lock "cinder-quobyte-82317c58-f962-4544-b260-6e95b9f6322b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:43:00 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-678886bc-52a6-4511-8da7-0d55bc7f6aa9 tempest-VolumesSnapshotListTestJSON-1859349725 None] Deleting offline snapshot 82317c58-f962-4544-b260-6e95b9f6322b of volume e0775578-9730-4128-a566-9dc7226fc2fa {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:43:00 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-678886bc-52a6-4511-8da7-0d55bc7f6aa9 tempest-VolumesSnapshotListTestJSON-1859349725 None] snapshot_file for this snap is: volume-e0775578-9730-4128-a566-9dc7226fc2fa.82317c58-f962-4544-b260-6e95b9f6322b {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:43:00 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1764a8d2-72e8-473a-ada5-8b7d2b4904f5]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:43:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-678886bc-52a6-4511-8da7-0d55bc7f6aa9 tempest-VolumesSnapshotListTestJSON-1859349725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.82317c58-f962-4544-b260-6e95b9f6322b {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:00 devstack sudo[108396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c.32a4ac7d-0a5d-4f5a-a45c-76931c1cdc5b Jun 23 16:43:00 devstack sudo[108396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:00 devstack sudo[108397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.82317c58-f962-4544-b260-6e95b9f6322b Jun 23 16:43:00 devstack sudo[108397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-15d9db55-d9e5-4579-8e16-3ebd33d3c1e0 tempest-VolumeDependencyTests-1788693032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:43:01 devstack sudo[108396]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c.32a4ac7d-0a5d-4f5a-a45c-76931c1cdc5b" returned: 0 in 0.920s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:43:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c {{(pid=93788) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 16:43:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] Creating direct copy from snapshot {{(pid=93788) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 16:43:01 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f1c344-ec47-40f1-b044-aec208f6cfa7]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:43:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:01 devstack sudo[108397]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-678886bc-52a6-4511-8da7-0d55bc7f6aa9 tempest-VolumesSnapshotListTestJSON-1859349725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.82317c58-f962-4544-b260-6e95b9f6322b" returned: 0 in 0.932s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-678886bc-52a6-4511-8da7-0d55bc7f6aa9 tempest-VolumesSnapshotListTestJSON-1859349725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0775578-9730-4128-a566-9dc7226fc2fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:43:01 devstack sudo[108409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c Jun 23 16:43:01 devstack sudo[108409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:01 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[de280249-20a6-41ad-9d01-4d180491c3e6]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:43:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-678886bc-52a6-4511-8da7-0d55bc7f6aa9 tempest-VolumesSnapshotListTestJSON-1859349725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.3289f398-3e22-45da-ac15-5a2db1d3b965 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:01 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:43:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:43:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:43:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:43:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:43:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:43:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:01 devstack sudo[108412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:43:01 devstack sudo[108412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:01 devstack sudo[108411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.3289f398-3e22-45da-ac15-5a2db1d3b965 Jun 23 16:43:01 devstack sudo[108411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:02 devstack sudo[108409]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c" returned: 0 in 0.869s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:02 devstack cinder-volume[93788]: DEBUG cinder.utils [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] Path /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-df4e0a34-9fac-4919-8b23-21aa3430d57f not found in is_blk_device check {{(pid=93788) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 16:43:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-df4e0a34-9fac-4919-8b23-21aa3430d57f {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:02 devstack sudo[108425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-df4e0a34-9fac-4919-8b23-21aa3430d57f Jun 23 16:43:02 devstack sudo[108425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:02 devstack sudo[108412]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.716s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:02 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:43:02 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager._thread_info {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:43:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread count: 28 {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 16:43:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread info: [<_MainThread(MainThread, started 126303828988032)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 16:43:02 devstack sudo[108411]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-678886bc-52a6-4511-8da7-0d55bc7f6aa9 tempest-VolumesSnapshotListTestJSON-1859349725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.3289f398-3e22-45da-ac15-5a2db1d3b965" returned: 0 in 0.889s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:02 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-678886bc-52a6-4511-8da7-0d55bc7f6aa9 tempest-VolumesSnapshotListTestJSON-1859349725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0775578-9730-4128-a566-9dc7226fc2fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:43:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-678886bc-52a6-4511-8da7-0d55bc7f6aa9 tempest-VolumesSnapshotListTestJSON-1859349725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.82317c58-f962-4544-b260-6e95b9f6322b {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:02 devstack sudo[108427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.82317c58-f962-4544-b260-6e95b9f6322b Jun 23 16:43:02 devstack sudo[108427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:03 devstack sudo[108427]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-678886bc-52a6-4511-8da7-0d55bc7f6aa9 tempest-VolumesSnapshotListTestJSON-1859349725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.82317c58-f962-4544-b260-6e95b9f6322b" returned: 0 in 1.283s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-678886bc-52a6-4511-8da7-0d55bc7f6aa9 tempest-VolumesSnapshotListTestJSON-1859349725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.82317c58-f962-4544-b260-6e95b9f6322b {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:03 devstack sudo[108442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.82317c58-f962-4544-b260-6e95b9f6322b Jun 23 16:43:03 devstack sudo[108442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:04 devstack sudo[108442]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-678886bc-52a6-4511-8da7-0d55bc7f6aa9 tempest-VolumesSnapshotListTestJSON-1859349725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.82317c58-f962-4544-b260-6e95b9f6322b" returned: 0 in 1.356s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:04 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-678886bc-52a6-4511-8da7-0d55bc7f6aa9 tempest-VolumesSnapshotListTestJSON-1859349725 None] Lock "cinder-quobyte-82317c58-f962-4544-b260-6e95b9f6322b" released by "_delete_snapshot" :: held 4.625s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:43:04 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-678886bc-52a6-4511-8da7-0d55bc7f6aa9 tempest-VolumesSnapshotListTestJSON-1859349725 None] Lock "cinder-quobyte-e0775578-9730-4128-a566-9dc7226fc2fa" released by "delete_snapshot" :: held 4.662s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:43:05 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-678886bc-52a6-4511-8da7-0d55bc7f6aa9 tempest-VolumesSnapshotListTestJSON-1859349725 None] Created reservations ['359a170c-85ba-4973-a172-2231062076b1', '48b1ed4b-48b5-4fd1-b2e9-e2ccd989c0f1', '96039526-a0df-40ed-88b5-60a50499c12b', '5d1e7f68-ba54-4f58-9340-c21625a13f2b'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:43:05 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-678886bc-52a6-4511-8da7-0d55bc7f6aa9 tempest-VolumesSnapshotListTestJSON-1859349725 None] Delete snapshot completed successfully. Jun 23 16:43:05 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-678886bc-52a6-4511-8da7-0d55bc7f6aa9 tempest-VolumesSnapshotListTestJSON-1859349725 None] Lock "cinder-82317c58-f962-4544-b260-6e95b9f6322b-delete_snapshot" released by "delete_snapshot" :: held 5.030s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:43:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-f58b7521-f8fd-4d80-9fe0-cacb8d1bec3e req-3f9c75a3-60cf-40b8-8c63-aca419bf0609 tempest-TestServerVolumeAttachmentScenario-12948084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:43:05 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-7ab8102f-bdcd-40d3-a802-95169f50f504 tempest-VolumesSnapshotListTestJSON-1859349725 None] Acquiring lock "cinder-3289f398-3e22-45da-ac15-5a2db1d3b965-delete_snapshot" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:43:05 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-7ab8102f-bdcd-40d3-a802-95169f50f504 tempest-VolumesSnapshotListTestJSON-1859349725 None] Lock "cinder-3289f398-3e22-45da-ac15-5a2db1d3b965-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:43:05 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-7ab8102f-bdcd-40d3-a802-95169f50f504 tempest-VolumesSnapshotListTestJSON-1859349725 None] Acquiring lock "cinder-quobyte-e0775578-9730-4128-a566-9dc7226fc2fa" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:43:05 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-7ab8102f-bdcd-40d3-a802-95169f50f504 tempest-VolumesSnapshotListTestJSON-1859349725 None] Lock "cinder-quobyte-e0775578-9730-4128-a566-9dc7226fc2fa" acquired by "delete_snapshot" :: waited 0.037s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:43:05 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-7ab8102f-bdcd-40d3-a802-95169f50f504 tempest-VolumesSnapshotListTestJSON-1859349725 None] Acquiring lock "cinder-quobyte-3289f398-3e22-45da-ac15-5a2db1d3b965" by "_delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:43:05 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-7ab8102f-bdcd-40d3-a802-95169f50f504 tempest-VolumesSnapshotListTestJSON-1859349725 None] Lock "cinder-quobyte-3289f398-3e22-45da-ac15-5a2db1d3b965" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:43:05 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-7ab8102f-bdcd-40d3-a802-95169f50f504 tempest-VolumesSnapshotListTestJSON-1859349725 None] Deleting offline snapshot 3289f398-3e22-45da-ac15-5a2db1d3b965 of volume e0775578-9730-4128-a566-9dc7226fc2fa {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:43:05 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-7ab8102f-bdcd-40d3-a802-95169f50f504 tempest-VolumesSnapshotListTestJSON-1859349725 None] snapshot_file for this snap is: volume-e0775578-9730-4128-a566-9dc7226fc2fa.3289f398-3e22-45da-ac15-5a2db1d3b965 {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:43:05 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[07896d77-3f6a-411e-8966-5b9773615e81]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:43:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-7ab8102f-bdcd-40d3-a802-95169f50f504 tempest-VolumesSnapshotListTestJSON-1859349725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.3289f398-3e22-45da-ac15-5a2db1d3b965 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:06 devstack sudo[108454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.3289f398-3e22-45da-ac15-5a2db1d3b965 Jun 23 16:43:06 devstack sudo[108454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:07 devstack sudo[108454]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-7ab8102f-bdcd-40d3-a802-95169f50f504 tempest-VolumesSnapshotListTestJSON-1859349725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.3289f398-3e22-45da-ac15-5a2db1d3b965" returned: 0 in 1.694s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:07 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-7ab8102f-bdcd-40d3-a802-95169f50f504 tempest-VolumesSnapshotListTestJSON-1859349725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0775578-9730-4128-a566-9dc7226fc2fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:43:07 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23c7d98-a9b3-4b7a-874b-e727fc045cd8]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:43:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-7ab8102f-bdcd-40d3-a802-95169f50f504 tempest-VolumesSnapshotListTestJSON-1859349725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.6898da04-f841-4f9a-86e6-71e6fd2f39b8 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:07 devstack sudo[108425]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-df4e0a34-9fac-4919-8b23-21aa3430d57f" returned: 0 in 5.729s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:07 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[75be62f6-30cd-4f6b-9d12-185535187bbd]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:43:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:07 devstack sudo[108459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.6898da04-f841-4f9a-86e6-71e6fd2f39b8 Jun 23 16:43:07 devstack sudo[108459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:07 devstack sudo[108460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c Jun 23 16:43:07 devstack sudo[108460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:08 devstack sudo[108459]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-7ab8102f-bdcd-40d3-a802-95169f50f504 tempest-VolumesSnapshotListTestJSON-1859349725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.6898da04-f841-4f9a-86e6-71e6fd2f39b8" returned: 0 in 0.766s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:08 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-7ab8102f-bdcd-40d3-a802-95169f50f504 tempest-VolumesSnapshotListTestJSON-1859349725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0775578-9730-4128-a566-9dc7226fc2fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:43:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-7ab8102f-bdcd-40d3-a802-95169f50f504 tempest-VolumesSnapshotListTestJSON-1859349725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.3289f398-3e22-45da-ac15-5a2db1d3b965 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:08 devstack sudo[108468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.3289f398-3e22-45da-ac15-5a2db1d3b965 Jun 23 16:43:08 devstack sudo[108468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:08 devstack sudo[108460]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c" returned: 0 in 0.981s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:08 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] Image conversion details: src /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c, size 1024.00 MB, duration 5.73 sec, destination /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-df4e0a34-9fac-4919-8b23-21aa3430d57f {{(pid=93788) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 16:43:08 devstack cinder-volume[93788]: INFO cinder.image.image_utils [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] Converted 1024.00 MB image at 178.69 MB/s Jun 23 16:43:08 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-df4e0a34-9fac-4919-8b23-21aa3430d57f is being set with open permissions: ugo+rw Jun 23 16:43:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-df4e0a34-9fac-4919-8b23-21aa3430d57f {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:08 devstack sudo[108471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-df4e0a34-9fac-4919-8b23-21aa3430d57f Jun 23 16:43:08 devstack sudo[108471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:09 devstack sudo[108468]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-7ab8102f-bdcd-40d3-a802-95169f50f504 tempest-VolumesSnapshotListTestJSON-1859349725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.3289f398-3e22-45da-ac15-5a2db1d3b965" returned: 0 in 0.805s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-7ab8102f-bdcd-40d3-a802-95169f50f504 tempest-VolumesSnapshotListTestJSON-1859349725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.3289f398-3e22-45da-ac15-5a2db1d3b965 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:09 devstack sudo[108477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.3289f398-3e22-45da-ac15-5a2db1d3b965 Jun 23 16:43:09 devstack sudo[108477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:09 devstack sudo[108471]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-df4e0a34-9fac-4919-8b23-21aa3430d57f" returned: 0 in 0.675s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:09 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "cinder-quobyte-df4e0a34-9fac-4919-8b23-21aa3430d57f" released by "_copy_volume_from_snapshot" :: held 9.304s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:43:09 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "cinder-quobyte-32a4ac7d-0a5d-4f5a-a45c-76931c1cdc5b-df4e0a34-9fac-4919-8b23-21aa3430d57f" released by "_create_volume_from_snapshot" :: held 9.362s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:43:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.395s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:43:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-15d9db55-d9e5-4579-8e16-3ebd33d3c1e0 tempest-VolumeDependencyTests-1788693032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.852s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:43:09 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-15d9db55-d9e5-4579-8e16-3ebd33d3c1e0 tempest-VolumeDependencyTests-1788693032 None] Creating offline snapshot d801331a-3e8c-4ec9-b656-6b6a2e5ef3e2 of volume 0182cd5f-4e03-4bcd-96d9-73c33ac44caf {{(pid=93788) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:43:09 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49152919-b3a9-42eb-bc93-322a79e78413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df4e0a34-9fac-4919-8b23-21aa3430d57f', 'volume_size': 2, 'snapshot_id': '32a4ac7d-0a5d-4f5a-a45c-76931c1cdc5b'}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:43:09 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d3e5310-8339-46b8-9d42-b3cc505b4e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:43:09 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[4533db19-2fab-4ef3-9118-56fc9402bc17]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:43:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-15d9db55-d9e5-4579-8e16-3ebd33d3c1e0 tempest-VolumeDependencyTests-1788693032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:09 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] Volume volume-df4e0a34-9fac-4919-8b23-21aa3430d57f (df4e0a34-9fac-4919-8b23-21aa3430d57f): created successfully Jun 23 16:43:09 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d3e5310-8339-46b8-9d42-b3cc505b4e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:43:09 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] Flow 'volume_create_manager' (12627b4b-3058-4f4a-8e02-cbcea1f0631a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:43:09 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-e90842cf-177e-4cfc-bf5c-227258b1cd8b tempest-VolumesSnapshotTestJSON-1537803418 None] Created volume successfully. Jun 23 16:43:09 devstack sudo[108480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf Jun 23 16:43:09 devstack sudo[108480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:09 devstack sudo[108477]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-7ab8102f-bdcd-40d3-a802-95169f50f504 tempest-VolumesSnapshotListTestJSON-1859349725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.3289f398-3e22-45da-ac15-5a2db1d3b965" returned: 0 in 0.648s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:09 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-7ab8102f-bdcd-40d3-a802-95169f50f504 tempest-VolumesSnapshotListTestJSON-1859349725 None] Lock "cinder-quobyte-3289f398-3e22-45da-ac15-5a2db1d3b965" released by "_delete_snapshot" :: held 4.101s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:43:09 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-7ab8102f-bdcd-40d3-a802-95169f50f504 tempest-VolumesSnapshotListTestJSON-1859349725 None] Lock "cinder-quobyte-e0775578-9730-4128-a566-9dc7226fc2fa" released by "delete_snapshot" :: held 4.149s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:43:10 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-7ab8102f-bdcd-40d3-a802-95169f50f504 tempest-VolumesSnapshotListTestJSON-1859349725 None] Created reservations ['8337f989-bf9e-4589-a357-6306ce975c07', '1cd02721-ff93-4386-80fd-9301b85e6392', '92d5f542-e8dd-4150-8be4-f2acb3aeb8cf', 'dbb2b4ec-3d7d-484b-abd8-fe8b9a26f720'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:43:10 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-3e428a99-ed57-4e38-a914-a5be4ccddd41 tempest-VolumesSnapshotTestJSON-1537803418 None] Acquiring lock "cinder-df4e0a34-9fac-4919-8b23-21aa3430d57f-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:43:10 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-3e428a99-ed57-4e38-a914-a5be4ccddd41 tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "cinder-df4e0a34-9fac-4919-8b23-21aa3430d57f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:43:10 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-7ab8102f-bdcd-40d3-a802-95169f50f504 tempest-VolumesSnapshotListTestJSON-1859349725 None] Delete snapshot completed successfully. Jun 23 16:43:10 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-7ab8102f-bdcd-40d3-a802-95169f50f504 tempest-VolumesSnapshotListTestJSON-1859349725 None] Lock "cinder-3289f398-3e22-45da-ac15-5a2db1d3b965-delete_snapshot" released by "delete_snapshot" :: held 4.368s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:43:10 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-3e428a99-ed57-4e38-a914-a5be4ccddd41 tempest-VolumesSnapshotTestJSON-1537803418 None] Acquiring lock "cinder-quobyte-df4e0a34-9fac-4919-8b23-21aa3430d57f" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:43:10 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-3e428a99-ed57-4e38-a914-a5be4ccddd41 tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "cinder-quobyte-df4e0a34-9fac-4919-8b23-21aa3430d57f" acquired by "delete_volume" :: waited 0.019s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:43:10 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce6e97b-7ea8-42e8-9219-e6ee82f84d19]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:43:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-3e428a99-ed57-4e38-a914-a5be4ccddd41 tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-df4e0a34-9fac-4919-8b23-21aa3430d57f {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:10 devstack sudo[108480]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-15d9db55-d9e5-4579-8e16-3ebd33d3c1e0 tempest-VolumeDependencyTests-1788693032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf" returned: 0 in 0.819s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-15d9db55-d9e5-4579-8e16-3ebd33d3c1e0 tempest-VolumeDependencyTests-1788693032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf.d801331a-3e8c-4ec9-b656-6b6a2e5ef3e2 1G {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:10 devstack sudo[108486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-df4e0a34-9fac-4919-8b23-21aa3430d57f Jun 23 16:43:10 devstack sudo[108486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:10 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-36267ea8-01a1-4ffb-93fd-bdcfb7efc909 tempest-VolumesSnapshotListTestJSON-1859349725 None] Acquiring lock "cinder-6898da04-f841-4f9a-86e6-71e6fd2f39b8-delete_snapshot" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:43:10 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-36267ea8-01a1-4ffb-93fd-bdcfb7efc909 tempest-VolumesSnapshotListTestJSON-1859349725 None] Lock "cinder-6898da04-f841-4f9a-86e6-71e6fd2f39b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:43:10 devstack sudo[108488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf.d801331a-3e8c-4ec9-b656-6b6a2e5ef3e2 1G Jun 23 16:43:10 devstack sudo[108488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:10 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-36267ea8-01a1-4ffb-93fd-bdcfb7efc909 tempest-VolumesSnapshotListTestJSON-1859349725 None] Acquiring lock "cinder-quobyte-e0775578-9730-4128-a566-9dc7226fc2fa" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:43:10 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-36267ea8-01a1-4ffb-93fd-bdcfb7efc909 tempest-VolumesSnapshotListTestJSON-1859349725 None] Lock "cinder-quobyte-e0775578-9730-4128-a566-9dc7226fc2fa" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:43:10 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-36267ea8-01a1-4ffb-93fd-bdcfb7efc909 tempest-VolumesSnapshotListTestJSON-1859349725 None] Acquiring lock "cinder-quobyte-6898da04-f841-4f9a-86e6-71e6fd2f39b8" by "_delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:43:10 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-36267ea8-01a1-4ffb-93fd-bdcfb7efc909 tempest-VolumesSnapshotListTestJSON-1859349725 None] Lock "cinder-quobyte-6898da04-f841-4f9a-86e6-71e6fd2f39b8" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:43:10 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-36267ea8-01a1-4ffb-93fd-bdcfb7efc909 tempest-VolumesSnapshotListTestJSON-1859349725 None] Deleting offline snapshot 6898da04-f841-4f9a-86e6-71e6fd2f39b8 of volume e0775578-9730-4128-a566-9dc7226fc2fa {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:43:10 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-36267ea8-01a1-4ffb-93fd-bdcfb7efc909 tempest-VolumesSnapshotListTestJSON-1859349725 None] snapshot_file for this snap is: volume-e0775578-9730-4128-a566-9dc7226fc2fa.6898da04-f841-4f9a-86e6-71e6fd2f39b8 {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:43:10 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[87265e93-7011-4cd2-bace-238a19d4a078]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:43:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-36267ea8-01a1-4ffb-93fd-bdcfb7efc909 tempest-VolumesSnapshotListTestJSON-1859349725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.6898da04-f841-4f9a-86e6-71e6fd2f39b8 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:10 devstack sudo[108490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.6898da04-f841-4f9a-86e6-71e6fd2f39b8 Jun 23 16:43:10 devstack sudo[108490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:11 devstack sudo[108486]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-3e428a99-ed57-4e38-a914-a5be4ccddd41 tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-df4e0a34-9fac-4919-8b23-21aa3430d57f" returned: 0 in 0.853s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-3e428a99-ed57-4e38-a914-a5be4ccddd41 tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-df4e0a34-9fac-4919-8b23-21aa3430d57f {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:11 devstack sudo[108499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-df4e0a34-9fac-4919-8b23-21aa3430d57f Jun 23 16:43:11 devstack sudo[108499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:11 devstack sudo[108488]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-15d9db55-d9e5-4579-8e16-3ebd33d3c1e0 tempest-VolumeDependencyTests-1788693032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf.d801331a-3e8c-4ec9-b656-6b6a2e5ef3e2 1G" returned: 0 in 0.932s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-15d9db55-d9e5-4579-8e16-3ebd33d3c1e0 tempest-VolumeDependencyTests-1788693032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf.d801331a-3e8c-4ec9-b656-6b6a2e5ef3e2 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:11 devstack sudo[108505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf.d801331a-3e8c-4ec9-b656-6b6a2e5ef3e2 Jun 23 16:43:11 devstack sudo[108505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:11 devstack sudo[108490]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-36267ea8-01a1-4ffb-93fd-bdcfb7efc909 tempest-VolumesSnapshotListTestJSON-1859349725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.6898da04-f841-4f9a-86e6-71e6fd2f39b8" returned: 0 in 0.904s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:11 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-36267ea8-01a1-4ffb-93fd-bdcfb7efc909 tempest-VolumesSnapshotListTestJSON-1859349725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0775578-9730-4128-a566-9dc7226fc2fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:43:11 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce977984-53ca-4c29-b76d-32d552ad6549]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:43:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-36267ea8-01a1-4ffb-93fd-bdcfb7efc909 tempest-VolumesSnapshotListTestJSON-1859349725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:11 devstack sudo[108507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa Jun 23 16:43:11 devstack sudo[108507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:11 devstack sudo[108499]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-3e428a99-ed57-4e38-a914-a5be4ccddd41 tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-df4e0a34-9fac-4919-8b23-21aa3430d57f" returned: 0 in 0.690s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:11 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-3e428a99-ed57-4e38-a914-a5be4ccddd41 tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "cinder-quobyte-df4e0a34-9fac-4919-8b23-21aa3430d57f" released by "delete_volume" :: held 1.586s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:43:11 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-3e428a99-ed57-4e38-a914-a5be4ccddd41 tempest-VolumesSnapshotTestJSON-1537803418 None] Created reservations ['45c5444d-3bfc-4972-95da-873d19e71a0e', '47c2eda9-6727-4fe2-aa81-472ff1f1a9de', '0dec52ea-80f4-47aa-a6b3-6e367e989a32', '218c9765-1d38-4cb7-b321-fd5059174e6d'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:43:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-3e428a99-ed57-4e38-a914-a5be4ccddd41 tempest-VolumesSnapshotTestJSON-1537803418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:43:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-3e428a99-ed57-4e38-a914-a5be4ccddd41 tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:43:11 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-3e428a99-ed57-4e38-a914-a5be4ccddd41 tempest-VolumesSnapshotTestJSON-1537803418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:43:11 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-3e428a99-ed57-4e38-a914-a5be4ccddd41 tempest-VolumesSnapshotTestJSON-1537803418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:43:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-3e428a99-ed57-4e38-a914-a5be4ccddd41 tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:43:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-3e428a99-ed57-4e38-a914-a5be4ccddd41 tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:11 devstack sudo[108514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:43:11 devstack sudo[108514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:12 devstack sudo[108505]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-15d9db55-d9e5-4579-8e16-3ebd33d3c1e0 tempest-VolumeDependencyTests-1788693032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf.d801331a-3e8c-4ec9-b656-6b6a2e5ef3e2" returned: 0 in 0.736s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:12 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-15d9db55-d9e5-4579-8e16-3ebd33d3c1e0 tempest-VolumeDependencyTests-1788693032 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf.d801331a-3e8c-4ec9-b656-6b6a2e5ef3e2 is being set with open permissions: ugo+rw Jun 23 16:43:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-15d9db55-d9e5-4579-8e16-3ebd33d3c1e0 tempest-VolumeDependencyTests-1788693032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf.d801331a-3e8c-4ec9-b656-6b6a2e5ef3e2 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:12 devstack sudo[108516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf.d801331a-3e8c-4ec9-b656-6b6a2e5ef3e2 Jun 23 16:43:12 devstack sudo[108516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:12 devstack sudo[108507]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-36267ea8-01a1-4ffb-93fd-bdcfb7efc909 tempest-VolumesSnapshotListTestJSON-1859349725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa" returned: 0 in 0.831s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-36267ea8-01a1-4ffb-93fd-bdcfb7efc909 tempest-VolumesSnapshotListTestJSON-1859349725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.6898da04-f841-4f9a-86e6-71e6fd2f39b8 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:12 devstack sudo[108521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.6898da04-f841-4f9a-86e6-71e6fd2f39b8 Jun 23 16:43:12 devstack sudo[108521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:12 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-c9867cfb-3969-4754-a338-40df13f81d9d tempest-VolumesSnapshotTestJSON-1537803418 None] Acquiring lock "cinder-32a4ac7d-0a5d-4f5a-a45c-76931c1cdc5b-delete_snapshot" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:43:12 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-c9867cfb-3969-4754-a338-40df13f81d9d tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "cinder-32a4ac7d-0a5d-4f5a-a45c-76931c1cdc5b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:43:12 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-c9867cfb-3969-4754-a338-40df13f81d9d tempest-VolumesSnapshotTestJSON-1537803418 None] Acquiring lock "cinder-quobyte-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:43:12 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-c9867cfb-3969-4754-a338-40df13f81d9d tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "cinder-quobyte-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c" acquired by "delete_snapshot" :: waited 0.038s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:43:12 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-c9867cfb-3969-4754-a338-40df13f81d9d tempest-VolumesSnapshotTestJSON-1537803418 None] Acquiring lock "cinder-quobyte-32a4ac7d-0a5d-4f5a-a45c-76931c1cdc5b" by "_delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:43:12 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-c9867cfb-3969-4754-a338-40df13f81d9d tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "cinder-quobyte-32a4ac7d-0a5d-4f5a-a45c-76931c1cdc5b" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:43:12 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-c9867cfb-3969-4754-a338-40df13f81d9d tempest-VolumesSnapshotTestJSON-1537803418 None] Deleting offline snapshot 32a4ac7d-0a5d-4f5a-a45c-76931c1cdc5b of volume e8f9d6e3-cfcb-4d59-a3a9-ce707606935c {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:43:12 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-c9867cfb-3969-4754-a338-40df13f81d9d tempest-VolumesSnapshotTestJSON-1537803418 None] snapshot_file for this snap is: volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c.32a4ac7d-0a5d-4f5a-a45c-76931c1cdc5b {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:43:12 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[44039265-0955-4ed6-a3bb-0b1dd67a8803]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:43:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c9867cfb-3969-4754-a338-40df13f81d9d tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c.32a4ac7d-0a5d-4f5a-a45c-76931c1cdc5b {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:12 devstack sudo[108514]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-3e428a99-ed57-4e38-a914-a5be4ccddd41 tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.725s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:12 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-3e428a99-ed57-4e38-a914-a5be4ccddd41 tempest-VolumesSnapshotTestJSON-1537803418 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:43:12 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-3e428a99-ed57-4e38-a914-a5be4ccddd41 tempest-VolumesSnapshotTestJSON-1537803418 None] Deleted volume successfully. Jun 23 16:43:12 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-3e428a99-ed57-4e38-a914-a5be4ccddd41 tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "cinder-df4e0a34-9fac-4919-8b23-21aa3430d57f-delete_volume" released by "delete_volume" :: held 2.555s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:43:12 devstack sudo[108516]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-15d9db55-d9e5-4579-8e16-3ebd33d3c1e0 tempest-VolumeDependencyTests-1788693032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf.d801331a-3e8c-4ec9-b656-6b6a2e5ef3e2" returned: 0 in 0.727s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:12 devstack sudo[108525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c.32a4ac7d-0a5d-4f5a-a45c-76931c1cdc5b Jun 23 16:43:12 devstack sudo[108525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-15d9db55-d9e5-4579-8e16-3ebd33d3c1e0 tempest-VolumeDependencyTests-1788693032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:12 devstack sudo[108527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf.info Jun 23 16:43:12 devstack sudo[108527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:13 devstack sudo[108521]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-36267ea8-01a1-4ffb-93fd-bdcfb7efc909 tempest-VolumesSnapshotListTestJSON-1859349725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.6898da04-f841-4f9a-86e6-71e6fd2f39b8" returned: 0 in 0.860s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-36267ea8-01a1-4ffb-93fd-bdcfb7efc909 tempest-VolumesSnapshotListTestJSON-1859349725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.6898da04-f841-4f9a-86e6-71e6fd2f39b8 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:13 devstack sudo[108532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.6898da04-f841-4f9a-86e6-71e6fd2f39b8 Jun 23 16:43:13 devstack sudo[108532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:13 devstack sudo[108525]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c9867cfb-3969-4754-a338-40df13f81d9d tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c.32a4ac7d-0a5d-4f5a-a45c-76931c1cdc5b" returned: 0 in 0.846s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:13 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-c9867cfb-3969-4754-a338-40df13f81d9d tempest-VolumesSnapshotTestJSON-1537803418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:43:13 devstack sudo[108527]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-15d9db55-d9e5-4579-8e16-3ebd33d3c1e0 tempest-VolumeDependencyTests-1788693032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf.info" returned: 0 in 0.705s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:13 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-15d9db55-d9e5-4579-8e16-3ebd33d3c1e0 tempest-VolumeDependencyTests-1788693032 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf.info is being set with open permissions: ugo+rw Jun 23 16:43:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-15d9db55-d9e5-4579-8e16-3ebd33d3c1e0 tempest-VolumeDependencyTests-1788693032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:13 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c2358e-f8fb-4a5e-8411-1e376676dff0]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:43:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c9867cfb-3969-4754-a338-40df13f81d9d tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:13 devstack sudo[108538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf.info Jun 23 16:43:13 devstack sudo[108538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:13 devstack sudo[108539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c Jun 23 16:43:13 devstack sudo[108539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:13 devstack sudo[108532]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-36267ea8-01a1-4ffb-93fd-bdcfb7efc909 tempest-VolumesSnapshotListTestJSON-1859349725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa.6898da04-f841-4f9a-86e6-71e6fd2f39b8" returned: 0 in 0.670s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:13 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-36267ea8-01a1-4ffb-93fd-bdcfb7efc909 tempest-VolumesSnapshotListTestJSON-1859349725 None] Lock "cinder-quobyte-6898da04-f841-4f9a-86e6-71e6fd2f39b8" released by "_delete_snapshot" :: held 3.404s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:43:13 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-36267ea8-01a1-4ffb-93fd-bdcfb7efc909 tempest-VolumesSnapshotListTestJSON-1859349725 None] Lock "cinder-quobyte-e0775578-9730-4128-a566-9dc7226fc2fa" released by "delete_snapshot" :: held 3.435s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:43:13 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-36267ea8-01a1-4ffb-93fd-bdcfb7efc909 tempest-VolumesSnapshotListTestJSON-1859349725 None] Created reservations ['c3dd7453-f9f6-4aa4-bb22-d8163b46a99d', 'f460fbba-c15a-480e-aa30-0a5d9799cfe5', 'de128598-a081-4af5-9c68-c598f154d1dd', 'ae02403c-d190-456c-befc-b5d3b86432c9'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:43:13 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-36267ea8-01a1-4ffb-93fd-bdcfb7efc909 tempest-VolumesSnapshotListTestJSON-1859349725 None] Delete snapshot completed successfully. Jun 23 16:43:13 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-36267ea8-01a1-4ffb-93fd-bdcfb7efc909 tempest-VolumesSnapshotListTestJSON-1859349725 None] Lock "cinder-6898da04-f841-4f9a-86e6-71e6fd2f39b8-delete_snapshot" released by "delete_snapshot" :: held 3.586s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:43:14 devstack sudo[108538]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-15d9db55-d9e5-4579-8e16-3ebd33d3c1e0 tempest-VolumeDependencyTests-1788693032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf.info" returned: 0 in 0.687s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-15d9db55-d9e5-4579-8e16-3ebd33d3c1e0 tempest-VolumeDependencyTests-1788693032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.716s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:43:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-f58b7521-f8fd-4d80-9fe0-cacb8d1bec3e req-3f9c75a3-60cf-40b8-8c63-aca419bf0609 tempest-TestServerVolumeAttachmentScenario-12948084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.681s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:43:14 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c82aff-0f2a-4549-bf0e-0d64010722f8]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:43:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-f58b7521-f8fd-4d80-9fe0-cacb8d1bec3e req-3f9c75a3-60cf-40b8-8c63-aca419bf0609 tempest-TestServerVolumeAttachmentScenario-12948084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-40ea7b4e-cdef-4b1b-b367-4151f8eb4a61 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:14 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-15d9db55-d9e5-4579-8e16-3ebd33d3c1e0 tempest-VolumeDependencyTests-1788693032 None] Create snapshot completed successfully Jun 23 16:43:14 devstack sudo[108539]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c9867cfb-3969-4754-a338-40df13f81d9d tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c" returned: 0 in 0.813s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c9867cfb-3969-4754-a338-40df13f81d9d tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c.32a4ac7d-0a5d-4f5a-a45c-76931c1cdc5b {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:14 devstack sudo[108549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-40ea7b4e-cdef-4b1b-b367-4151f8eb4a61 Jun 23 16:43:14 devstack sudo[108549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:14 devstack sudo[108550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c.32a4ac7d-0a5d-4f5a-a45c-76931c1cdc5b Jun 23 16:43:14 devstack sudo[108550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:15 devstack sudo[108549]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-f58b7521-f8fd-4d80-9fe0-cacb8d1bec3e req-3f9c75a3-60cf-40b8-8c63-aca419bf0609 tempest-TestServerVolumeAttachmentScenario-12948084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-40ea7b4e-cdef-4b1b-b367-4151f8eb4a61" returned: 0 in 0.823s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-f58b7521-f8fd-4d80-9fe0-cacb8d1bec3e req-3f9c75a3-60cf-40b8-8c63-aca419bf0609 tempest-TestServerVolumeAttachmentScenario-12948084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.843s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:43:15 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-f58b7521-f8fd-4d80-9fe0-cacb8d1bec3e req-3f9c75a3-60cf-40b8-8c63-aca419bf0609 tempest-TestServerVolumeAttachmentScenario-12948084 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e', 'name': 'volume-40ea7b4e-cdef-4b1b-b367-4151f8eb4a61', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b7c7faaa-522c-46ef-91c0-92c4dc609020', 'enforce_multipath': True} {{(pid=93788) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 16:43:15 devstack sudo[108550]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c9867cfb-3969-4754-a338-40df13f81d9d tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c.32a4ac7d-0a5d-4f5a-a45c-76931c1cdc5b" returned: 0 in 0.791s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c9867cfb-3969-4754-a338-40df13f81d9d tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c.32a4ac7d-0a5d-4f5a-a45c-76931c1cdc5b {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:15 devstack sudo[108563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c.32a4ac7d-0a5d-4f5a-a45c-76931c1cdc5b Jun 23 16:43:15 devstack sudo[108563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:15 devstack cinder-volume[93788]: INFO cinder.volume.manager [req-f58b7521-f8fd-4d80-9fe0-cacb8d1bec3e req-3f9c75a3-60cf-40b8-8c63-aca419bf0609 tempest-TestServerVolumeAttachmentScenario-12948084 None] attachment_update completed successfully. Jun 23 16:43:15 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-f037a451-293f-4494-8ebf-c3ff070e57e0 tempest-VolumesSnapshotListTestJSON-1859349725 None] Acquiring lock "cinder-e0775578-9730-4128-a566-9dc7226fc2fa-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:43:15 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:43:15 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-f037a451-293f-4494-8ebf-c3ff070e57e0 tempest-VolumesSnapshotListTestJSON-1859349725 None] Lock "cinder-e0775578-9730-4128-a566-9dc7226fc2fa-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:43:15 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] Flow 'volume_create_manager' (22ce45ec-8d5e-402d-86d0-717fc79fad38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:43:15 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94ae5d57-ad7c-482b-8755-60d2355ad8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:43:15 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94ae5d57-ad7c-482b-8755-60d2355ad8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1347559482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8919e8db-86db-4c5f-a37d-e86d77589cda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='707addd997ef483e90e2a2760828c4e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d801331a-3e8c-4ec9-b656-6b6a2e5ef3e2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:43:15Z,use_quota=True,user_id='0f342aa541ae4a07865a59b734021fda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:43:15 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (721bb1bd-1bfe-4d3a-8b3b-c508d90e9718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:43:15 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (721bb1bd-1bfe-4d3a-8b3b-c508d90e9718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:43:15 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8beb838-2594-4822-981e-ad1e5c961dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:43:15 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8beb838-2594-4822-981e-ad1e5c961dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8919e8db-86db-4c5f-a37d-e86d77589cda', 'volume_name': 'volume-8919e8db-86db-4c5f-a37d-e86d77589cda', 'volume_size': 1, 'snapshot_id': 'd801331a-3e8c-4ec9-b656-6b6a2e5ef3e2'}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:43:15 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b4c3a27-4108-4c46-99c3-852c63385727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:43:15 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b4c3a27-4108-4c46-99c3-852c63385727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:43:15 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32c3a7ad-6371-4a84-837a-8ccae3e88f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:43:15 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] Volume 8919e8db-86db-4c5f-a37d-e86d77589cda: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8919e8db-86db-4c5f-a37d-e86d77589cda', 'volume_size': 1, 'snapshot_id': 'd801331a-3e8c-4ec9-b656-6b6a2e5ef3e2'} Jun 23 16:43:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:43:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:43:15 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] Acquiring lock "cinder-quobyte-d801331a-3e8c-4ec9-b656-6b6a2e5ef3e2-8919e8db-86db-4c5f-a37d-e86d77589cda" by "_create_volume_from_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:43:15 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-f037a451-293f-4494-8ebf-c3ff070e57e0 tempest-VolumesSnapshotListTestJSON-1859349725 None] Acquiring lock "cinder-quobyte-e0775578-9730-4128-a566-9dc7226fc2fa" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:43:15 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] Lock "cinder-quobyte-d801331a-3e8c-4ec9-b656-6b6a2e5ef3e2-8919e8db-86db-4c5f-a37d-e86d77589cda" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:43:15 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] Creating volume 8919e8db-86db-4c5f-a37d-e86d77589cda from snapshot d801331a-3e8c-4ec9-b656-6b6a2e5ef3e2 {{(pid=93788) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 16:43:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:43:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:43:15 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:43:15 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:43:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:43:15 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:43:15 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] Acquiring lock "cinder-quobyte-8919e8db-86db-4c5f-a37d-e86d77589cda" by "_copy_volume_from_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:43:15 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-f037a451-293f-4494-8ebf-c3ff070e57e0 tempest-VolumesSnapshotListTestJSON-1859349725 None] Lock "cinder-quobyte-e0775578-9730-4128-a566-9dc7226fc2fa" acquired by "delete_volume" :: waited 0.035s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:43:15 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] Lock "cinder-quobyte-8919e8db-86db-4c5f-a37d-e86d77589cda" acquired by "_copy_volume_from_snapshot" :: waited 0.051s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:43:15 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] snapshot: d801331a-3e8c-4ec9-b656-6b6a2e5ef3e2, volume: 8919e8db-86db-4c5f-a37d-e86d77589cda, {{(pid=93788) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 16:43:15 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28fdc37-c7ec-44b4-becb-6c5349470438]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:43:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f037a451-293f-4494-8ebf-c3ff070e57e0 tempest-VolumesSnapshotListTestJSON-1859349725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:43:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:43:15 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:43:15 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:43:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:43:15 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[9166aec3-2c2a-47ae-9474-bb2495bf8d3d]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:43:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf.d801331a-3e8c-4ec9-b656-6b6a2e5ef3e2 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:15 devstack sudo[108566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa Jun 23 16:43:15 devstack sudo[108566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:15 devstack sudo[108589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf.d801331a-3e8c-4ec9-b656-6b6a2e5ef3e2 Jun 23 16:43:15 devstack sudo[108589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:15 devstack sudo[108563]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c9867cfb-3969-4754-a338-40df13f81d9d tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c.32a4ac7d-0a5d-4f5a-a45c-76931c1cdc5b" returned: 0 in 0.818s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:15 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-c9867cfb-3969-4754-a338-40df13f81d9d tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "cinder-quobyte-32a4ac7d-0a5d-4f5a-a45c-76931c1cdc5b" released by "_delete_snapshot" :: held 3.390s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:43:15 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-c9867cfb-3969-4754-a338-40df13f81d9d tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "cinder-quobyte-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c" released by "delete_snapshot" :: held 3.424s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:43:16 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-c9867cfb-3969-4754-a338-40df13f81d9d tempest-VolumesSnapshotTestJSON-1537803418 None] Created reservations ['e984c326-35f3-4315-aaf3-d97ec735e925', 'f9882d8f-22fb-4351-9f14-eb2bd7437c1b', '552e596b-ebcb-4f8e-b4b7-fc07f969f78f', '63507722-7827-4e5a-95a1-88cd3df953eb'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:43:16 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-c9867cfb-3969-4754-a338-40df13f81d9d tempest-VolumesSnapshotTestJSON-1537803418 None] Delete snapshot completed successfully. Jun 23 16:43:16 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-c9867cfb-3969-4754-a338-40df13f81d9d tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "cinder-32a4ac7d-0a5d-4f5a-a45c-76931c1cdc5b-delete_snapshot" released by "delete_snapshot" :: held 3.612s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:43:16 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b6a67028-dfb5-4206-9c0d-ffc2d77ce264 tempest-VolumesSnapshotTestJSON-1537803418 None] Acquiring lock "cinder-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:43:16 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b6a67028-dfb5-4206-9c0d-ffc2d77ce264 tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "cinder-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:43:16 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b6a67028-dfb5-4206-9c0d-ffc2d77ce264 tempest-VolumesSnapshotTestJSON-1537803418 None] Acquiring lock "cinder-quobyte-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:43:16 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b6a67028-dfb5-4206-9c0d-ffc2d77ce264 tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "cinder-quobyte-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c" acquired by "delete_volume" :: waited 0.041s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:43:16 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5ac76c-c9d2-4f33-92c6-3680045618f8]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:43:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b6a67028-dfb5-4206-9c0d-ffc2d77ce264 tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:16 devstack sudo[108589]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf.d801331a-3e8c-4ec9-b656-6b6a2e5ef3e2" returned: 0 in 0.874s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:16 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:43:16 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf {{(pid=93788) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 16:43:16 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] Creating direct copy from snapshot {{(pid=93788) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 16:43:16 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d614b8-bf0b-434a-b8e2-05f815fb0a32]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:43:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:16 devstack sudo[108566]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f037a451-293f-4494-8ebf-c3ff070e57e0 tempest-VolumesSnapshotListTestJSON-1859349725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa" returned: 0 in 1.011s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f037a451-293f-4494-8ebf-c3ff070e57e0 tempest-VolumesSnapshotListTestJSON-1859349725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:16 devstack sudo[108962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa Jun 23 16:43:16 devstack sudo[108962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:16 devstack sudo[108959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c Jun 23 16:43:16 devstack sudo[108959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:16 devstack sudo[108961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf Jun 23 16:43:16 devstack sudo[108961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:17 devstack sudo[108959]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b6a67028-dfb5-4206-9c0d-ffc2d77ce264 tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c" returned: 0 in 0.867s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b6a67028-dfb5-4206-9c0d-ffc2d77ce264 tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:17 devstack sudo[108962]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f037a451-293f-4494-8ebf-c3ff070e57e0 tempest-VolumesSnapshotListTestJSON-1859349725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e0775578-9730-4128-a566-9dc7226fc2fa" returned: 0 in 0.795s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:17 devstack sudo[108961]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf" returned: 0 in 0.852s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:17 devstack sudo[108975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c Jun 23 16:43:17 devstack sudo[108975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:17 devstack cinder-volume[93788]: DEBUG cinder.utils [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] Path /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-8919e8db-86db-4c5f-a37d-e86d77589cda not found in is_blk_device check {{(pid=93788) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 16:43:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-8919e8db-86db-4c5f-a37d-e86d77589cda {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:17 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-f037a451-293f-4494-8ebf-c3ff070e57e0 tempest-VolumesSnapshotListTestJSON-1859349725 None] Lock "cinder-quobyte-e0775578-9730-4128-a566-9dc7226fc2fa" released by "delete_volume" :: held 1.900s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:43:17 devstack sudo[108977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-8919e8db-86db-4c5f-a37d-e86d77589cda Jun 23 16:43:17 devstack sudo[108977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:17 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-f037a451-293f-4494-8ebf-c3ff070e57e0 tempest-VolumesSnapshotListTestJSON-1859349725 None] Created reservations ['1c7de89e-343c-4f24-9ce2-93be55bd8949', '2117077a-4fc8-4f91-ae0c-b96aba072dab', 'a7ff16bd-1b45-4b65-a1b0-b7f3035adab3', '0bd5f776-d1f9-44c1-b481-71b94a1b2cb4'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:43:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f037a451-293f-4494-8ebf-c3ff070e57e0 tempest-VolumesSnapshotListTestJSON-1859349725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:43:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f037a451-293f-4494-8ebf-c3ff070e57e0 tempest-VolumesSnapshotListTestJSON-1859349725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:43:17 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-f037a451-293f-4494-8ebf-c3ff070e57e0 tempest-VolumesSnapshotListTestJSON-1859349725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:43:17 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-f037a451-293f-4494-8ebf-c3ff070e57e0 tempest-VolumesSnapshotListTestJSON-1859349725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:43:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f037a451-293f-4494-8ebf-c3ff070e57e0 tempest-VolumesSnapshotListTestJSON-1859349725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:43:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f037a451-293f-4494-8ebf-c3ff070e57e0 tempest-VolumesSnapshotListTestJSON-1859349725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:17 devstack sudo[108979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:43:17 devstack sudo[108979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:18 devstack sudo[108975]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:18 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b6a67028-dfb5-4206-9c0d-ffc2d77ce264 tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c" returned: 0 in 0.739s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:18 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b6a67028-dfb5-4206-9c0d-ffc2d77ce264 tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "cinder-quobyte-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c" released by "delete_volume" :: held 1.696s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:43:18 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-b6a67028-dfb5-4206-9c0d-ffc2d77ce264 tempest-VolumesSnapshotTestJSON-1537803418 None] Created reservations ['0ab367f9-d975-499c-9c47-c0c1b3aefe33', 'f1b4adb9-0cd1-4cdf-8b87-f7e024c4957f', '0fa1b6d6-c619-40ba-aa75-ae895e13b4cb', '79b6d359-8235-455b-93b6-1732412fbd6f'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:43:18 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b6a67028-dfb5-4206-9c0d-ffc2d77ce264 tempest-VolumesSnapshotTestJSON-1537803418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:43:18 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b6a67028-dfb5-4206-9c0d-ffc2d77ce264 tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:43:18 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b6a67028-dfb5-4206-9c0d-ffc2d77ce264 tempest-VolumesSnapshotTestJSON-1537803418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:43:18 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b6a67028-dfb5-4206-9c0d-ffc2d77ce264 tempest-VolumesSnapshotTestJSON-1537803418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:43:18 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b6a67028-dfb5-4206-9c0d-ffc2d77ce264 tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:43:18 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b6a67028-dfb5-4206-9c0d-ffc2d77ce264 tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:18 devstack sudo[108979]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:18 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f037a451-293f-4494-8ebf-c3ff070e57e0 tempest-VolumesSnapshotListTestJSON-1859349725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.696s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:18 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-f037a451-293f-4494-8ebf-c3ff070e57e0 tempest-VolumesSnapshotListTestJSON-1859349725 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:43:18 devstack sudo[108986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:43:18 devstack sudo[108986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:18 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-f037a451-293f-4494-8ebf-c3ff070e57e0 tempest-VolumesSnapshotListTestJSON-1859349725 None] Deleted volume successfully. Jun 23 16:43:18 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-f037a451-293f-4494-8ebf-c3ff070e57e0 tempest-VolumesSnapshotListTestJSON-1859349725 None] Lock "cinder-e0775578-9730-4128-a566-9dc7226fc2fa-delete_volume" released by "delete_volume" :: held 3.001s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:43:19 devstack sudo[108986]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:19 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b6a67028-dfb5-4206-9c0d-ffc2d77ce264 tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.379s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:19 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-b6a67028-dfb5-4206-9c0d-ffc2d77ce264 tempest-VolumesSnapshotTestJSON-1537803418 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:43:19 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-b6a67028-dfb5-4206-9c0d-ffc2d77ce264 tempest-VolumesSnapshotTestJSON-1537803418 None] Deleted volume successfully. Jun 23 16:43:19 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b6a67028-dfb5-4206-9c0d-ffc2d77ce264 tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "cinder-e8f9d6e3-cfcb-4d59-a3a9-ce707606935c-delete_volume" released by "delete_volume" :: held 3.429s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:43:20 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-af91330a-dab1-49c0-8940-7c50a91deec4 tempest-VolumesSnapshotTestJSON-1537803418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:43:20 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-af91330a-dab1-49c0-8940-7c50a91deec4 tempest-VolumesSnapshotTestJSON-1537803418 None] Flow 'volume_create_manager' (3711bc3e-9f6f-4185-b5a5-33639d5d8fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:43:20 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-af91330a-dab1-49c0-8940-7c50a91deec4 tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00409098-f57f-4ce7-8cbe-c171d9082e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:43:20 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-af91330a-dab1-49c0-8940-7c50a91deec4 tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00409098-f57f-4ce7-8cbe-c171d9082e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2009478418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d8b37cc-c124-415c-b709-04a55796b45c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd0b61ecd544df9a4720fb512a61494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:43:20Z,use_quota=True,user_id='dc863f468a064fdca543394f9e0a10c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:43:20 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-af91330a-dab1-49c0-8940-7c50a91deec4 tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0fcaa3d-8640-4140-a6fc-7bbc0742ea9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:43:20 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-af91330a-dab1-49c0-8940-7c50a91deec4 tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0fcaa3d-8640-4140-a6fc-7bbc0742ea9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:43:20 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-af91330a-dab1-49c0-8940-7c50a91deec4 tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68ee131e-8f28-4360-b779-68d22e7f9dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:43:20 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-af91330a-dab1-49c0-8940-7c50a91deec4 tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68ee131e-8f28-4360-b779-68d22e7f9dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d8b37cc-c124-415c-b709-04a55796b45c', 'volume_name': 'volume-1d8b37cc-c124-415c-b709-04a55796b45c', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:43:20 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-af91330a-dab1-49c0-8940-7c50a91deec4 tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f892070a-cfd4-4088-9595-211a08f17ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:43:20 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-af91330a-dab1-49c0-8940-7c50a91deec4 tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f892070a-cfd4-4088-9595-211a08f17ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:43:20 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-af91330a-dab1-49c0-8940-7c50a91deec4 tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (349e4ece-b9e2-4929-ae00-11714d4884f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:43:20 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-af91330a-dab1-49c0-8940-7c50a91deec4 tempest-VolumesSnapshotTestJSON-1537803418 None] Volume 1d8b37cc-c124-415c-b709-04a55796b45c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d8b37cc-c124-415c-b709-04a55796b45c', 'volume_size': 1} Jun 23 16:43:20 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-af91330a-dab1-49c0-8940-7c50a91deec4 tempest-VolumesSnapshotTestJSON-1537803418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:43:23 devstack sudo[108977]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-8919e8db-86db-4c5f-a37d-e86d77589cda" returned: 0 in 6.607s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:23 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[824356d5-0ddb-491b-a06e-c626d14342ed]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:43:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:24 devstack sudo[108999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf Jun 23 16:43:24 devstack sudo[108999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:25 devstack sudo[108999]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf" returned: 0 in 1.064s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:25 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] Image conversion details: src /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf, size 1024.00 MB, duration 6.61 sec, destination /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-8919e8db-86db-4c5f-a37d-e86d77589cda {{(pid=93788) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 16:43:25 devstack cinder-volume[93788]: INFO cinder.image.image_utils [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] Converted 1024.00 MB image at 154.96 MB/s Jun 23 16:43:25 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-8919e8db-86db-4c5f-a37d-e86d77589cda is being set with open permissions: ugo+rw Jun 23 16:43:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-8919e8db-86db-4c5f-a37d-e86d77589cda {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:25 devstack sudo[109004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-8919e8db-86db-4c5f-a37d-e86d77589cda Jun 23 16:43:25 devstack sudo[109004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:25 devstack sudo[109004]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-8919e8db-86db-4c5f-a37d-e86d77589cda" returned: 0 in 0.762s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:25 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] Lock "cinder-quobyte-8919e8db-86db-4c5f-a37d-e86d77589cda" released by "_copy_volume_from_snapshot" :: held 10.312s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:43:25 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] Lock "cinder-quobyte-d801331a-3e8c-4ec9-b656-6b6a2e5ef3e2-8919e8db-86db-4c5f-a37d-e86d77589cda" released by "_create_volume_from_snapshot" :: held 10.386s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:43:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.413s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:43:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-af91330a-dab1-49c0-8940-7c50a91deec4 tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.927s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:43:25 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-af91330a-dab1-49c0-8940-7c50a91deec4 tempest-VolumesSnapshotTestJSON-1537803418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2009478418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d8b37cc-c124-415c-b709-04a55796b45c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd0b61ecd544df9a4720fb512a61494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:43:20Z,use_quota=True,user_id='dc863f468a064fdca543394f9e0a10c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:43:25 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-af91330a-dab1-49c0-8940-7c50a91deec4 tempest-VolumesSnapshotTestJSON-1537803418 None] Creating volume 1d8b37cc-c124-415c-b709-04a55796b45c {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:43:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-af91330a-dab1-49c0-8940-7c50a91deec4 tempest-VolumesSnapshotTestJSON-1537803418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:43:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-af91330a-dab1-49c0-8940-7c50a91deec4 tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:43:25 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-af91330a-dab1-49c0-8940-7c50a91deec4 tempest-VolumesSnapshotTestJSON-1537803418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:43:25 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-af91330a-dab1-49c0-8940-7c50a91deec4 tempest-VolumesSnapshotTestJSON-1537803418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:43:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-af91330a-dab1-49c0-8940-7c50a91deec4 tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:43:25 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-af91330a-dab1-49c0-8940-7c50a91deec4 tempest-VolumesSnapshotTestJSON-1537803418 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:43:25 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-af91330a-dab1-49c0-8940-7c50a91deec4 tempest-VolumesSnapshotTestJSON-1537803418 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:43:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-af91330a-dab1-49c0-8940-7c50a91deec4 tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:25 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:UPDATE=150,cinder:SELECT=132,cinder:INSERT=38,cinder:DELETE=12 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:43:25 devstack sudo[109010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c 1073741824 Jun 23 16:43:25 devstack sudo[109010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:25 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32c3a7ad-6371-4a84-837a-8ccae3e88f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8919e8db-86db-4c5f-a37d-e86d77589cda', 'volume_size': 1, 'snapshot_id': 'd801331a-3e8c-4ec9-b656-6b6a2e5ef3e2'}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:43:25 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5e54eff-348e-4349-86c9-9bd244264635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:43:25 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] Volume volume-8919e8db-86db-4c5f-a37d-e86d77589cda (8919e8db-86db-4c5f-a37d-e86d77589cda): created successfully Jun 23 16:43:25 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5e54eff-348e-4349-86c9-9bd244264635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:43:25 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] Flow 'volume_create_manager' (22ce45ec-8d5e-402d-86d0-717fc79fad38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:43:26 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-4d57a9be-08de-4069-9563-3b07cb28aefc tempest-VolumeDependencyTests-1788693032 None] Created volume successfully. Jun 23 16:43:26 devstack sudo[109010]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-af91330a-dab1-49c0-8940-7c50a91deec4 tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c 1073741824" returned: 0 in 0.968s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-af91330a-dab1-49c0-8940-7c50a91deec4 tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:26 devstack sudo[109016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c Jun 23 16:43:26 devstack sudo[109016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:26 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-33aed971-0062-4371-b8c6-3ccae4640ecc tempest-VolumeDependencyTests-1788693032 None] Acquiring lock "cinder-d801331a-3e8c-4ec9-b656-6b6a2e5ef3e2-delete_snapshot" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:43:26 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-33aed971-0062-4371-b8c6-3ccae4640ecc tempest-VolumeDependencyTests-1788693032 None] Lock "cinder-d801331a-3e8c-4ec9-b656-6b6a2e5ef3e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:43:26 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-33aed971-0062-4371-b8c6-3ccae4640ecc tempest-VolumeDependencyTests-1788693032 None] Acquiring lock "cinder-quobyte-0182cd5f-4e03-4bcd-96d9-73c33ac44caf" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:43:27 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-33aed971-0062-4371-b8c6-3ccae4640ecc tempest-VolumeDependencyTests-1788693032 None] Lock "cinder-quobyte-0182cd5f-4e03-4bcd-96d9-73c33ac44caf" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:43:27 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-33aed971-0062-4371-b8c6-3ccae4640ecc tempest-VolumeDependencyTests-1788693032 None] Acquiring lock "cinder-quobyte-d801331a-3e8c-4ec9-b656-6b6a2e5ef3e2" by "_delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:43:27 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-33aed971-0062-4371-b8c6-3ccae4640ecc tempest-VolumeDependencyTests-1788693032 None] Lock "cinder-quobyte-d801331a-3e8c-4ec9-b656-6b6a2e5ef3e2" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:43:27 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-33aed971-0062-4371-b8c6-3ccae4640ecc tempest-VolumeDependencyTests-1788693032 None] Deleting offline snapshot d801331a-3e8c-4ec9-b656-6b6a2e5ef3e2 of volume 0182cd5f-4e03-4bcd-96d9-73c33ac44caf {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:43:27 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-33aed971-0062-4371-b8c6-3ccae4640ecc tempest-VolumeDependencyTests-1788693032 None] snapshot_file for this snap is: volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf.d801331a-3e8c-4ec9-b656-6b6a2e5ef3e2 {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:43:27 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb2ba69-2cea-488f-9239-7c008c2fadf1]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:43:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-33aed971-0062-4371-b8c6-3ccae4640ecc tempest-VolumeDependencyTests-1788693032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf.d801331a-3e8c-4ec9-b656-6b6a2e5ef3e2 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:27 devstack sudo[109018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf.d801331a-3e8c-4ec9-b656-6b6a2e5ef3e2 Jun 23 16:43:27 devstack sudo[109018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:27 devstack sudo[109016]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-af91330a-dab1-49c0-8940-7c50a91deec4 tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c" returned: 0 in 0.785s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:27 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-af91330a-dab1-49c0-8940-7c50a91deec4 tempest-VolumesSnapshotTestJSON-1537803418 None] <== create_volume: return (1815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:43:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-af91330a-dab1-49c0-8940-7c50a91deec4 tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.822s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:43:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-af91330a-dab1-49c0-8940-7c50a91deec4 tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (349e4ece-b9e2-4929-ae00-11714d4884f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d8b37cc-c124-415c-b709-04a55796b45c', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:43:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-af91330a-dab1-49c0-8940-7c50a91deec4 tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d48fd804-652d-4d20-8290-db0d57c84865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:43:27 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-af91330a-dab1-49c0-8940-7c50a91deec4 tempest-VolumesSnapshotTestJSON-1537803418 None] Volume volume-1d8b37cc-c124-415c-b709-04a55796b45c (1d8b37cc-c124-415c-b709-04a55796b45c): created successfully Jun 23 16:43:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-af91330a-dab1-49c0-8940-7c50a91deec4 tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d48fd804-652d-4d20-8290-db0d57c84865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:43:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-af91330a-dab1-49c0-8940-7c50a91deec4 tempest-VolumesSnapshotTestJSON-1537803418 None] Flow 'volume_create_manager' (3711bc3e-9f6f-4185-b5a5-33639d5d8fb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:43:27 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-af91330a-dab1-49c0-8940-7c50a91deec4 tempest-VolumesSnapshotTestJSON-1537803418 None] Created volume successfully. Jun 23 16:43:27 devstack sudo[109018]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-33aed971-0062-4371-b8c6-3ccae4640ecc tempest-VolumeDependencyTests-1788693032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf.d801331a-3e8c-4ec9-b656-6b6a2e5ef3e2" returned: 0 in 0.833s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:27 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-33aed971-0062-4371-b8c6-3ccae4640ecc tempest-VolumeDependencyTests-1788693032 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:43:27 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ff30cb-ed3b-492f-bd5e-182694ef5e05]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:43:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-33aed971-0062-4371-b8c6-3ccae4640ecc tempest-VolumeDependencyTests-1788693032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:28 devstack sudo[109024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf Jun 23 16:43:28 devstack sudo[109024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-7f4adb4b-35a9-4544-858e-c52f24a6e872 tempest-VolumesSnapshotTestJSON-1537803418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:43:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-7f4adb4b-35a9-4544-858e-c52f24a6e872 tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:43:28 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-7f4adb4b-35a9-4544-858e-c52f24a6e872 tempest-VolumesSnapshotTestJSON-1537803418 None] Creating offline snapshot 136822a8-479d-4399-8cfd-2cc5274bbb4f of volume 1d8b37cc-c124-415c-b709-04a55796b45c {{(pid=93788) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:43:28 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33ca44b-438c-48d2-a724-7fd664704f97]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:43:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-7f4adb4b-35a9-4544-858e-c52f24a6e872 tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:28 devstack sudo[109026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c Jun 23 16:43:28 devstack sudo[109026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:28 devstack sudo[109024]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-33aed971-0062-4371-b8c6-3ccae4640ecc tempest-VolumeDependencyTests-1788693032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf" returned: 0 in 0.970s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-33aed971-0062-4371-b8c6-3ccae4640ecc tempest-VolumeDependencyTests-1788693032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf.d801331a-3e8c-4ec9-b656-6b6a2e5ef3e2 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:28 devstack sudo[109040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf.d801331a-3e8c-4ec9-b656-6b6a2e5ef3e2 Jun 23 16:43:28 devstack sudo[109040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-3d1ab5f1-d7a7-414e-b354-4d45d12fc4d8 req-19ef509a-b4e9-4028-9ac1-cc337ddd9dbd tempest-TestServerVolumeAttachmentScenario-12948084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:43:29 devstack sudo[109026]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-7f4adb4b-35a9-4544-858e-c52f24a6e872 tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c" returned: 0 in 1.037s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-7f4adb4b-35a9-4544-858e-c52f24a6e872 tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c.136822a8-479d-4399-8cfd-2cc5274bbb4f 1G {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:29 devstack sudo[109046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c.136822a8-479d-4399-8cfd-2cc5274bbb4f 1G Jun 23 16:43:29 devstack sudo[109046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:29 devstack sudo[109040]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-33aed971-0062-4371-b8c6-3ccae4640ecc tempest-VolumeDependencyTests-1788693032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf.d801331a-3e8c-4ec9-b656-6b6a2e5ef3e2" returned: 0 in 1.060s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-33aed971-0062-4371-b8c6-3ccae4640ecc tempest-VolumeDependencyTests-1788693032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf.d801331a-3e8c-4ec9-b656-6b6a2e5ef3e2 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:30 devstack sudo[109050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf.d801331a-3e8c-4ec9-b656-6b6a2e5ef3e2 Jun 23 16:43:30 devstack sudo[109050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:30 devstack sudo[109046]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-7f4adb4b-35a9-4544-858e-c52f24a6e872 tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c.136822a8-479d-4399-8cfd-2cc5274bbb4f 1G" returned: 0 in 1.066s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-7f4adb4b-35a9-4544-858e-c52f24a6e872 tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d8b37cc-c124-415c-b709-04a55796b45c -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c.136822a8-479d-4399-8cfd-2cc5274bbb4f {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:30 devstack sudo[109056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d8b37cc-c124-415c-b709-04a55796b45c -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c.136822a8-479d-4399-8cfd-2cc5274bbb4f Jun 23 16:43:30 devstack sudo[109056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:30 devstack sudo[109050]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-33aed971-0062-4371-b8c6-3ccae4640ecc tempest-VolumeDependencyTests-1788693032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf.d801331a-3e8c-4ec9-b656-6b6a2e5ef3e2" returned: 0 in 0.882s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:30 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-33aed971-0062-4371-b8c6-3ccae4640ecc tempest-VolumeDependencyTests-1788693032 None] Lock "cinder-quobyte-d801331a-3e8c-4ec9-b656-6b6a2e5ef3e2" released by "_delete_snapshot" :: held 3.902s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:43:30 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-33aed971-0062-4371-b8c6-3ccae4640ecc tempest-VolumeDependencyTests-1788693032 None] Lock "cinder-quobyte-0182cd5f-4e03-4bcd-96d9-73c33ac44caf" released by "delete_snapshot" :: held 3.941s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:43:31 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-33aed971-0062-4371-b8c6-3ccae4640ecc tempest-VolumeDependencyTests-1788693032 None] Created reservations ['34306d87-cd96-4e1d-8a90-0975f9d8218f', '01ea363f-91b5-401a-9e66-1577dbdd33b9', 'e3bda175-1a77-4cb8-ad25-5ebf40da84f5', '100475ec-2353-4138-aa64-60192ad8cfde'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:43:31 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-33aed971-0062-4371-b8c6-3ccae4640ecc tempest-VolumeDependencyTests-1788693032 None] Delete snapshot completed successfully. Jun 23 16:43:31 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-33aed971-0062-4371-b8c6-3ccae4640ecc tempest-VolumeDependencyTests-1788693032 None] Lock "cinder-d801331a-3e8c-4ec9-b656-6b6a2e5ef3e2-delete_snapshot" released by "delete_snapshot" :: held 4.137s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:43:31 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-f9661a80-01ff-45ec-9c74-ec729945031e tempest-VolumeDependencyTests-1788693032 None] Acquiring lock "cinder-0182cd5f-4e03-4bcd-96d9-73c33ac44caf-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:43:31 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-f9661a80-01ff-45ec-9c74-ec729945031e tempest-VolumeDependencyTests-1788693032 None] Lock "cinder-0182cd5f-4e03-4bcd-96d9-73c33ac44caf-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:43:31 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-f9661a80-01ff-45ec-9c74-ec729945031e tempest-VolumeDependencyTests-1788693032 None] Acquiring lock "cinder-quobyte-0182cd5f-4e03-4bcd-96d9-73c33ac44caf" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:43:31 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-f9661a80-01ff-45ec-9c74-ec729945031e tempest-VolumeDependencyTests-1788693032 None] Lock "cinder-quobyte-0182cd5f-4e03-4bcd-96d9-73c33ac44caf" acquired by "delete_volume" :: waited 0.016s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:43:31 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f227491-be64-413d-b12b-7744e4280d9b]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:43:31 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f9661a80-01ff-45ec-9c74-ec729945031e tempest-VolumeDependencyTests-1788693032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:31 devstack sudo[109060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf Jun 23 16:43:31 devstack sudo[109060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:31 devstack sudo[109056]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:31 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-7f4adb4b-35a9-4544-858e-c52f24a6e872 tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d8b37cc-c124-415c-b709-04a55796b45c -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c.136822a8-479d-4399-8cfd-2cc5274bbb4f" returned: 0 in 1.094s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:31 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-7f4adb4b-35a9-4544-858e-c52f24a6e872 tempest-VolumesSnapshotTestJSON-1537803418 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c.136822a8-479d-4399-8cfd-2cc5274bbb4f is being set with open permissions: ugo+rw Jun 23 16:43:31 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-7f4adb4b-35a9-4544-858e-c52f24a6e872 tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c.136822a8-479d-4399-8cfd-2cc5274bbb4f {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:31 devstack sudo[109065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c.136822a8-479d-4399-8cfd-2cc5274bbb4f Jun 23 16:43:31 devstack sudo[109065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:32 devstack sudo[109060]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f9661a80-01ff-45ec-9c74-ec729945031e tempest-VolumeDependencyTests-1788693032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf" returned: 0 in 1.110s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f9661a80-01ff-45ec-9c74-ec729945031e tempest-VolumeDependencyTests-1788693032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:32 devstack sudo[109080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf Jun 23 16:43:32 devstack sudo[109080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:32 devstack sudo[109065]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-7f4adb4b-35a9-4544-858e-c52f24a6e872 tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c.136822a8-479d-4399-8cfd-2cc5274bbb4f" returned: 0 in 0.914s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-7f4adb4b-35a9-4544-858e-c52f24a6e872 tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:32 devstack sudo[109082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c.info Jun 23 16:43:32 devstack sudo[109082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:33 devstack sudo[109080]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:33 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f9661a80-01ff-45ec-9c74-ec729945031e tempest-VolumeDependencyTests-1788693032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-0182cd5f-4e03-4bcd-96d9-73c33ac44caf" returned: 0 in 0.815s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:33 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-f9661a80-01ff-45ec-9c74-ec729945031e tempest-VolumeDependencyTests-1788693032 None] Lock "cinder-quobyte-0182cd5f-4e03-4bcd-96d9-73c33ac44caf" released by "delete_volume" :: held 2.020s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:43:33 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-f9661a80-01ff-45ec-9c74-ec729945031e tempest-VolumeDependencyTests-1788693032 None] Created reservations ['1863ba5c-2d32-49d3-b07d-2415a29f5831', '784d5273-a06b-4b90-9a1a-3d183c4845d0', '9e521644-24f1-4277-8b9d-689d4a95c4f2', 'bed3c1b3-dd4d-4fbb-b558-957d98f6fcfd'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:43:33 devstack sudo[109082]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:33 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-7f4adb4b-35a9-4544-858e-c52f24a6e872 tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c.info" returned: 0 in 0.774s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:33 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-7f4adb4b-35a9-4544-858e-c52f24a6e872 tempest-VolumesSnapshotTestJSON-1537803418 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c.info is being set with open permissions: ugo+rw Jun 23 16:43:33 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-7f4adb4b-35a9-4544-858e-c52f24a6e872 tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:33 devstack sudo[109086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c.info Jun 23 16:43:33 devstack sudo[109086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:33 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f9661a80-01ff-45ec-9c74-ec729945031e tempest-VolumeDependencyTests-1788693032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:43:33 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f9661a80-01ff-45ec-9c74-ec729945031e tempest-VolumeDependencyTests-1788693032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:43:33 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-f9661a80-01ff-45ec-9c74-ec729945031e tempest-VolumeDependencyTests-1788693032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:43:33 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-f9661a80-01ff-45ec-9c74-ec729945031e tempest-VolumeDependencyTests-1788693032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:43:33 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f9661a80-01ff-45ec-9c74-ec729945031e tempest-VolumeDependencyTests-1788693032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:43:33 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f9661a80-01ff-45ec-9c74-ec729945031e tempest-VolumeDependencyTests-1788693032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:33 devstack sudo[109088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:43:33 devstack sudo[109088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:34 devstack sudo[109086]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-7f4adb4b-35a9-4544-858e-c52f24a6e872 tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c.info" returned: 0 in 0.912s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-7f4adb4b-35a9-4544-858e-c52f24a6e872 tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.937s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:43:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-3d1ab5f1-d7a7-414e-b354-4d45d12fc4d8 req-19ef509a-b4e9-4028-9ac1-cc337ddd9dbd tempest-TestServerVolumeAttachmentScenario-12948084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.322s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:43:34 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de55008-ea2a-4999-a129-c701dec41f2e]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:43:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-3d1ab5f1-d7a7-414e-b354-4d45d12fc4d8 req-19ef509a-b4e9-4028-9ac1-cc337ddd9dbd tempest-TestServerVolumeAttachmentScenario-12948084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69e2cdcc-ab99-4639-9be2-f15d69f6358e {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:34 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-7f4adb4b-35a9-4544-858e-c52f24a6e872 tempest-VolumesSnapshotTestJSON-1537803418 None] Create snapshot completed successfully Jun 23 16:43:34 devstack sudo[109088]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f9661a80-01ff-45ec-9c74-ec729945031e tempest-VolumeDependencyTests-1788693032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.928s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:34 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-f9661a80-01ff-45ec-9c74-ec729945031e tempest-VolumeDependencyTests-1788693032 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:43:34 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-f9661a80-01ff-45ec-9c74-ec729945031e tempest-VolumeDependencyTests-1788693032 None] Deleted volume successfully. Jun 23 16:43:34 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-f9661a80-01ff-45ec-9c74-ec729945031e tempest-VolumeDependencyTests-1788693032 None] Lock "cinder-0182cd5f-4e03-4bcd-96d9-73c33ac44caf-delete_volume" released by "delete_volume" :: held 3.233s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:43:34 devstack sudo[109092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69e2cdcc-ab99-4639-9be2-f15d69f6358e Jun 23 16:43:34 devstack sudo[109092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:34 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-0da5afaf-1805-430c-b308-fa2eb06ae2c1 tempest-VolumeDependencyTests-1788693032 None] Acquiring lock "cinder-8919e8db-86db-4c5f-a37d-e86d77589cda-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:43:34 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-0da5afaf-1805-430c-b308-fa2eb06ae2c1 tempest-VolumeDependencyTests-1788693032 None] Lock "cinder-8919e8db-86db-4c5f-a37d-e86d77589cda-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:43:34 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-0da5afaf-1805-430c-b308-fa2eb06ae2c1 tempest-VolumeDependencyTests-1788693032 None] Acquiring lock "cinder-quobyte-8919e8db-86db-4c5f-a37d-e86d77589cda" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:43:34 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-0da5afaf-1805-430c-b308-fa2eb06ae2c1 tempest-VolumeDependencyTests-1788693032 None] Lock "cinder-quobyte-8919e8db-86db-4c5f-a37d-e86d77589cda" acquired by "delete_volume" :: waited 0.030s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:43:34 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab340070-ad8d-4308-940d-eaed96ac5c70]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:43:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0da5afaf-1805-430c-b308-fa2eb06ae2c1 tempest-VolumeDependencyTests-1788693032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-8919e8db-86db-4c5f-a37d-e86d77589cda {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:34 devstack sudo[109094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-8919e8db-86db-4c5f-a37d-e86d77589cda Jun 23 16:43:34 devstack sudo[109094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:35 devstack sudo[109092]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-3d1ab5f1-d7a7-414e-b354-4d45d12fc4d8 req-19ef509a-b4e9-4028-9ac1-cc337ddd9dbd tempest-TestServerVolumeAttachmentScenario-12948084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69e2cdcc-ab99-4639-9be2-f15d69f6358e" returned: 0 in 1.017s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-3d1ab5f1-d7a7-414e-b354-4d45d12fc4d8 req-19ef509a-b4e9-4028-9ac1-cc337ddd9dbd tempest-TestServerVolumeAttachmentScenario-12948084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.051s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:43:35 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-3d1ab5f1-d7a7-414e-b354-4d45d12fc4d8 req-19ef509a-b4e9-4028-9ac1-cc337ddd9dbd tempest-TestServerVolumeAttachmentScenario-12948084 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e', 'name': 'volume-69e2cdcc-ab99-4639-9be2-f15d69f6358e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1a1ac2af-8671-4f21-8892-7d75c4cc2eab', 'enforce_multipath': True} {{(pid=93788) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 16:43:35 devstack cinder-volume[93788]: INFO cinder.volume.manager [req-3d1ab5f1-d7a7-414e-b354-4d45d12fc4d8 req-19ef509a-b4e9-4028-9ac1-cc337ddd9dbd tempest-TestServerVolumeAttachmentScenario-12948084 None] attachment_update completed successfully. Jun 23 16:43:35 devstack sudo[109094]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0da5afaf-1805-430c-b308-fa2eb06ae2c1 tempest-VolumeDependencyTests-1788693032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-8919e8db-86db-4c5f-a37d-e86d77589cda" returned: 0 in 0.981s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0da5afaf-1805-430c-b308-fa2eb06ae2c1 tempest-VolumeDependencyTests-1788693032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-8919e8db-86db-4c5f-a37d-e86d77589cda {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:35 devstack sudo[109126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-8919e8db-86db-4c5f-a37d-e86d77589cda Jun 23 16:43:35 devstack sudo[109126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:35 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:43:35 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] Flow 'volume_create_manager' (3049e41a-01d8-42d5-a51a-7c5463612611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:43:35 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0ee8335-ff5b-4771-8f45-564c74167a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:43:35 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0ee8335-ff5b-4771-8f45-564c74167a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1949494276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34a8624d-adbd-4506-a8b3-0d8387c5764b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd0b61ecd544df9a4720fb512a61494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=136822a8-479d-4399-8cfd-2cc5274bbb4f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:43:36Z,use_quota=True,user_id='dc863f468a064fdca543394f9e0a10c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:43:35 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad4a793c-fbcd-4bcb-8300-8f16bfff4a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:43:35 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad4a793c-fbcd-4bcb-8300-8f16bfff4a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:43:35 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5fb7922-6bf7-4b81-b97d-8a59173a96ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:43:35 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5fb7922-6bf7-4b81-b97d-8a59173a96ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '34a8624d-adbd-4506-a8b3-0d8387c5764b', 'volume_name': 'volume-34a8624d-adbd-4506-a8b3-0d8387c5764b', 'volume_size': 1, 'snapshot_id': '136822a8-479d-4399-8cfd-2cc5274bbb4f'}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:43:35 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80de483b-0fda-4bc0-b434-93d9321a9f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:43:35 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80de483b-0fda-4bc0-b434-93d9321a9f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:43:35 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1581e6b-8035-490c-befe-7f9a300f5549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:43:35 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] Volume 34a8624d-adbd-4506-a8b3-0d8387c5764b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-34a8624d-adbd-4506-a8b3-0d8387c5764b', 'volume_size': 1, 'snapshot_id': '136822a8-479d-4399-8cfd-2cc5274bbb4f'} Jun 23 16:43:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:43:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:43:35 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] Acquiring lock "cinder-quobyte-136822a8-479d-4399-8cfd-2cc5274bbb4f-34a8624d-adbd-4506-a8b3-0d8387c5764b" by "_create_volume_from_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:43:35 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "cinder-quobyte-136822a8-479d-4399-8cfd-2cc5274bbb4f-34a8624d-adbd-4506-a8b3-0d8387c5764b" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:43:35 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] Creating volume 34a8624d-adbd-4506-a8b3-0d8387c5764b from snapshot 136822a8-479d-4399-8cfd-2cc5274bbb4f {{(pid=93788) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 16:43:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:43:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:43:35 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:43:35 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:43:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:43:35 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:43:35 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] Acquiring lock "cinder-quobyte-34a8624d-adbd-4506-a8b3-0d8387c5764b" by "_copy_volume_from_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:43:36 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "cinder-quobyte-34a8624d-adbd-4506-a8b3-0d8387c5764b" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:43:36 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] snapshot: 136822a8-479d-4399-8cfd-2cc5274bbb4f, volume: 34a8624d-adbd-4506-a8b3-0d8387c5764b, {{(pid=93788) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 16:43:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:43:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:43:36 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:43:36 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:43:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:43:36 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5873ac-1d65-4b94-bb33-50b2764eaafd]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:43:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c.136822a8-479d-4399-8cfd-2cc5274bbb4f {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:36 devstack sudo[109128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c.136822a8-479d-4399-8cfd-2cc5274bbb4f Jun 23 16:43:36 devstack sudo[109128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:36 devstack sudo[109126]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0da5afaf-1805-430c-b308-fa2eb06ae2c1 tempest-VolumeDependencyTests-1788693032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-8919e8db-86db-4c5f-a37d-e86d77589cda" returned: 0 in 0.762s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:36 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-0da5afaf-1805-430c-b308-fa2eb06ae2c1 tempest-VolumeDependencyTests-1788693032 None] Lock "cinder-quobyte-8919e8db-86db-4c5f-a37d-e86d77589cda" released by "delete_volume" :: held 1.798s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:43:36 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-0da5afaf-1805-430c-b308-fa2eb06ae2c1 tempest-VolumeDependencyTests-1788693032 None] Created reservations ['8c535cac-d406-4b4f-85f9-0a7ec17f1437', '576552b2-d06a-46b6-a2a7-29f0c0d47fc3', '0133be74-4d65-4788-8e9b-c96e084b005b', '81c5bc8b-ae1d-4b4c-bb38-ee5c10a23b1d'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:43:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-0da5afaf-1805-430c-b308-fa2eb06ae2c1 tempest-VolumeDependencyTests-1788693032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:43:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-0da5afaf-1805-430c-b308-fa2eb06ae2c1 tempest-VolumeDependencyTests-1788693032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:43:36 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-0da5afaf-1805-430c-b308-fa2eb06ae2c1 tempest-VolumeDependencyTests-1788693032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:43:36 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-0da5afaf-1805-430c-b308-fa2eb06ae2c1 tempest-VolumeDependencyTests-1788693032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:43:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-0da5afaf-1805-430c-b308-fa2eb06ae2c1 tempest-VolumeDependencyTests-1788693032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:43:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0da5afaf-1805-430c-b308-fa2eb06ae2c1 tempest-VolumeDependencyTests-1788693032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:36 devstack sudo[109132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:43:36 devstack sudo[109132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:37 devstack sudo[109128]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c.136822a8-479d-4399-8cfd-2cc5274bbb4f" returned: 0 in 1.180s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:37 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d8b37cc-c124-415c-b709-04a55796b45c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:43:37 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c {{(pid=93788) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 16:43:37 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] Creating direct copy from snapshot {{(pid=93788) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 16:43:37 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1490dcf-8e79-4185-9ed0-ee488d50dfd5]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:43:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:37 devstack sudo[109175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c Jun 23 16:43:37 devstack sudo[109175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:37 devstack sudo[109132]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0da5afaf-1805-430c-b308-fa2eb06ae2c1 tempest-VolumeDependencyTests-1788693032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.930s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:37 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-0da5afaf-1805-430c-b308-fa2eb06ae2c1 tempest-VolumeDependencyTests-1788693032 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:43:37 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-0da5afaf-1805-430c-b308-fa2eb06ae2c1 tempest-VolumeDependencyTests-1788693032 None] Deleted volume successfully. Jun 23 16:43:37 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-0da5afaf-1805-430c-b308-fa2eb06ae2c1 tempest-VolumeDependencyTests-1788693032 None] Lock "cinder-8919e8db-86db-4c5f-a37d-e86d77589cda-delete_volume" released by "delete_volume" :: held 2.996s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:43:38 devstack sudo[109175]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c" returned: 0 in 1.083s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:38 devstack cinder-volume[93788]: DEBUG cinder.utils [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] Path /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-34a8624d-adbd-4506-a8b3-0d8387c5764b not found in is_blk_device check {{(pid=93788) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 16:43:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-34a8624d-adbd-4506-a8b3-0d8387c5764b {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:38 devstack sudo[109183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-34a8624d-adbd-4506-a8b3-0d8387c5764b Jun 23 16:43:38 devstack sudo[109183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:43 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-e38c03a5-f133-43cb-9531-7dba7cd7d417 tempest-CinderUnicodeTest-1860100501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:43:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e38c03a5-f133-43cb-9531-7dba7cd7d417 tempest-CinderUnicodeTest-1860100501 None] Flow 'volume_create_manager' (abfe5d7a-ddfa-4b4d-9ea8-63733d7c82c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:43:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e38c03a5-f133-43cb-9531-7dba7cd7d417 tempest-CinderUnicodeTest-1860100501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfc06dd9-4d77-4c2e-a986-a3ff3759b08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:43:43 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:UPDATE=114,cinder:SELECT=113,cinder:INSERT=30,cinder:DELETE=11 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:43:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e38c03a5-f133-43cb-9531-7dba7cd7d417 tempest-CinderUnicodeTest-1860100501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfc06dd9-4d77-4c2e-a986-a3ff3759b08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e5d565a-443c-4dfe-8229-73244d830fee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c19a8dd35104986905b60d6449d2728',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:43:43Z,use_quota=True,user_id='dc54cad1ef1c44a7b894e991ec642a8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:43:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e38c03a5-f133-43cb-9531-7dba7cd7d417 tempest-CinderUnicodeTest-1860100501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6542360-c85c-4124-a1a6-26c8ff3421d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:43:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e38c03a5-f133-43cb-9531-7dba7cd7d417 tempest-CinderUnicodeTest-1860100501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6542360-c85c-4124-a1a6-26c8ff3421d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:43:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e38c03a5-f133-43cb-9531-7dba7cd7d417 tempest-CinderUnicodeTest-1860100501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9295bf75-7b96-41a1-a649-16be02b32143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:43:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e38c03a5-f133-43cb-9531-7dba7cd7d417 tempest-CinderUnicodeTest-1860100501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9295bf75-7b96-41a1-a649-16be02b32143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e5d565a-443c-4dfe-8229-73244d830fee', 'volume_name': 'volume-9e5d565a-443c-4dfe-8229-73244d830fee', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:43:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e38c03a5-f133-43cb-9531-7dba7cd7d417 tempest-CinderUnicodeTest-1860100501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78438b9f-f753-4dd6-ba0c-60b50600184e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:43:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e38c03a5-f133-43cb-9531-7dba7cd7d417 tempest-CinderUnicodeTest-1860100501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78438b9f-f753-4dd6-ba0c-60b50600184e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:43:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e38c03a5-f133-43cb-9531-7dba7cd7d417 tempest-CinderUnicodeTest-1860100501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2debc458-d1c9-44b8-9c3f-8aba3122ae8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:43:43 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-e38c03a5-f133-43cb-9531-7dba7cd7d417 tempest-CinderUnicodeTest-1860100501 None] Volume 9e5d565a-443c-4dfe-8229-73244d830fee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e5d565a-443c-4dfe-8229-73244d830fee', 'volume_size': 1} Jun 23 16:43:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e38c03a5-f133-43cb-9531-7dba7cd7d417 tempest-CinderUnicodeTest-1860100501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:43:44 devstack cinder-volume[93788]: INFO cinder.volume.manager [req-cd5be900-8d6b-42b1-a391-42db33e403c7 req-44934ad6-51a4-404f-9c10-49b6440c8e60 tempest-TestServerVolumeAttachmentScenario-12948084 None] Terminate volume connection completed successfully. Jun 23 16:43:44 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-cd5be900-8d6b-42b1-a391-42db33e403c7 req-44934ad6-51a4-404f-9c10-49b6440c8e60 tempest-TestServerVolumeAttachmentScenario-12948084 None] Deleting attachment 1a1ac2af-8671-4f21-8892-7d75c4cc2eab. {{(pid=93788) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 16:43:45 devstack sudo[109183]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:45 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-34a8624d-adbd-4506-a8b3-0d8387c5764b" returned: 0 in 6.661s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:45 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[702efb8a-9e47-4beb-a534-5dc3a2698919]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:43:45 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:45 devstack sudo[109202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c Jun 23 16:43:45 devstack sudo[109202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:46 devstack sudo[109202]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c" returned: 0 in 1.052s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:46 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] Image conversion details: src /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c, size 1024.00 MB, duration 6.66 sec, destination /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-34a8624d-adbd-4506-a8b3-0d8387c5764b {{(pid=93788) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 16:43:46 devstack cinder-volume[93788]: INFO cinder.image.image_utils [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] Converted 1024.00 MB image at 153.71 MB/s Jun 23 16:43:46 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-34a8624d-adbd-4506-a8b3-0d8387c5764b is being set with open permissions: ugo+rw Jun 23 16:43:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-34a8624d-adbd-4506-a8b3-0d8387c5764b {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:46 devstack sudo[109207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-34a8624d-adbd-4506-a8b3-0d8387c5764b Jun 23 16:43:46 devstack sudo[109207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:46 devstack sudo[109207]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-34a8624d-adbd-4506-a8b3-0d8387c5764b" returned: 0 in 0.884s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:47 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "cinder-quobyte-34a8624d-adbd-4506-a8b3-0d8387c5764b" released by "_copy_volume_from_snapshot" :: held 11.013s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:43:47 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "cinder-quobyte-136822a8-479d-4399-8cfd-2cc5274bbb4f-34a8624d-adbd-4506-a8b3-0d8387c5764b" released by "_create_volume_from_snapshot" :: held 11.046s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:43:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.060s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:43:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e38c03a5-f133-43cb-9531-7dba7cd7d417 tempest-CinderUnicodeTest-1860100501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.090s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:43:47 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e38c03a5-f133-43cb-9531-7dba7cd7d417 tempest-CinderUnicodeTest-1860100501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e5d565a-443c-4dfe-8229-73244d830fee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c19a8dd35104986905b60d6449d2728',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:43:43Z,use_quota=True,user_id='dc54cad1ef1c44a7b894e991ec642a8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:43:47 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-e38c03a5-f133-43cb-9531-7dba7cd7d417 tempest-CinderUnicodeTest-1860100501 None] Creating volume 9e5d565a-443c-4dfe-8229-73244d830fee {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:43:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e38c03a5-f133-43cb-9531-7dba7cd7d417 tempest-CinderUnicodeTest-1860100501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:43:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e38c03a5-f133-43cb-9531-7dba7cd7d417 tempest-CinderUnicodeTest-1860100501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:43:47 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e38c03a5-f133-43cb-9531-7dba7cd7d417 tempest-CinderUnicodeTest-1860100501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:43:47 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e38c03a5-f133-43cb-9531-7dba7cd7d417 tempest-CinderUnicodeTest-1860100501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:43:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e38c03a5-f133-43cb-9531-7dba7cd7d417 tempest-CinderUnicodeTest-1860100501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:43:47 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e38c03a5-f133-43cb-9531-7dba7cd7d417 tempest-CinderUnicodeTest-1860100501 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:43:47 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-e38c03a5-f133-43cb-9531-7dba7cd7d417 tempest-CinderUnicodeTest-1860100501 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:43:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e38c03a5-f133-43cb-9531-7dba7cd7d417 tempest-CinderUnicodeTest-1860100501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9e5d565a-443c-4dfe-8229-73244d830fee 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:47 devstack sudo[109210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9e5d565a-443c-4dfe-8229-73244d830fee 1073741824 Jun 23 16:43:47 devstack sudo[109210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:47 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1581e6b-8035-490c-befe-7f9a300f5549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34a8624d-adbd-4506-a8b3-0d8387c5764b', 'volume_size': 1, 'snapshot_id': '136822a8-479d-4399-8cfd-2cc5274bbb4f'}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:43:47 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a120956-c16d-46dd-b602-fe58a5474695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:43:47 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] Volume volume-34a8624d-adbd-4506-a8b3-0d8387c5764b (34a8624d-adbd-4506-a8b3-0d8387c5764b): created successfully Jun 23 16:43:47 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a120956-c16d-46dd-b602-fe58a5474695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:43:47 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] Flow 'volume_create_manager' (3049e41a-01d8-42d5-a51a-7c5463612611) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:43:47 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-529f9fd1-8639-4d7b-a2aa-a3b086ea896c tempest-VolumesSnapshotTestJSON-1537803418 None] Created volume successfully. Jun 23 16:43:48 devstack sudo[109210]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e38c03a5-f133-43cb-9531-7dba7cd7d417 tempest-CinderUnicodeTest-1860100501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9e5d565a-443c-4dfe-8229-73244d830fee 1073741824" returned: 0 in 1.020s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e38c03a5-f133-43cb-9531-7dba7cd7d417 tempest-CinderUnicodeTest-1860100501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9e5d565a-443c-4dfe-8229-73244d830fee {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:48 devstack sudo[109226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9e5d565a-443c-4dfe-8229-73244d830fee Jun 23 16:43:48 devstack sudo[109226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:48 devstack cinder-volume[93788]: INFO cinder.volume.manager [req-5129ec9d-d517-4799-be22-c0f687b393fd req-45484545-ad2c-4bbd-882c-69aff43070dc tempest-TestServerVolumeAttachmentScenario-12948084 None] Terminate volume connection completed successfully. Jun 23 16:43:48 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-5129ec9d-d517-4799-be22-c0f687b393fd req-45484545-ad2c-4bbd-882c-69aff43070dc tempest-TestServerVolumeAttachmentScenario-12948084 None] Deleting attachment b7c7faaa-522c-46ef-91c0-92c4dc609020. {{(pid=93788) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 16:43:48 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-cb060f68-7d9c-44a9-b27b-ec31c7608cc7 tempest-VolumesSnapshotTestJSON-1537803418 None] Acquiring lock "cinder-34a8624d-adbd-4506-a8b3-0d8387c5764b-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:43:48 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-cb060f68-7d9c-44a9-b27b-ec31c7608cc7 tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "cinder-34a8624d-adbd-4506-a8b3-0d8387c5764b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:43:48 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-cb060f68-7d9c-44a9-b27b-ec31c7608cc7 tempest-VolumesSnapshotTestJSON-1537803418 None] Acquiring lock "cinder-quobyte-34a8624d-adbd-4506-a8b3-0d8387c5764b" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:43:48 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-cb060f68-7d9c-44a9-b27b-ec31c7608cc7 tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "cinder-quobyte-34a8624d-adbd-4506-a8b3-0d8387c5764b" acquired by "delete_volume" :: waited 0.026s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:43:48 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ec6d9a-d825-4d10-96a2-8cc6c1958559]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:43:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-cb060f68-7d9c-44a9-b27b-ec31c7608cc7 tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-34a8624d-adbd-4506-a8b3-0d8387c5764b {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:48 devstack sudo[109231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-34a8624d-adbd-4506-a8b3-0d8387c5764b Jun 23 16:43:48 devstack sudo[109231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:48 devstack sudo[109226]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e38c03a5-f133-43cb-9531-7dba7cd7d417 tempest-CinderUnicodeTest-1860100501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9e5d565a-443c-4dfe-8229-73244d830fee" returned: 0 in 0.761s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:48 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e38c03a5-f133-43cb-9531-7dba7cd7d417 tempest-CinderUnicodeTest-1860100501 None] <== create_volume: return (1829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:43:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e38c03a5-f133-43cb-9531-7dba7cd7d417 tempest-CinderUnicodeTest-1860100501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.833s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:43:48 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e38c03a5-f133-43cb-9531-7dba7cd7d417 tempest-CinderUnicodeTest-1860100501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2debc458-d1c9-44b8-9c3f-8aba3122ae8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e5d565a-443c-4dfe-8229-73244d830fee', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:43:48 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e38c03a5-f133-43cb-9531-7dba7cd7d417 tempest-CinderUnicodeTest-1860100501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6371ce5-05cc-4297-9860-4027a3dd70a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:43:48 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-e38c03a5-f133-43cb-9531-7dba7cd7d417 tempest-CinderUnicodeTest-1860100501 None] Volume volume-9e5d565a-443c-4dfe-8229-73244d830fee (9e5d565a-443c-4dfe-8229-73244d830fee): created successfully Jun 23 16:43:48 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e38c03a5-f133-43cb-9531-7dba7cd7d417 tempest-CinderUnicodeTest-1860100501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6371ce5-05cc-4297-9860-4027a3dd70a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:43:48 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e38c03a5-f133-43cb-9531-7dba7cd7d417 tempest-CinderUnicodeTest-1860100501 None] Flow 'volume_create_manager' (abfe5d7a-ddfa-4b4d-9ea8-63733d7c82c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:43:48 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-e38c03a5-f133-43cb-9531-7dba7cd7d417 tempest-CinderUnicodeTest-1860100501 None] Created volume successfully. Jun 23 16:43:49 devstack sudo[109231]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-cb060f68-7d9c-44a9-b27b-ec31c7608cc7 tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-34a8624d-adbd-4506-a8b3-0d8387c5764b" returned: 0 in 0.883s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-cb060f68-7d9c-44a9-b27b-ec31c7608cc7 tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-34a8624d-adbd-4506-a8b3-0d8387c5764b {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:49 devstack sudo[109238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-34a8624d-adbd-4506-a8b3-0d8387c5764b Jun 23 16:43:49 devstack sudo[109238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:50 devstack sudo[109238]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-cb060f68-7d9c-44a9-b27b-ec31c7608cc7 tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-34a8624d-adbd-4506-a8b3-0d8387c5764b" returned: 0 in 0.840s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:50 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-cb060f68-7d9c-44a9-b27b-ec31c7608cc7 tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "cinder-quobyte-34a8624d-adbd-4506-a8b3-0d8387c5764b" released by "delete_volume" :: held 1.809s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:43:50 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-e75029bc-1121-4581-a91b-4bdffdaa79fe tempest-CinderUnicodeTest-1860100501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:43:50 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e75029bc-1121-4581-a91b-4bdffdaa79fe tempest-CinderUnicodeTest-1860100501 None] Flow 'volume_create_manager' (1f7780c7-4f29-4c16-9fb2-da79b62f7f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:43:50 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e75029bc-1121-4581-a91b-4bdffdaa79fe tempest-CinderUnicodeTest-1860100501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f83f2c6-5cd7-4dae-9a3b-294bb8d6a548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:43:50 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-cb060f68-7d9c-44a9-b27b-ec31c7608cc7 tempest-VolumesSnapshotTestJSON-1537803418 None] Created reservations ['930e2a2f-8dd2-4987-b15f-e97b65addc51', '57cd71cc-4a8e-4c2d-8e0c-8319fc19ad7e', '787742b4-7007-491a-b338-272268a1b587', 'd19ce9ec-3760-4835-b400-c69f56237a39'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:43:50 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e75029bc-1121-4581-a91b-4bdffdaa79fe tempest-CinderUnicodeTest-1860100501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f83f2c6-5cd7-4dae-9a3b-294bb8d6a548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:43:50Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1473025372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=002451a3-ad4c-48bb-a234-05bf713f2955,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c19a8dd35104986905b60d6449d2728',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:43:50Z,use_quota=True,user_id='dc54cad1ef1c44a7b894e991ec642a8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:43:50 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e75029bc-1121-4581-a91b-4bdffdaa79fe tempest-CinderUnicodeTest-1860100501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db0e51f6-665c-46d4-bb71-469382257d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:43:50 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e75029bc-1121-4581-a91b-4bdffdaa79fe tempest-CinderUnicodeTest-1860100501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db0e51f6-665c-46d4-bb71-469382257d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:43:50 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e75029bc-1121-4581-a91b-4bdffdaa79fe tempest-CinderUnicodeTest-1860100501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04540b14-a8f6-4814-8ce2-847d3c8b479a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:43:50 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e75029bc-1121-4581-a91b-4bdffdaa79fe tempest-CinderUnicodeTest-1860100501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04540b14-a8f6-4814-8ce2-847d3c8b479a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '002451a3-ad4c-48bb-a234-05bf713f2955', 'volume_name': 'volume-002451a3-ad4c-48bb-a234-05bf713f2955', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:43:50 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e75029bc-1121-4581-a91b-4bdffdaa79fe tempest-CinderUnicodeTest-1860100501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f53f25e-a788-4dc4-81b4-f22427c017ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:43:50 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e75029bc-1121-4581-a91b-4bdffdaa79fe tempest-CinderUnicodeTest-1860100501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f53f25e-a788-4dc4-81b4-f22427c017ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:43:50 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e75029bc-1121-4581-a91b-4bdffdaa79fe tempest-CinderUnicodeTest-1860100501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90ece740-dced-4f68-8b87-a8160219f3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:43:50 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-e75029bc-1121-4581-a91b-4bdffdaa79fe tempest-CinderUnicodeTest-1860100501 None] Volume 002451a3-ad4c-48bb-a234-05bf713f2955: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-002451a3-ad4c-48bb-a234-05bf713f2955', 'volume_size': 1} Jun 23 16:43:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e75029bc-1121-4581-a91b-4bdffdaa79fe tempest-CinderUnicodeTest-1860100501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:43:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e75029bc-1121-4581-a91b-4bdffdaa79fe tempest-CinderUnicodeTest-1860100501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:43:50 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e75029bc-1121-4581-a91b-4bdffdaa79fe tempest-CinderUnicodeTest-1860100501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:43:50Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1473025372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=002451a3-ad4c-48bb-a234-05bf713f2955,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c19a8dd35104986905b60d6449d2728',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:43:50Z,use_quota=True,user_id='dc54cad1ef1c44a7b894e991ec642a8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:43:50 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-e75029bc-1121-4581-a91b-4bdffdaa79fe tempest-CinderUnicodeTest-1860100501 None] Creating volume 002451a3-ad4c-48bb-a234-05bf713f2955 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:43:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e75029bc-1121-4581-a91b-4bdffdaa79fe tempest-CinderUnicodeTest-1860100501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:43:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e75029bc-1121-4581-a91b-4bdffdaa79fe tempest-CinderUnicodeTest-1860100501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:43:50 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e75029bc-1121-4581-a91b-4bdffdaa79fe tempest-CinderUnicodeTest-1860100501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:43:50 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e75029bc-1121-4581-a91b-4bdffdaa79fe tempest-CinderUnicodeTest-1860100501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:43:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e75029bc-1121-4581-a91b-4bdffdaa79fe tempest-CinderUnicodeTest-1860100501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:43:50 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e75029bc-1121-4581-a91b-4bdffdaa79fe tempest-CinderUnicodeTest-1860100501 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:43:50 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-e75029bc-1121-4581-a91b-4bdffdaa79fe tempest-CinderUnicodeTest-1860100501 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:43:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e75029bc-1121-4581-a91b-4bdffdaa79fe tempest-CinderUnicodeTest-1860100501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-002451a3-ad4c-48bb-a234-05bf713f2955 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:50 devstack sudo[109241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-002451a3-ad4c-48bb-a234-05bf713f2955 1073741824 Jun 23 16:43:50 devstack sudo[109241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-cb060f68-7d9c-44a9-b27b-ec31c7608cc7 tempest-VolumesSnapshotTestJSON-1537803418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:43:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-cb060f68-7d9c-44a9-b27b-ec31c7608cc7 tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:43:50 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-cb060f68-7d9c-44a9-b27b-ec31c7608cc7 tempest-VolumesSnapshotTestJSON-1537803418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:43:50 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-cb060f68-7d9c-44a9-b27b-ec31c7608cc7 tempest-VolumesSnapshotTestJSON-1537803418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:43:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-cb060f68-7d9c-44a9-b27b-ec31c7608cc7 tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:43:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-cb060f68-7d9c-44a9-b27b-ec31c7608cc7 tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:50 devstack sudo[109243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:43:50 devstack sudo[109243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:52 devstack sudo[109243]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-cb060f68-7d9c-44a9-b27b-ec31c7608cc7 tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.169s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:52 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-cb060f68-7d9c-44a9-b27b-ec31c7608cc7 tempest-VolumesSnapshotTestJSON-1537803418 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:43:52 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-1c1e123d-2ce7-421c-b596-31dcf4f87166 tempest-VolumesSnapshotTestJSON-1537803418 None] Acquiring lock "cinder-136822a8-479d-4399-8cfd-2cc5274bbb4f-delete_snapshot" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:43:52 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-cb060f68-7d9c-44a9-b27b-ec31c7608cc7 tempest-VolumesSnapshotTestJSON-1537803418 None] Deleted volume successfully. Jun 23 16:43:52 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-1c1e123d-2ce7-421c-b596-31dcf4f87166 tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "cinder-136822a8-479d-4399-8cfd-2cc5274bbb4f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:43:52 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-1c1e123d-2ce7-421c-b596-31dcf4f87166 tempest-VolumesSnapshotTestJSON-1537803418 None] Acquiring lock "cinder-quobyte-1d8b37cc-c124-415c-b709-04a55796b45c" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:43:52 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-cb060f68-7d9c-44a9-b27b-ec31c7608cc7 tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "cinder-34a8624d-adbd-4506-a8b3-0d8387c5764b-delete_volume" released by "delete_volume" :: held 3.636s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:43:52 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-1c1e123d-2ce7-421c-b596-31dcf4f87166 tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "cinder-quobyte-1d8b37cc-c124-415c-b709-04a55796b45c" acquired by "delete_snapshot" :: waited 0.049s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:43:52 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-1c1e123d-2ce7-421c-b596-31dcf4f87166 tempest-VolumesSnapshotTestJSON-1537803418 None] Acquiring lock "cinder-quobyte-136822a8-479d-4399-8cfd-2cc5274bbb4f" by "_delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:43:52 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-1c1e123d-2ce7-421c-b596-31dcf4f87166 tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "cinder-quobyte-136822a8-479d-4399-8cfd-2cc5274bbb4f" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:43:52 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-1c1e123d-2ce7-421c-b596-31dcf4f87166 tempest-VolumesSnapshotTestJSON-1537803418 None] Deleting offline snapshot 136822a8-479d-4399-8cfd-2cc5274bbb4f of volume 1d8b37cc-c124-415c-b709-04a55796b45c {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:43:52 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-1c1e123d-2ce7-421c-b596-31dcf4f87166 tempest-VolumesSnapshotTestJSON-1537803418 None] snapshot_file for this snap is: volume-1d8b37cc-c124-415c-b709-04a55796b45c.136822a8-479d-4399-8cfd-2cc5274bbb4f {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:43:52 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8df0e7-78db-4ceb-b5d5-69d8742f8a6a]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:43:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1c1e123d-2ce7-421c-b596-31dcf4f87166 tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c.136822a8-479d-4399-8cfd-2cc5274bbb4f {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:52 devstack sudo[109241]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e75029bc-1121-4581-a91b-4bdffdaa79fe tempest-CinderUnicodeTest-1860100501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-002451a3-ad4c-48bb-a234-05bf713f2955 1073741824" returned: 0 in 1.538s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e75029bc-1121-4581-a91b-4bdffdaa79fe tempest-CinderUnicodeTest-1860100501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-002451a3-ad4c-48bb-a234-05bf713f2955 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:52 devstack sudo[109290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-002451a3-ad4c-48bb-a234-05bf713f2955 Jun 23 16:43:52 devstack sudo[109290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:52 devstack sudo[109289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c.136822a8-479d-4399-8cfd-2cc5274bbb4f Jun 23 16:43:52 devstack sudo[109289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:53 devstack sudo[109289]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:53 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1c1e123d-2ce7-421c-b596-31dcf4f87166 tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c.136822a8-479d-4399-8cfd-2cc5274bbb4f" returned: 0 in 1.041s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:53 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-1c1e123d-2ce7-421c-b596-31dcf4f87166 tempest-VolumesSnapshotTestJSON-1537803418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d8b37cc-c124-415c-b709-04a55796b45c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:43:53 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cde27e9-9333-48e5-8cb4-c99ca054aa3e]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:43:53 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1c1e123d-2ce7-421c-b596-31dcf4f87166 tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:53 devstack sudo[109290]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:53 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e75029bc-1121-4581-a91b-4bdffdaa79fe tempest-CinderUnicodeTest-1860100501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-002451a3-ad4c-48bb-a234-05bf713f2955" returned: 0 in 1.028s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:53 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e75029bc-1121-4581-a91b-4bdffdaa79fe tempest-CinderUnicodeTest-1860100501 None] <== create_volume: return (2638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:43:53 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e75029bc-1121-4581-a91b-4bdffdaa79fe tempest-CinderUnicodeTest-1860100501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.641s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:43:53 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e75029bc-1121-4581-a91b-4bdffdaa79fe tempest-CinderUnicodeTest-1860100501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90ece740-dced-4f68-8b87-a8160219f3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-002451a3-ad4c-48bb-a234-05bf713f2955', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:43:53 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e75029bc-1121-4581-a91b-4bdffdaa79fe tempest-CinderUnicodeTest-1860100501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa4769ea-42b6-4cdb-aeb8-8b3a0292ea86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:43:53 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-e75029bc-1121-4581-a91b-4bdffdaa79fe tempest-CinderUnicodeTest-1860100501 None] Volume volume-002451a3-ad4c-48bb-a234-05bf713f2955 (002451a3-ad4c-48bb-a234-05bf713f2955): created successfully Jun 23 16:43:53 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e75029bc-1121-4581-a91b-4bdffdaa79fe tempest-CinderUnicodeTest-1860100501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa4769ea-42b6-4cdb-aeb8-8b3a0292ea86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:43:53 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e75029bc-1121-4581-a91b-4bdffdaa79fe tempest-CinderUnicodeTest-1860100501 None] Flow 'volume_create_manager' (1f7780c7-4f29-4c16-9fb2-da79b62f7f49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:43:53 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-e75029bc-1121-4581-a91b-4bdffdaa79fe tempest-CinderUnicodeTest-1860100501 None] Created volume successfully. Jun 23 16:43:53 devstack sudo[109298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c Jun 23 16:43:53 devstack sudo[109298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-cac5085f-047b-4989-81c7-4cac7c762c38 tempest-CinderUnicodeTest-1860100501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:43:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-cac5085f-047b-4989-81c7-4cac7c762c38 tempest-CinderUnicodeTest-1860100501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:43:54 devstack sudo[109298]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1c1e123d-2ce7-421c-b596-31dcf4f87166 tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c" returned: 0 in 0.912s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1c1e123d-2ce7-421c-b596-31dcf4f87166 tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c.136822a8-479d-4399-8cfd-2cc5274bbb4f {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:54 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-cac5085f-047b-4989-81c7-4cac7c762c38 tempest-CinderUnicodeTest-1860100501 None] Creating offline snapshot 3eb7152b-d272-4cf6-b2ae-86af32f6b9c1 of volume 002451a3-ad4c-48bb-a234-05bf713f2955 {{(pid=93788) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:43:54 devstack sudo[109303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c.136822a8-479d-4399-8cfd-2cc5274bbb4f Jun 23 16:43:54 devstack sudo[109303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:54 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80a30d2-dac1-4b94-8970-be6745e65f7e]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:43:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-cac5085f-047b-4989-81c7-4cac7c762c38 tempest-CinderUnicodeTest-1860100501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-002451a3-ad4c-48bb-a234-05bf713f2955 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:54 devstack sudo[109305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-002451a3-ad4c-48bb-a234-05bf713f2955 Jun 23 16:43:54 devstack sudo[109305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:55 devstack sudo[109305]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-cac5085f-047b-4989-81c7-4cac7c762c38 tempest-CinderUnicodeTest-1860100501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-002451a3-ad4c-48bb-a234-05bf713f2955" returned: 0 in 1.013s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-cac5085f-047b-4989-81c7-4cac7c762c38 tempest-CinderUnicodeTest-1860100501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-002451a3-ad4c-48bb-a234-05bf713f2955,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-002451a3-ad4c-48bb-a234-05bf713f2955.3eb7152b-d272-4cf6-b2ae-86af32f6b9c1 1G {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:55 devstack sudo[109303]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1c1e123d-2ce7-421c-b596-31dcf4f87166 tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c.136822a8-479d-4399-8cfd-2cc5274bbb4f" returned: 0 in 1.086s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1c1e123d-2ce7-421c-b596-31dcf4f87166 tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c.136822a8-479d-4399-8cfd-2cc5274bbb4f {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:55 devstack sudo[109317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-002451a3-ad4c-48bb-a234-05bf713f2955,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-002451a3-ad4c-48bb-a234-05bf713f2955.3eb7152b-d272-4cf6-b2ae-86af32f6b9c1 1G Jun 23 16:43:55 devstack sudo[109317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:55 devstack sudo[109318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c.136822a8-479d-4399-8cfd-2cc5274bbb4f Jun 23 16:43:55 devstack sudo[109318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:56 devstack sudo[109318]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1c1e123d-2ce7-421c-b596-31dcf4f87166 tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c.136822a8-479d-4399-8cfd-2cc5274bbb4f" returned: 0 in 0.699s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:56 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-1c1e123d-2ce7-421c-b596-31dcf4f87166 tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "cinder-quobyte-136822a8-479d-4399-8cfd-2cc5274bbb4f" released by "_delete_snapshot" :: held 3.927s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:43:56 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-1c1e123d-2ce7-421c-b596-31dcf4f87166 tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "cinder-quobyte-1d8b37cc-c124-415c-b709-04a55796b45c" released by "delete_snapshot" :: held 3.965s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:43:56 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-1c1e123d-2ce7-421c-b596-31dcf4f87166 tempest-VolumesSnapshotTestJSON-1537803418 None] Created reservations ['836f7d31-6001-487f-b53c-1ec1fffe8f26', 'ea952d5c-3123-402d-9132-5aa612a4a9ae', 'abf48b67-b7bf-41df-a8ad-a322665e7fe5', '07abfaba-8a22-4f1c-80f5-8994ae57c965'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:43:56 devstack sudo[109317]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:56 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-1c1e123d-2ce7-421c-b596-31dcf4f87166 tempest-VolumesSnapshotTestJSON-1537803418 None] Delete snapshot completed successfully. Jun 23 16:43:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-cac5085f-047b-4989-81c7-4cac7c762c38 tempest-CinderUnicodeTest-1860100501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-002451a3-ad4c-48bb-a234-05bf713f2955,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-002451a3-ad4c-48bb-a234-05bf713f2955.3eb7152b-d272-4cf6-b2ae-86af32f6b9c1 1G" returned: 0 in 0.950s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-cac5085f-047b-4989-81c7-4cac7c762c38 tempest-CinderUnicodeTest-1860100501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-002451a3-ad4c-48bb-a234-05bf713f2955 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-002451a3-ad4c-48bb-a234-05bf713f2955.3eb7152b-d272-4cf6-b2ae-86af32f6b9c1 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:56 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-1c1e123d-2ce7-421c-b596-31dcf4f87166 tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "cinder-136822a8-479d-4399-8cfd-2cc5274bbb4f-delete_snapshot" released by "delete_snapshot" :: held 4.224s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:43:56 devstack sudo[109328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-002451a3-ad4c-48bb-a234-05bf713f2955 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-002451a3-ad4c-48bb-a234-05bf713f2955.3eb7152b-d272-4cf6-b2ae-86af32f6b9c1 Jun 23 16:43:56 devstack sudo[109328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:56 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5e366c29-4122-4a51-bd68-0fa42592344d tempest-VolumesSnapshotTestJSON-1537803418 None] Acquiring lock "cinder-1d8b37cc-c124-415c-b709-04a55796b45c-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:43:56 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5e366c29-4122-4a51-bd68-0fa42592344d tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "cinder-1d8b37cc-c124-415c-b709-04a55796b45c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:43:56 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5e366c29-4122-4a51-bd68-0fa42592344d tempest-VolumesSnapshotTestJSON-1537803418 None] Acquiring lock "cinder-quobyte-1d8b37cc-c124-415c-b709-04a55796b45c" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:43:56 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5e366c29-4122-4a51-bd68-0fa42592344d tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "cinder-quobyte-1d8b37cc-c124-415c-b709-04a55796b45c" acquired by "delete_volume" :: waited 0.017s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:43:56 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0931748b-615e-4ecc-baa2-ba2b91953daf]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:43:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5e366c29-4122-4a51-bd68-0fa42592344d tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:56 devstack sudo[109333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c Jun 23 16:43:56 devstack sudo[109333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:57 devstack sudo[109328]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-cac5085f-047b-4989-81c7-4cac7c762c38 tempest-CinderUnicodeTest-1860100501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-002451a3-ad4c-48bb-a234-05bf713f2955 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-002451a3-ad4c-48bb-a234-05bf713f2955.3eb7152b-d272-4cf6-b2ae-86af32f6b9c1" returned: 0 in 0.912s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:57 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-cac5085f-047b-4989-81c7-4cac7c762c38 tempest-CinderUnicodeTest-1860100501 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-002451a3-ad4c-48bb-a234-05bf713f2955.3eb7152b-d272-4cf6-b2ae-86af32f6b9c1 is being set with open permissions: ugo+rw Jun 23 16:43:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-cac5085f-047b-4989-81c7-4cac7c762c38 tempest-CinderUnicodeTest-1860100501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-002451a3-ad4c-48bb-a234-05bf713f2955.3eb7152b-d272-4cf6-b2ae-86af32f6b9c1 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:57 devstack sudo[109338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-002451a3-ad4c-48bb-a234-05bf713f2955.3eb7152b-d272-4cf6-b2ae-86af32f6b9c1 Jun 23 16:43:57 devstack sudo[109338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:57 devstack sudo[109333]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5e366c29-4122-4a51-bd68-0fa42592344d tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c" returned: 0 in 0.859s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5e366c29-4122-4a51-bd68-0fa42592344d tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:57 devstack sudo[109343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c Jun 23 16:43:57 devstack sudo[109343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:57 devstack sudo[109338]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-cac5085f-047b-4989-81c7-4cac7c762c38 tempest-CinderUnicodeTest-1860100501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-002451a3-ad4c-48bb-a234-05bf713f2955.3eb7152b-d272-4cf6-b2ae-86af32f6b9c1" returned: 0 in 0.743s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-cac5085f-047b-4989-81c7-4cac7c762c38 tempest-CinderUnicodeTest-1860100501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-002451a3-ad4c-48bb-a234-05bf713f2955.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:58 devstack sudo[109346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-002451a3-ad4c-48bb-a234-05bf713f2955.info Jun 23 16:43:58 devstack sudo[109346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:58 devstack sudo[109343]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5e366c29-4122-4a51-bd68-0fa42592344d tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-1d8b37cc-c124-415c-b709-04a55796b45c" returned: 0 in 0.695s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:58 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5e366c29-4122-4a51-bd68-0fa42592344d tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "cinder-quobyte-1d8b37cc-c124-415c-b709-04a55796b45c" released by "delete_volume" :: held 1.636s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:43:58 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-5e366c29-4122-4a51-bd68-0fa42592344d tempest-VolumesSnapshotTestJSON-1537803418 None] Created reservations ['f908f077-73dd-4ad8-a2a8-59ce2cf968f6', '575808c9-c324-4d88-9f25-58a1be6bddd2', '66087702-1273-4080-bba8-006ca3b82e68', 'ab8310b9-2a0b-4d33-9386-ecccf877cb7b'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:43:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5e366c29-4122-4a51-bd68-0fa42592344d tempest-VolumesSnapshotTestJSON-1537803418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:43:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5e366c29-4122-4a51-bd68-0fa42592344d tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:43:58 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-5e366c29-4122-4a51-bd68-0fa42592344d tempest-VolumesSnapshotTestJSON-1537803418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:43:58 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-5e366c29-4122-4a51-bd68-0fa42592344d tempest-VolumesSnapshotTestJSON-1537803418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:43:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5e366c29-4122-4a51-bd68-0fa42592344d tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:43:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5e366c29-4122-4a51-bd68-0fa42592344d tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:58 devstack sudo[109349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:43:58 devstack sudo[109349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:58 devstack sudo[109346]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-cac5085f-047b-4989-81c7-4cac7c762c38 tempest-CinderUnicodeTest-1860100501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-002451a3-ad4c-48bb-a234-05bf713f2955.info" returned: 0 in 0.675s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:58 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-cac5085f-047b-4989-81c7-4cac7c762c38 tempest-CinderUnicodeTest-1860100501 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-002451a3-ad4c-48bb-a234-05bf713f2955.info is being set with open permissions: ugo+rw Jun 23 16:43:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-cac5085f-047b-4989-81c7-4cac7c762c38 tempest-CinderUnicodeTest-1860100501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-002451a3-ad4c-48bb-a234-05bf713f2955.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:58 devstack sudo[109352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-002451a3-ad4c-48bb-a234-05bf713f2955.info Jun 23 16:43:58 devstack sudo[109352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:58 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-8c21a339-5fb8-44ba-9456-5d70879b1be8 tempest-VolumesSnapshotTestJSON-1537803418 None] Acquiring lock "cinder-b4df677b-2c51-4af8-99b5-1f0ff9644df2-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:43:58 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-8c21a339-5fb8-44ba-9456-5d70879b1be8 tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "cinder-b4df677b-2c51-4af8-99b5-1f0ff9644df2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:43:59 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-8c21a339-5fb8-44ba-9456-5d70879b1be8 tempest-VolumesSnapshotTestJSON-1537803418 None] Acquiring lock "cinder-quobyte-b4df677b-2c51-4af8-99b5-1f0ff9644df2" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:43:59 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-8c21a339-5fb8-44ba-9456-5d70879b1be8 tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "cinder-quobyte-b4df677b-2c51-4af8-99b5-1f0ff9644df2" acquired by "delete_volume" :: waited 0.026s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:43:59 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd94b459-1715-4cd3-ab11-c23e02eadbe2]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:43:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8c21a339-5fb8-44ba-9456-5d70879b1be8 tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:43:59 devstack sudo[109349]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5e366c29-4122-4a51-bd68-0fa42592344d tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.868s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:59 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-5e366c29-4122-4a51-bd68-0fa42592344d tempest-VolumesSnapshotTestJSON-1537803418 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:43:59 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-5e366c29-4122-4a51-bd68-0fa42592344d tempest-VolumesSnapshotTestJSON-1537803418 None] Deleted volume successfully. Jun 23 16:43:59 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5e366c29-4122-4a51-bd68-0fa42592344d tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "cinder-1d8b37cc-c124-415c-b709-04a55796b45c-delete_volume" released by "delete_volume" :: held 2.793s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:43:59 devstack sudo[109356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2 Jun 23 16:43:59 devstack sudo[109356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:43:59 devstack sudo[109352]: pam_unix(sudo:session): session closed for user root Jun 23 16:43:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-cac5085f-047b-4989-81c7-4cac7c762c38 tempest-CinderUnicodeTest-1860100501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-002451a3-ad4c-48bb-a234-05bf713f2955.info" returned: 0 in 0.912s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:43:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-cac5085f-047b-4989-81c7-4cac7c762c38 tempest-CinderUnicodeTest-1860100501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.337s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:43:59 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-cac5085f-047b-4989-81c7-4cac7c762c38 tempest-CinderUnicodeTest-1860100501 None] Create snapshot completed successfully Jun 23 16:43:59 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-aa097ba4-b195-4a10-acec-7431a6e3cf2f tempest-TestServerVolumeAttachmentScenario-12948084 None] Acquiring lock "cinder-69e2cdcc-ab99-4639-9be2-f15d69f6358e-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:43:59 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-aa097ba4-b195-4a10-acec-7431a6e3cf2f tempest-TestServerVolumeAttachmentScenario-12948084 None] Lock "cinder-69e2cdcc-ab99-4639-9be2-f15d69f6358e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:44:00 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-aa097ba4-b195-4a10-acec-7431a6e3cf2f tempest-TestServerVolumeAttachmentScenario-12948084 None] Acquiring lock "cinder-quobyte-69e2cdcc-ab99-4639-9be2-f15d69f6358e" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:44:00 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-aa097ba4-b195-4a10-acec-7431a6e3cf2f tempest-TestServerVolumeAttachmentScenario-12948084 None] Lock "cinder-quobyte-69e2cdcc-ab99-4639-9be2-f15d69f6358e" acquired by "delete_volume" :: waited 0.018s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:44:00 devstack sudo[109356]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8c21a339-5fb8-44ba-9456-5d70879b1be8 tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2" returned: 0 in 0.937s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8c21a339-5fb8-44ba-9456-5d70879b1be8 tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:00 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a868b2-b43e-4c18-9833-e5dd501bbbf0]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:44:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-aa097ba4-b195-4a10-acec-7431a6e3cf2f tempest-TestServerVolumeAttachmentScenario-12948084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69e2cdcc-ab99-4639-9be2-f15d69f6358e {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:00 devstack sudo[109362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2 Jun 23 16:44:00 devstack sudo[109362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:00 devstack sudo[109363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69e2cdcc-ab99-4639-9be2-f15d69f6358e Jun 23 16:44:00 devstack sudo[109363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:00 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-6577c050-126b-4f6a-96e2-b00d096fe18e tempest-CinderUnicodeTest-1860100501 None] Acquiring lock "cinder-3eb7152b-d272-4cf6-b2ae-86af32f6b9c1-delete_snapshot" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:44:00 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-6577c050-126b-4f6a-96e2-b00d096fe18e tempest-CinderUnicodeTest-1860100501 None] Lock "cinder-3eb7152b-d272-4cf6-b2ae-86af32f6b9c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:44:00 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-6577c050-126b-4f6a-96e2-b00d096fe18e tempest-CinderUnicodeTest-1860100501 None] Acquiring lock "cinder-quobyte-002451a3-ad4c-48bb-a234-05bf713f2955" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:44:00 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-6577c050-126b-4f6a-96e2-b00d096fe18e tempest-CinderUnicodeTest-1860100501 None] Lock "cinder-quobyte-002451a3-ad4c-48bb-a234-05bf713f2955" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:44:00 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-6577c050-126b-4f6a-96e2-b00d096fe18e tempest-CinderUnicodeTest-1860100501 None] Acquiring lock "cinder-quobyte-3eb7152b-d272-4cf6-b2ae-86af32f6b9c1" by "_delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:44:00 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-6577c050-126b-4f6a-96e2-b00d096fe18e tempest-CinderUnicodeTest-1860100501 None] Lock "cinder-quobyte-3eb7152b-d272-4cf6-b2ae-86af32f6b9c1" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:44:00 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-6577c050-126b-4f6a-96e2-b00d096fe18e tempest-CinderUnicodeTest-1860100501 None] Deleting offline snapshot 3eb7152b-d272-4cf6-b2ae-86af32f6b9c1 of volume 002451a3-ad4c-48bb-a234-05bf713f2955 {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:44:00 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-6577c050-126b-4f6a-96e2-b00d096fe18e tempest-CinderUnicodeTest-1860100501 None] snapshot_file for this snap is: volume-002451a3-ad4c-48bb-a234-05bf713f2955.3eb7152b-d272-4cf6-b2ae-86af32f6b9c1 {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:44:00 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f24aa1-673f-402b-ac3b-3ba13deac414]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:44:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-6577c050-126b-4f6a-96e2-b00d096fe18e tempest-CinderUnicodeTest-1860100501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-002451a3-ad4c-48bb-a234-05bf713f2955.3eb7152b-d272-4cf6-b2ae-86af32f6b9c1 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:00 devstack sudo[109366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-002451a3-ad4c-48bb-a234-05bf713f2955.3eb7152b-d272-4cf6-b2ae-86af32f6b9c1 Jun 23 16:44:00 devstack sudo[109366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:00 devstack sudo[109362]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8c21a339-5fb8-44ba-9456-5d70879b1be8 tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b4df677b-2c51-4af8-99b5-1f0ff9644df2" returned: 0 in 0.715s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:00 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-8c21a339-5fb8-44ba-9456-5d70879b1be8 tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "cinder-quobyte-b4df677b-2c51-4af8-99b5-1f0ff9644df2" released by "delete_volume" :: held 1.750s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:44:00 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-8c21a339-5fb8-44ba-9456-5d70879b1be8 tempest-VolumesSnapshotTestJSON-1537803418 None] Created reservations ['b6fe12d3-0e76-464e-8dd0-aac6540e3620', 'd6fb2cc0-3f90-454d-b8e7-4905806dc984', '53b0b6ab-f1ef-4680-bd78-52fa4d0b370a', 'e031522b-85d1-4e82-8a83-2b5546a5f9e0'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:44:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8c21a339-5fb8-44ba-9456-5d70879b1be8 tempest-VolumesSnapshotTestJSON-1537803418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:44:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8c21a339-5fb8-44ba-9456-5d70879b1be8 tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:44:00 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-8c21a339-5fb8-44ba-9456-5d70879b1be8 tempest-VolumesSnapshotTestJSON-1537803418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:44:00 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-8c21a339-5fb8-44ba-9456-5d70879b1be8 tempest-VolumesSnapshotTestJSON-1537803418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:44:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8c21a339-5fb8-44ba-9456-5d70879b1be8 tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:44:00 devstack sudo[109363]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8c21a339-5fb8-44ba-9456-5d70879b1be8 tempest-VolumesSnapshotTestJSON-1537803418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-aa097ba4-b195-4a10-acec-7431a6e3cf2f tempest-TestServerVolumeAttachmentScenario-12948084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69e2cdcc-ab99-4639-9be2-f15d69f6358e" returned: 0 in 0.862s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-aa097ba4-b195-4a10-acec-7431a6e3cf2f tempest-TestServerVolumeAttachmentScenario-12948084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69e2cdcc-ab99-4639-9be2-f15d69f6358e {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:01 devstack sudo[109372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:44:01 devstack sudo[109372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:01 devstack sudo[109373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69e2cdcc-ab99-4639-9be2-f15d69f6358e Jun 23 16:44:01 devstack sudo[109373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:01 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:44:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:44:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:44:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:44:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:44:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:44:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:01 devstack sudo[109376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:44:01 devstack sudo[109376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:01 devstack sudo[109366]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-6577c050-126b-4f6a-96e2-b00d096fe18e tempest-CinderUnicodeTest-1860100501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-002451a3-ad4c-48bb-a234-05bf713f2955.3eb7152b-d272-4cf6-b2ae-86af32f6b9c1" returned: 0 in 0.982s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-6577c050-126b-4f6a-96e2-b00d096fe18e tempest-CinderUnicodeTest-1860100501 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-002451a3-ad4c-48bb-a234-05bf713f2955(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:44:01 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[48812487-7608-4d76-9ec8-57405db839ce]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:44:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-6577c050-126b-4f6a-96e2-b00d096fe18e tempest-CinderUnicodeTest-1860100501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-002451a3-ad4c-48bb-a234-05bf713f2955 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:01 devstack sudo[109382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-002451a3-ad4c-48bb-a234-05bf713f2955 Jun 23 16:44:01 devstack sudo[109382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:02 devstack sudo[109372]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8c21a339-5fb8-44ba-9456-5d70879b1be8 tempest-VolumesSnapshotTestJSON-1537803418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.182s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:02 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-8c21a339-5fb8-44ba-9456-5d70879b1be8 tempest-VolumesSnapshotTestJSON-1537803418 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:44:02 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-8c21a339-5fb8-44ba-9456-5d70879b1be8 tempest-VolumesSnapshotTestJSON-1537803418 None] Deleted volume successfully. Jun 23 16:44:02 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-8c21a339-5fb8-44ba-9456-5d70879b1be8 tempest-VolumesSnapshotTestJSON-1537803418 None] Lock "cinder-b4df677b-2c51-4af8-99b5-1f0ff9644df2-delete_volume" released by "delete_volume" :: held 3.219s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:44:02 devstack sudo[109373]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-aa097ba4-b195-4a10-acec-7431a6e3cf2f tempest-TestServerVolumeAttachmentScenario-12948084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-69e2cdcc-ab99-4639-9be2-f15d69f6358e" returned: 0 in 1.243s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:02 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-aa097ba4-b195-4a10-acec-7431a6e3cf2f tempest-TestServerVolumeAttachmentScenario-12948084 None] Lock "cinder-quobyte-69e2cdcc-ab99-4639-9be2-f15d69f6358e" released by "delete_volume" :: held 2.177s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:44:02 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-aa097ba4-b195-4a10-acec-7431a6e3cf2f tempest-TestServerVolumeAttachmentScenario-12948084 None] Created reservations ['138e8ce0-38a0-49e8-95e9-51b56b03a451', '8f15f817-9d3d-4abe-9875-5a32763af81a', '0b0d102f-240f-4e03-8ac9-3b02e3d846ca', '661165d9-e70a-45e0-a8c6-9d27bb97ce82'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:44:02 devstack sudo[109376]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.119s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:02 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:44:02 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager._thread_info {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:44:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread count: 28 {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 16:44:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread info: [<_MainThread(MainThread, started 126303828988032)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 16:44:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-aa097ba4-b195-4a10-acec-7431a6e3cf2f tempest-TestServerVolumeAttachmentScenario-12948084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:44:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-aa097ba4-b195-4a10-acec-7431a6e3cf2f tempest-TestServerVolumeAttachmentScenario-12948084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:44:02 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-aa097ba4-b195-4a10-acec-7431a6e3cf2f tempest-TestServerVolumeAttachmentScenario-12948084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:44:02 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-aa097ba4-b195-4a10-acec-7431a6e3cf2f tempest-TestServerVolumeAttachmentScenario-12948084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:44:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-aa097ba4-b195-4a10-acec-7431a6e3cf2f tempest-TestServerVolumeAttachmentScenario-12948084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:44:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-aa097ba4-b195-4a10-acec-7431a6e3cf2f tempest-TestServerVolumeAttachmentScenario-12948084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:02 devstack sudo[109387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:44:02 devstack sudo[109387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:03 devstack sudo[109382]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-6577c050-126b-4f6a-96e2-b00d096fe18e tempest-CinderUnicodeTest-1860100501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-002451a3-ad4c-48bb-a234-05bf713f2955" returned: 0 in 1.382s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-6577c050-126b-4f6a-96e2-b00d096fe18e tempest-CinderUnicodeTest-1860100501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-002451a3-ad4c-48bb-a234-05bf713f2955.3eb7152b-d272-4cf6-b2ae-86af32f6b9c1 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:03 devstack sudo[109393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-002451a3-ad4c-48bb-a234-05bf713f2955.3eb7152b-d272-4cf6-b2ae-86af32f6b9c1 Jun 23 16:44:03 devstack sudo[109393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:03 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-3963e0dd-7911-41a6-bb19-6569d65f3495 tempest-TestServerVolumeAttachmentScenario-12948084 None] Acquiring lock "cinder-40ea7b4e-cdef-4b1b-b367-4151f8eb4a61-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:44:03 devstack sudo[109387]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-aa097ba4-b195-4a10-acec-7431a6e3cf2f tempest-TestServerVolumeAttachmentScenario-12948084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.051s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:03 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-aa097ba4-b195-4a10-acec-7431a6e3cf2f tempest-TestServerVolumeAttachmentScenario-12948084 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:44:03 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-3963e0dd-7911-41a6-bb19-6569d65f3495 tempest-TestServerVolumeAttachmentScenario-12948084 None] Lock "cinder-40ea7b4e-cdef-4b1b-b367-4151f8eb4a61-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:44:03 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-aa097ba4-b195-4a10-acec-7431a6e3cf2f tempest-TestServerVolumeAttachmentScenario-12948084 None] Deleted volume successfully. Jun 23 16:44:03 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-aa097ba4-b195-4a10-acec-7431a6e3cf2f tempest-TestServerVolumeAttachmentScenario-12948084 None] Lock "cinder-69e2cdcc-ab99-4639-9be2-f15d69f6358e-delete_volume" released by "delete_volume" :: held 3.744s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:44:03 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-3963e0dd-7911-41a6-bb19-6569d65f3495 tempest-TestServerVolumeAttachmentScenario-12948084 None] Acquiring lock "cinder-quobyte-40ea7b4e-cdef-4b1b-b367-4151f8eb4a61" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:44:03 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-3963e0dd-7911-41a6-bb19-6569d65f3495 tempest-TestServerVolumeAttachmentScenario-12948084 None] Lock "cinder-quobyte-40ea7b4e-cdef-4b1b-b367-4151f8eb4a61" acquired by "delete_volume" :: waited 0.016s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:44:03 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[15906939-421f-4663-be4d-29106e418b17]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:44:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-3963e0dd-7911-41a6-bb19-6569d65f3495 tempest-TestServerVolumeAttachmentScenario-12948084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-40ea7b4e-cdef-4b1b-b367-4151f8eb4a61 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:03 devstack sudo[109396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-40ea7b4e-cdef-4b1b-b367-4151f8eb4a61 Jun 23 16:44:03 devstack sudo[109396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:04 devstack sudo[109393]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-6577c050-126b-4f6a-96e2-b00d096fe18e tempest-CinderUnicodeTest-1860100501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-002451a3-ad4c-48bb-a234-05bf713f2955.3eb7152b-d272-4cf6-b2ae-86af32f6b9c1" returned: 0 in 1.260s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-6577c050-126b-4f6a-96e2-b00d096fe18e tempest-CinderUnicodeTest-1860100501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-002451a3-ad4c-48bb-a234-05bf713f2955.3eb7152b-d272-4cf6-b2ae-86af32f6b9c1 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:04 devstack sudo[109404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-002451a3-ad4c-48bb-a234-05bf713f2955.3eb7152b-d272-4cf6-b2ae-86af32f6b9c1 Jun 23 16:44:04 devstack sudo[109404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:05 devstack sudo[109396]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-3963e0dd-7911-41a6-bb19-6569d65f3495 tempest-TestServerVolumeAttachmentScenario-12948084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-40ea7b4e-cdef-4b1b-b367-4151f8eb4a61" returned: 0 in 1.334s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-3963e0dd-7911-41a6-bb19-6569d65f3495 tempest-TestServerVolumeAttachmentScenario-12948084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-40ea7b4e-cdef-4b1b-b367-4151f8eb4a61 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:05 devstack sudo[109430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-40ea7b4e-cdef-4b1b-b367-4151f8eb4a61 Jun 23 16:44:05 devstack sudo[109430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:05 devstack sudo[109404]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-6577c050-126b-4f6a-96e2-b00d096fe18e tempest-CinderUnicodeTest-1860100501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-002451a3-ad4c-48bb-a234-05bf713f2955.3eb7152b-d272-4cf6-b2ae-86af32f6b9c1" returned: 0 in 0.943s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:05 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-6577c050-126b-4f6a-96e2-b00d096fe18e tempest-CinderUnicodeTest-1860100501 None] Lock "cinder-quobyte-3eb7152b-d272-4cf6-b2ae-86af32f6b9c1" released by "_delete_snapshot" :: held 4.721s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:44:05 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-6577c050-126b-4f6a-96e2-b00d096fe18e tempest-CinderUnicodeTest-1860100501 None] Lock "cinder-quobyte-002451a3-ad4c-48bb-a234-05bf713f2955" released by "delete_snapshot" :: held 4.751s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:44:05 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-6577c050-126b-4f6a-96e2-b00d096fe18e tempest-CinderUnicodeTest-1860100501 None] Created reservations ['33ce05b9-fccd-4bbf-a98a-1d2c9d03bf3f', '9aa9f72f-59bd-44ea-b711-6abd1b6e5f65', 'ed210669-b603-416d-9681-016fc928bef1', 'd12cd441-ab2f-484b-91f5-04f26c2d70de'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:44:05 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-6577c050-126b-4f6a-96e2-b00d096fe18e tempest-CinderUnicodeTest-1860100501 None] Delete snapshot completed successfully. Jun 23 16:44:05 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-6577c050-126b-4f6a-96e2-b00d096fe18e tempest-CinderUnicodeTest-1860100501 None] Lock "cinder-3eb7152b-d272-4cf6-b2ae-86af32f6b9c1-delete_snapshot" released by "delete_snapshot" :: held 5.013s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:44:06 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-95780541-917d-452e-85dd-2447a2ead1a3 tempest-CinderUnicodeTest-1860100501 None] Acquiring lock "cinder-002451a3-ad4c-48bb-a234-05bf713f2955-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:44:06 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-95780541-917d-452e-85dd-2447a2ead1a3 tempest-CinderUnicodeTest-1860100501 None] Lock "cinder-002451a3-ad4c-48bb-a234-05bf713f2955-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:44:06 devstack sudo[109430]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-3963e0dd-7911-41a6-bb19-6569d65f3495 tempest-TestServerVolumeAttachmentScenario-12948084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-40ea7b4e-cdef-4b1b-b367-4151f8eb4a61" returned: 0 in 0.941s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:06 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-3963e0dd-7911-41a6-bb19-6569d65f3495 tempest-TestServerVolumeAttachmentScenario-12948084 None] Lock "cinder-quobyte-40ea7b4e-cdef-4b1b-b367-4151f8eb4a61" released by "delete_volume" :: held 2.339s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:44:06 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-95780541-917d-452e-85dd-2447a2ead1a3 tempest-CinderUnicodeTest-1860100501 None] Acquiring lock "cinder-quobyte-002451a3-ad4c-48bb-a234-05bf713f2955" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:44:06 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-95780541-917d-452e-85dd-2447a2ead1a3 tempest-CinderUnicodeTest-1860100501 None] Lock "cinder-quobyte-002451a3-ad4c-48bb-a234-05bf713f2955" acquired by "delete_volume" :: waited 0.025s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:44:06 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1d36c7-9c55-4dc5-9b04-2c7289517d37]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:44:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-95780541-917d-452e-85dd-2447a2ead1a3 tempest-CinderUnicodeTest-1860100501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-002451a3-ad4c-48bb-a234-05bf713f2955 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:06 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-3963e0dd-7911-41a6-bb19-6569d65f3495 tempest-TestServerVolumeAttachmentScenario-12948084 None] Created reservations ['7fa0ddf0-9263-4edc-ac3f-ded87bc6ebba', '450d8435-47a3-4bb7-b15c-e80a8b085d12', 'bbf5deab-d68a-4a3d-a88f-865b4f42fcde', '1605ca4e-38b4-428e-8372-7c5d3729aa0f'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:44:06 devstack sudo[109447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-002451a3-ad4c-48bb-a234-05bf713f2955 Jun 23 16:44:06 devstack sudo[109447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-3963e0dd-7911-41a6-bb19-6569d65f3495 tempest-TestServerVolumeAttachmentScenario-12948084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:44:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-3963e0dd-7911-41a6-bb19-6569d65f3495 tempest-TestServerVolumeAttachmentScenario-12948084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:44:06 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-3963e0dd-7911-41a6-bb19-6569d65f3495 tempest-TestServerVolumeAttachmentScenario-12948084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:44:06 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-3963e0dd-7911-41a6-bb19-6569d65f3495 tempest-TestServerVolumeAttachmentScenario-12948084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:44:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-3963e0dd-7911-41a6-bb19-6569d65f3495 tempest-TestServerVolumeAttachmentScenario-12948084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:44:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-3963e0dd-7911-41a6-bb19-6569d65f3495 tempest-TestServerVolumeAttachmentScenario-12948084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:06 devstack sudo[109449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:44:06 devstack sudo[109449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:07 devstack sudo[109449]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-3963e0dd-7911-41a6-bb19-6569d65f3495 tempest-TestServerVolumeAttachmentScenario-12948084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.819s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:07 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-3963e0dd-7911-41a6-bb19-6569d65f3495 tempest-TestServerVolumeAttachmentScenario-12948084 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:44:07 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-3963e0dd-7911-41a6-bb19-6569d65f3495 tempest-TestServerVolumeAttachmentScenario-12948084 None] Deleted volume successfully. Jun 23 16:44:07 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-3963e0dd-7911-41a6-bb19-6569d65f3495 tempest-TestServerVolumeAttachmentScenario-12948084 None] Lock "cinder-40ea7b4e-cdef-4b1b-b367-4151f8eb4a61-delete_volume" released by "delete_volume" :: held 3.650s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:44:07 devstack sudo[109447]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-95780541-917d-452e-85dd-2447a2ead1a3 tempest-CinderUnicodeTest-1860100501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-002451a3-ad4c-48bb-a234-05bf713f2955" returned: 0 in 1.156s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-95780541-917d-452e-85dd-2447a2ead1a3 tempest-CinderUnicodeTest-1860100501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-002451a3-ad4c-48bb-a234-05bf713f2955 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:07 devstack sudo[109456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-002451a3-ad4c-48bb-a234-05bf713f2955 Jun 23 16:44:07 devstack sudo[109456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:08 devstack sudo[109456]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-95780541-917d-452e-85dd-2447a2ead1a3 tempest-CinderUnicodeTest-1860100501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-002451a3-ad4c-48bb-a234-05bf713f2955" returned: 0 in 0.846s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:08 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-95780541-917d-452e-85dd-2447a2ead1a3 tempest-CinderUnicodeTest-1860100501 None] Lock "cinder-quobyte-002451a3-ad4c-48bb-a234-05bf713f2955" released by "delete_volume" :: held 2.074s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:44:08 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-95780541-917d-452e-85dd-2447a2ead1a3 tempest-CinderUnicodeTest-1860100501 None] Created reservations ['e2eb95d1-b67f-4640-9ca0-60d7a06862c1', 'e80e8dd7-e3eb-4f5c-9d31-12625e4fa78c', '180319a5-0190-4749-b09b-eac36cf4aa18', '780f29a9-5ffc-4458-963b-5c7fbfe8e2d1'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:44:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-95780541-917d-452e-85dd-2447a2ead1a3 tempest-CinderUnicodeTest-1860100501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:44:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-95780541-917d-452e-85dd-2447a2ead1a3 tempest-CinderUnicodeTest-1860100501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:44:08 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-95780541-917d-452e-85dd-2447a2ead1a3 tempest-CinderUnicodeTest-1860100501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:44:08 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-95780541-917d-452e-85dd-2447a2ead1a3 tempest-CinderUnicodeTest-1860100501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:44:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-95780541-917d-452e-85dd-2447a2ead1a3 tempest-CinderUnicodeTest-1860100501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:44:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-95780541-917d-452e-85dd-2447a2ead1a3 tempest-CinderUnicodeTest-1860100501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:08 devstack sudo[109459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:44:08 devstack sudo[109459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:09 devstack sudo[109459]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-95780541-917d-452e-85dd-2447a2ead1a3 tempest-CinderUnicodeTest-1860100501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.806s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:09 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-95780541-917d-452e-85dd-2447a2ead1a3 tempest-CinderUnicodeTest-1860100501 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:44:09 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-95780541-917d-452e-85dd-2447a2ead1a3 tempest-CinderUnicodeTest-1860100501 None] Deleted volume successfully. Jun 23 16:44:09 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-95780541-917d-452e-85dd-2447a2ead1a3 tempest-CinderUnicodeTest-1860100501 None] Lock "cinder-002451a3-ad4c-48bb-a234-05bf713f2955-delete_volume" released by "delete_volume" :: held 3.192s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:44:09 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-a93ae2af-0589-41a6-83be-88f004174288 tempest-CinderUnicodeTest-1860100501 None] Acquiring lock "cinder-9e5d565a-443c-4dfe-8229-73244d830fee-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:44:09 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-a93ae2af-0589-41a6-83be-88f004174288 tempest-CinderUnicodeTest-1860100501 None] Lock "cinder-9e5d565a-443c-4dfe-8229-73244d830fee-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:44:09 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-a93ae2af-0589-41a6-83be-88f004174288 tempest-CinderUnicodeTest-1860100501 None] Acquiring lock "cinder-quobyte-9e5d565a-443c-4dfe-8229-73244d830fee" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:44:09 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-a93ae2af-0589-41a6-83be-88f004174288 tempest-CinderUnicodeTest-1860100501 None] Lock "cinder-quobyte-9e5d565a-443c-4dfe-8229-73244d830fee" acquired by "delete_volume" :: waited 0.019s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:44:09 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d38761-9c54-4ab9-9fef-8e12b6bb11ef]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:44:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a93ae2af-0589-41a6-83be-88f004174288 tempest-CinderUnicodeTest-1860100501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9e5d565a-443c-4dfe-8229-73244d830fee {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:09 devstack sudo[109464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9e5d565a-443c-4dfe-8229-73244d830fee Jun 23 16:44:09 devstack sudo[109464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:10 devstack sudo[109464]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a93ae2af-0589-41a6-83be-88f004174288 tempest-CinderUnicodeTest-1860100501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9e5d565a-443c-4dfe-8229-73244d830fee" returned: 0 in 1.146s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a93ae2af-0589-41a6-83be-88f004174288 tempest-CinderUnicodeTest-1860100501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9e5d565a-443c-4dfe-8229-73244d830fee {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:10 devstack sudo[109473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9e5d565a-443c-4dfe-8229-73244d830fee Jun 23 16:44:10 devstack sudo[109473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:11 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8e445ee-f8d8-4820-878b-de619437c5ab tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:44:11 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f8e445ee-f8d8-4820-878b-de619437c5ab tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Flow 'volume_create_manager' (17e5fcf4-456d-47ad-ba87-93d5f1c0f26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:44:11 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f8e445ee-f8d8-4820-878b-de619437c5ab tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6533e708-0eba-4438-8b6f-4ea2ec14ee94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:11 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f8e445ee-f8d8-4820-878b-de619437c5ab tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6533e708-0eba-4438-8b6f-4ea2ec14ee94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:44:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1665557117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1c01498-9655-4896-8b2c-4a1e8cc21023,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b578d45b53c54c238f952d1d311c0b4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:44:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:44:11Z,use_quota=True,user_id='bb2a53a811ee40ef88c9c89af12d9cfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:11 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f8e445ee-f8d8-4820-878b-de619437c5ab tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e4e4524-794d-4b21-8daf-3fafe726c00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:11 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f8e445ee-f8d8-4820-878b-de619437c5ab tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e4e4524-794d-4b21-8daf-3fafe726c00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:11 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f8e445ee-f8d8-4820-878b-de619437c5ab tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41a69500-e7dd-4bc4-a1c2-5363ddac542c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:11 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f8e445ee-f8d8-4820-878b-de619437c5ab tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41a69500-e7dd-4bc4-a1c2-5363ddac542c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1c01498-9655-4896-8b2c-4a1e8cc21023', 'volume_name': 'volume-c1c01498-9655-4896-8b2c-4a1e8cc21023', 'volume_size': 2}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:11 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f8e445ee-f8d8-4820-878b-de619437c5ab tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (283c840e-8348-40f9-a435-a2a228832b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:11 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f8e445ee-f8d8-4820-878b-de619437c5ab tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (283c840e-8348-40f9-a435-a2a228832b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:11 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f8e445ee-f8d8-4820-878b-de619437c5ab tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1df64eed-72ef-448b-84d8-2ffbe73b4c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:11 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-f8e445ee-f8d8-4820-878b-de619437c5ab tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Volume c1c01498-9655-4896-8b2c-4a1e8cc21023: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1c01498-9655-4896-8b2c-4a1e8cc21023', 'volume_size': 2} Jun 23 16:44:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f8e445ee-f8d8-4820-878b-de619437c5ab tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:44:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f8e445ee-f8d8-4820-878b-de619437c5ab tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:44:11 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-f8e445ee-f8d8-4820-878b-de619437c5ab tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:44:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1665557117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1c01498-9655-4896-8b2c-4a1e8cc21023,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b578d45b53c54c238f952d1d311c0b4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:44:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:44:11Z,use_quota=True,user_id='bb2a53a811ee40ef88c9c89af12d9cfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:44:11 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-f8e445ee-f8d8-4820-878b-de619437c5ab tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Creating volume c1c01498-9655-4896-8b2c-4a1e8cc21023 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:44:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f8e445ee-f8d8-4820-878b-de619437c5ab tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:44:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f8e445ee-f8d8-4820-878b-de619437c5ab tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:44:11 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-f8e445ee-f8d8-4820-878b-de619437c5ab tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:44:11 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-f8e445ee-f8d8-4820-878b-de619437c5ab tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:44:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f8e445ee-f8d8-4820-878b-de619437c5ab tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:44:11 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-f8e445ee-f8d8-4820-878b-de619437c5ab tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:44:11 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-f8e445ee-f8d8-4820-878b-de619437c5ab tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:44:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f8e445ee-f8d8-4820-878b-de619437c5ab tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c1c01498-9655-4896-8b2c-4a1e8cc21023 2147483648 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:11 devstack sudo[109475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c1c01498-9655-4896-8b2c-4a1e8cc21023 2147483648 Jun 23 16:44:11 devstack sudo[109475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:11 devstack sudo[109473]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a93ae2af-0589-41a6-83be-88f004174288 tempest-CinderUnicodeTest-1860100501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9e5d565a-443c-4dfe-8229-73244d830fee" returned: 0 in 0.891s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:11 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-a93ae2af-0589-41a6-83be-88f004174288 tempest-CinderUnicodeTest-1860100501 None] Lock "cinder-quobyte-9e5d565a-443c-4dfe-8229-73244d830fee" released by "delete_volume" :: held 2.102s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:44:11 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-a93ae2af-0589-41a6-83be-88f004174288 tempest-CinderUnicodeTest-1860100501 None] Created reservations ['c9c7e9ca-3711-40f7-b69a-de7857af9dce', '68bf9727-b3e1-4914-8162-91b1cc1daeb6', '6eb012fb-b343-4403-af54-0b2818d9f380', '0954b015-b6bb-4fd0-ae5a-72c586d71dd8'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:44:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a93ae2af-0589-41a6-83be-88f004174288 tempest-CinderUnicodeTest-1860100501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:44:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a93ae2af-0589-41a6-83be-88f004174288 tempest-CinderUnicodeTest-1860100501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:44:11 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-a93ae2af-0589-41a6-83be-88f004174288 tempest-CinderUnicodeTest-1860100501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:44:11 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-a93ae2af-0589-41a6-83be-88f004174288 tempest-CinderUnicodeTest-1860100501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:44:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a93ae2af-0589-41a6-83be-88f004174288 tempest-CinderUnicodeTest-1860100501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:44:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a93ae2af-0589-41a6-83be-88f004174288 tempest-CinderUnicodeTest-1860100501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:11 devstack sudo[109493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:44:11 devstack sudo[109493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:12 devstack sudo[109475]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f8e445ee-f8d8-4820-878b-de619437c5ab tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c1c01498-9655-4896-8b2c-4a1e8cc21023 2147483648" returned: 0 in 1.246s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f8e445ee-f8d8-4820-878b-de619437c5ab tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c1c01498-9655-4896-8b2c-4a1e8cc21023 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:12 devstack sudo[109518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c1c01498-9655-4896-8b2c-4a1e8cc21023 Jun 23 16:44:12 devstack sudo[109518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:13 devstack sudo[109493]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a93ae2af-0589-41a6-83be-88f004174288 tempest-CinderUnicodeTest-1860100501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.156s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:13 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-a93ae2af-0589-41a6-83be-88f004174288 tempest-CinderUnicodeTest-1860100501 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:44:13 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-a93ae2af-0589-41a6-83be-88f004174288 tempest-CinderUnicodeTest-1860100501 None] Deleted volume successfully. Jun 23 16:44:13 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-a93ae2af-0589-41a6-83be-88f004174288 tempest-CinderUnicodeTest-1860100501 None] Lock "cinder-9e5d565a-443c-4dfe-8229-73244d830fee-delete_volume" released by "delete_volume" :: held 3.653s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:44:13 devstack sudo[109518]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f8e445ee-f8d8-4820-878b-de619437c5ab tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c1c01498-9655-4896-8b2c-4a1e8cc21023" returned: 0 in 1.413s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:13 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-f8e445ee-f8d8-4820-878b-de619437c5ab tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] <== create_volume: return (2746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:44:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f8e445ee-f8d8-4820-878b-de619437c5ab tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.748s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:44:14 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f8e445ee-f8d8-4820-878b-de619437c5ab tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1df64eed-72ef-448b-84d8-2ffbe73b4c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1c01498-9655-4896-8b2c-4a1e8cc21023', 'volume_size': 2}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:14 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f8e445ee-f8d8-4820-878b-de619437c5ab tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71c9f7de-6eaf-4c24-a299-d97a6ec997db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:14 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-f8e445ee-f8d8-4820-878b-de619437c5ab tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Volume volume-c1c01498-9655-4896-8b2c-4a1e8cc21023 (c1c01498-9655-4896-8b2c-4a1e8cc21023): created successfully Jun 23 16:44:14 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f8e445ee-f8d8-4820-878b-de619437c5ab tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71c9f7de-6eaf-4c24-a299-d97a6ec997db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:14 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f8e445ee-f8d8-4820-878b-de619437c5ab tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Flow 'volume_create_manager' (17e5fcf4-456d-47ad-ba87-93d5f1c0f26b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:44:14 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-f8e445ee-f8d8-4820-878b-de619437c5ab tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Created volume successfully. Jun 23 16:44:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b6592073-fe66-429f-bccc-cfa6f415b4a3 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:44:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b6592073-fe66-429f-bccc-cfa6f415b4a3 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:44:14 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-b6592073-fe66-429f-bccc-cfa6f415b4a3 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Creating offline snapshot 7fd4ae60-f276-491c-a14a-614b3586aefe of volume c1c01498-9655-4896-8b2c-4a1e8cc21023 {{(pid=93788) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:44:14 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b361fa7d-1ff1-4c44-95f2-d0436c8a354e]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:44:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b6592073-fe66-429f-bccc-cfa6f415b4a3 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c1c01498-9655-4896-8b2c-4a1e8cc21023 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:15 devstack sudo[109574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c1c01498-9655-4896-8b2c-4a1e8cc21023 Jun 23 16:44:15 devstack sudo[109574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:16 devstack sudo[109574]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b6592073-fe66-429f-bccc-cfa6f415b4a3 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c1c01498-9655-4896-8b2c-4a1e8cc21023" returned: 0 in 1.360s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b6592073-fe66-429f-bccc-cfa6f415b4a3 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c1c01498-9655-4896-8b2c-4a1e8cc21023,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c1c01498-9655-4896-8b2c-4a1e8cc21023.7fd4ae60-f276-491c-a14a-614b3586aefe 2G {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:16 devstack sudo[109581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c1c01498-9655-4896-8b2c-4a1e8cc21023,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c1c01498-9655-4896-8b2c-4a1e8cc21023.7fd4ae60-f276-491c-a14a-614b3586aefe 2G Jun 23 16:44:16 devstack sudo[109581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:17 devstack sudo[109581]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b6592073-fe66-429f-bccc-cfa6f415b4a3 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c1c01498-9655-4896-8b2c-4a1e8cc21023,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c1c01498-9655-4896-8b2c-4a1e8cc21023.7fd4ae60-f276-491c-a14a-614b3586aefe 2G" returned: 0 in 1.311s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b6592073-fe66-429f-bccc-cfa6f415b4a3 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1c01498-9655-4896-8b2c-4a1e8cc21023 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c1c01498-9655-4896-8b2c-4a1e8cc21023.7fd4ae60-f276-491c-a14a-614b3586aefe {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:17 devstack sudo[109587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1c01498-9655-4896-8b2c-4a1e8cc21023 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c1c01498-9655-4896-8b2c-4a1e8cc21023.7fd4ae60-f276-491c-a14a-614b3586aefe Jun 23 16:44:17 devstack sudo[109587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:18 devstack sudo[109587]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:18 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b6592073-fe66-429f-bccc-cfa6f415b4a3 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1c01498-9655-4896-8b2c-4a1e8cc21023 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c1c01498-9655-4896-8b2c-4a1e8cc21023.7fd4ae60-f276-491c-a14a-614b3586aefe" returned: 0 in 1.085s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:18 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-b6592073-fe66-429f-bccc-cfa6f415b4a3 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c1c01498-9655-4896-8b2c-4a1e8cc21023.7fd4ae60-f276-491c-a14a-614b3586aefe is being set with open permissions: ugo+rw Jun 23 16:44:18 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b6592073-fe66-429f-bccc-cfa6f415b4a3 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c1c01498-9655-4896-8b2c-4a1e8cc21023.7fd4ae60-f276-491c-a14a-614b3586aefe {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:18 devstack sudo[109593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c1c01498-9655-4896-8b2c-4a1e8cc21023.7fd4ae60-f276-491c-a14a-614b3586aefe Jun 23 16:44:18 devstack sudo[109593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:19 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fbaf64d-f047-4a1b-9b46-2e72154f0436 tempest-TestMinimumBasicScenario-494903709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:44:19 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5fbaf64d-f047-4a1b-9b46-2e72154f0436 tempest-TestMinimumBasicScenario-494903709 None] Flow 'volume_create_manager' (93d9fb0f-77e4-465d-923f-c2abd7a82b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:44:19 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5fbaf64d-f047-4a1b-9b46-2e72154f0436 tempest-TestMinimumBasicScenario-494903709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cde41df-c27d-4c4b-8e82-5d667beda7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:19 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5fbaf64d-f047-4a1b-9b46-2e72154f0436 tempest-TestMinimumBasicScenario-494903709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cde41df-c27d-4c4b-8e82-5d667beda7df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:44:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1452317608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b672584d-3406-45b6-a8be-d9d44e47df66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24c858afa9404d7fbf28ad344b54823c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:44:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:44:19Z,use_quota=True,user_id='0d1389b7be974c4c8b36021574862c7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:19 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5fbaf64d-f047-4a1b-9b46-2e72154f0436 tempest-TestMinimumBasicScenario-494903709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75067902-b91b-4e1f-b66f-abd84ce269d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:19 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5fbaf64d-f047-4a1b-9b46-2e72154f0436 tempest-TestMinimumBasicScenario-494903709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75067902-b91b-4e1f-b66f-abd84ce269d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:19 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5fbaf64d-f047-4a1b-9b46-2e72154f0436 tempest-TestMinimumBasicScenario-494903709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8246ca44-0209-4c4c-98ec-cfe38d24b91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:19 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5fbaf64d-f047-4a1b-9b46-2e72154f0436 tempest-TestMinimumBasicScenario-494903709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8246ca44-0209-4c4c-98ec-cfe38d24b91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b672584d-3406-45b6-a8be-d9d44e47df66', 'volume_name': 'volume-b672584d-3406-45b6-a8be-d9d44e47df66', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:19 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5fbaf64d-f047-4a1b-9b46-2e72154f0436 tempest-TestMinimumBasicScenario-494903709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c268a62e-da18-4745-9b97-a1b034f0fe0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:19 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5fbaf64d-f047-4a1b-9b46-2e72154f0436 tempest-TestMinimumBasicScenario-494903709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c268a62e-da18-4745-9b97-a1b034f0fe0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:19 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5fbaf64d-f047-4a1b-9b46-2e72154f0436 tempest-TestMinimumBasicScenario-494903709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca03a05d-be72-4a10-ba49-1922b22f54a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:19 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-5fbaf64d-f047-4a1b-9b46-2e72154f0436 tempest-TestMinimumBasicScenario-494903709 None] Volume b672584d-3406-45b6-a8be-d9d44e47df66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b672584d-3406-45b6-a8be-d9d44e47df66', 'volume_size': 1} Jun 23 16:44:19 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5fbaf64d-f047-4a1b-9b46-2e72154f0436 tempest-TestMinimumBasicScenario-494903709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:44:19 devstack sudo[109593]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:19 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b6592073-fe66-429f-bccc-cfa6f415b4a3 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c1c01498-9655-4896-8b2c-4a1e8cc21023.7fd4ae60-f276-491c-a14a-614b3586aefe" returned: 0 in 0.931s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:19 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b6592073-fe66-429f-bccc-cfa6f415b4a3 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c1c01498-9655-4896-8b2c-4a1e8cc21023.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:19 devstack sudo[109597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c1c01498-9655-4896-8b2c-4a1e8cc21023.info Jun 23 16:44:19 devstack sudo[109597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:20 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b6592073-fe66-429f-bccc-cfa6f415b4a3 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c1c01498-9655-4896-8b2c-4a1e8cc21023.info" returned: 0 in 0.835s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:20 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-b6592073-fe66-429f-bccc-cfa6f415b4a3 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c1c01498-9655-4896-8b2c-4a1e8cc21023.info is being set with open permissions: ugo+rw Jun 23 16:44:20 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b6592073-fe66-429f-bccc-cfa6f415b4a3 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c1c01498-9655-4896-8b2c-4a1e8cc21023.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:20 devstack sudo[109597]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:20 devstack sudo[109600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c1c01498-9655-4896-8b2c-4a1e8cc21023.info Jun 23 16:44:20 devstack sudo[109600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:21 devstack sudo[109600]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b6592073-fe66-429f-bccc-cfa6f415b4a3 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c1c01498-9655-4896-8b2c-4a1e8cc21023.info" returned: 0 in 0.729s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b6592073-fe66-429f-bccc-cfa6f415b4a3 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.428s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:44:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5fbaf64d-f047-4a1b-9b46-2e72154f0436 tempest-TestMinimumBasicScenario-494903709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.690s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:44:21 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-5fbaf64d-f047-4a1b-9b46-2e72154f0436 tempest-TestMinimumBasicScenario-494903709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:44:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1452317608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b672584d-3406-45b6-a8be-d9d44e47df66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24c858afa9404d7fbf28ad344b54823c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:44:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:44:19Z,use_quota=True,user_id='0d1389b7be974c4c8b36021574862c7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:44:21 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-5fbaf64d-f047-4a1b-9b46-2e72154f0436 tempest-TestMinimumBasicScenario-494903709 None] Creating volume b672584d-3406-45b6-a8be-d9d44e47df66 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:44:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5fbaf64d-f047-4a1b-9b46-2e72154f0436 tempest-TestMinimumBasicScenario-494903709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:44:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5fbaf64d-f047-4a1b-9b46-2e72154f0436 tempest-TestMinimumBasicScenario-494903709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:44:21 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-5fbaf64d-f047-4a1b-9b46-2e72154f0436 tempest-TestMinimumBasicScenario-494903709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:44:21 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-5fbaf64d-f047-4a1b-9b46-2e72154f0436 tempest-TestMinimumBasicScenario-494903709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:44:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5fbaf64d-f047-4a1b-9b46-2e72154f0436 tempest-TestMinimumBasicScenario-494903709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:44:21 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-5fbaf64d-f047-4a1b-9b46-2e72154f0436 tempest-TestMinimumBasicScenario-494903709 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:44:21 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-5fbaf64d-f047-4a1b-9b46-2e72154f0436 tempest-TestMinimumBasicScenario-494903709 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:44:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5fbaf64d-f047-4a1b-9b46-2e72154f0436 tempest-TestMinimumBasicScenario-494903709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b672584d-3406-45b6-a8be-d9d44e47df66 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:21 devstack sudo[109603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b672584d-3406-45b6-a8be-d9d44e47df66 1073741824 Jun 23 16:44:21 devstack sudo[109603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:21 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-b6592073-fe66-429f-bccc-cfa6f415b4a3 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Create snapshot completed successfully Jun 23 16:44:22 devstack sudo[109603]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5fbaf64d-f047-4a1b-9b46-2e72154f0436 tempest-TestMinimumBasicScenario-494903709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b672584d-3406-45b6-a8be-d9d44e47df66 1073741824" returned: 0 in 1.027s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5fbaf64d-f047-4a1b-9b46-2e72154f0436 tempest-TestMinimumBasicScenario-494903709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b672584d-3406-45b6-a8be-d9d44e47df66 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:22 devstack sudo[109609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b672584d-3406-45b6-a8be-d9d44e47df66 Jun 23 16:44:22 devstack sudo[109609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:22 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e6cbefb3-35c3-4bf4-a022-37cac0b785f4 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Acquiring lock "cinder-7fd4ae60-f276-491c-a14a-614b3586aefe-delete_snapshot" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:44:22 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e6cbefb3-35c3-4bf4-a022-37cac0b785f4 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Lock "cinder-7fd4ae60-f276-491c-a14a-614b3586aefe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:44:22 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e6cbefb3-35c3-4bf4-a022-37cac0b785f4 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Acquiring lock "cinder-quobyte-c1c01498-9655-4896-8b2c-4a1e8cc21023" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:44:22 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e6cbefb3-35c3-4bf4-a022-37cac0b785f4 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Lock "cinder-quobyte-c1c01498-9655-4896-8b2c-4a1e8cc21023" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:44:22 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e6cbefb3-35c3-4bf4-a022-37cac0b785f4 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Acquiring lock "cinder-quobyte-7fd4ae60-f276-491c-a14a-614b3586aefe" by "_delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:44:22 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e6cbefb3-35c3-4bf4-a022-37cac0b785f4 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Lock "cinder-quobyte-7fd4ae60-f276-491c-a14a-614b3586aefe" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:44:22 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-e6cbefb3-35c3-4bf4-a022-37cac0b785f4 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Deleting offline snapshot 7fd4ae60-f276-491c-a14a-614b3586aefe of volume c1c01498-9655-4896-8b2c-4a1e8cc21023 {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:44:22 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-e6cbefb3-35c3-4bf4-a022-37cac0b785f4 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] snapshot_file for this snap is: volume-c1c01498-9655-4896-8b2c-4a1e8cc21023.7fd4ae60-f276-491c-a14a-614b3586aefe {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:44:22 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec7dd7b-5111-459b-914a-64e53cf7040f]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:44:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e6cbefb3-35c3-4bf4-a022-37cac0b785f4 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c1c01498-9655-4896-8b2c-4a1e8cc21023.7fd4ae60-f276-491c-a14a-614b3586aefe {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:22 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-43d19b86-ed9a-4a0f-ba6a-33a2dae56a50 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:44:22 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-43d19b86-ed9a-4a0f-ba6a-33a2dae56a50 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Flow 'volume_create_manager' (828515e0-c205-403f-92e2-7d0232d70ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:44:22 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-43d19b86-ed9a-4a0f-ba6a-33a2dae56a50 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14d80337-1e99-4ef4-a956-2acf6265bb2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:22 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-43d19b86-ed9a-4a0f-ba6a-33a2dae56a50 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14d80337-1e99-4ef4-a956-2acf6265bb2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:44:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1370856894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=315e3edd-c8a8-413f-8008-dfe4e5961685,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4954058dc8dd4ee5aa442e7f5f95740b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:44:23Z,use_quota=True,user_id='29173dda70c54ca3a5cbac76e5e7533d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:22 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-43d19b86-ed9a-4a0f-ba6a-33a2dae56a50 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73d1bfa1-aee3-488a-909e-60a555bbf4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:22 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-43d19b86-ed9a-4a0f-ba6a-33a2dae56a50 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73d1bfa1-aee3-488a-909e-60a555bbf4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:22 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-43d19b86-ed9a-4a0f-ba6a-33a2dae56a50 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a95caf18-bfa9-4be6-a863-ec333a70bcd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:22 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-43d19b86-ed9a-4a0f-ba6a-33a2dae56a50 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a95caf18-bfa9-4be6-a863-ec333a70bcd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '315e3edd-c8a8-413f-8008-dfe4e5961685', 'volume_name': 'volume-315e3edd-c8a8-413f-8008-dfe4e5961685', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:22 devstack sudo[109611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c1c01498-9655-4896-8b2c-4a1e8cc21023.7fd4ae60-f276-491c-a14a-614b3586aefe Jun 23 16:44:22 devstack sudo[109611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:22 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-43d19b86-ed9a-4a0f-ba6a-33a2dae56a50 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e2d7f79-d3e6-4c89-9ef0-4efeec4ed0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:22 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-43d19b86-ed9a-4a0f-ba6a-33a2dae56a50 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e2d7f79-d3e6-4c89-9ef0-4efeec4ed0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:22 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-43d19b86-ed9a-4a0f-ba6a-33a2dae56a50 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f04cd02-f618-4bb4-9083-b69bed64bfd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:22 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-43d19b86-ed9a-4a0f-ba6a-33a2dae56a50 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Volume 315e3edd-c8a8-413f-8008-dfe4e5961685: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-315e3edd-c8a8-413f-8008-dfe4e5961685', 'volume_size': 1} Jun 23 16:44:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-43d19b86-ed9a-4a0f-ba6a-33a2dae56a50 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:44:23 devstack sudo[109609]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5fbaf64d-f047-4a1b-9b46-2e72154f0436 tempest-TestMinimumBasicScenario-494903709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b672584d-3406-45b6-a8be-d9d44e47df66" returned: 0 in 0.830s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:23 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-5fbaf64d-f047-4a1b-9b46-2e72154f0436 tempest-TestMinimumBasicScenario-494903709 None] <== create_volume: return (1930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:44:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5fbaf64d-f047-4a1b-9b46-2e72154f0436 tempest-TestMinimumBasicScenario-494903709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.934s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:44:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-43d19b86-ed9a-4a0f-ba6a-33a2dae56a50 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.467s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:44:23 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-43d19b86-ed9a-4a0f-ba6a-33a2dae56a50 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:44:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1370856894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=315e3edd-c8a8-413f-8008-dfe4e5961685,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4954058dc8dd4ee5aa442e7f5f95740b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:44:23Z,use_quota=True,user_id='29173dda70c54ca3a5cbac76e5e7533d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:44:23 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-43d19b86-ed9a-4a0f-ba6a-33a2dae56a50 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Creating volume 315e3edd-c8a8-413f-8008-dfe4e5961685 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:44:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-43d19b86-ed9a-4a0f-ba6a-33a2dae56a50 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:44:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-43d19b86-ed9a-4a0f-ba6a-33a2dae56a50 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:44:23 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-43d19b86-ed9a-4a0f-ba6a-33a2dae56a50 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:44:23 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-43d19b86-ed9a-4a0f-ba6a-33a2dae56a50 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:44:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-43d19b86-ed9a-4a0f-ba6a-33a2dae56a50 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:44:23 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-43d19b86-ed9a-4a0f-ba6a-33a2dae56a50 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:44:23 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-43d19b86-ed9a-4a0f-ba6a-33a2dae56a50 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:44:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-43d19b86-ed9a-4a0f-ba6a-33a2dae56a50 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-315e3edd-c8a8-413f-8008-dfe4e5961685 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:23 devstack sudo[109614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-315e3edd-c8a8-413f-8008-dfe4e5961685 1073741824 Jun 23 16:44:23 devstack sudo[109614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:23 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5fbaf64d-f047-4a1b-9b46-2e72154f0436 tempest-TestMinimumBasicScenario-494903709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca03a05d-be72-4a10-ba49-1922b22f54a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b672584d-3406-45b6-a8be-d9d44e47df66', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:23 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5fbaf64d-f047-4a1b-9b46-2e72154f0436 tempest-TestMinimumBasicScenario-494903709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6483f869-6411-4092-8de4-4bfd7bafa287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:23 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-5fbaf64d-f047-4a1b-9b46-2e72154f0436 tempest-TestMinimumBasicScenario-494903709 None] Volume volume-b672584d-3406-45b6-a8be-d9d44e47df66 (b672584d-3406-45b6-a8be-d9d44e47df66): created successfully Jun 23 16:44:23 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5fbaf64d-f047-4a1b-9b46-2e72154f0436 tempest-TestMinimumBasicScenario-494903709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6483f869-6411-4092-8de4-4bfd7bafa287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:23 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-5fbaf64d-f047-4a1b-9b46-2e72154f0436 tempest-TestMinimumBasicScenario-494903709 None] Flow 'volume_create_manager' (93d9fb0f-77e4-465d-923f-c2abd7a82b6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:44:23 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-5fbaf64d-f047-4a1b-9b46-2e72154f0436 tempest-TestMinimumBasicScenario-494903709 None] Created volume successfully. Jun 23 16:44:23 devstack sudo[109611]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e6cbefb3-35c3-4bf4-a022-37cac0b785f4 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c1c01498-9655-4896-8b2c-4a1e8cc21023.7fd4ae60-f276-491c-a14a-614b3586aefe" returned: 0 in 0.885s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:23 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-e6cbefb3-35c3-4bf4-a022-37cac0b785f4 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1c01498-9655-4896-8b2c-4a1e8cc21023(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:44:23 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[69aabdc5-c932-4968-8144-78d8dc3acc25]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:44:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e6cbefb3-35c3-4bf4-a022-37cac0b785f4 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c1c01498-9655-4896-8b2c-4a1e8cc21023 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:23 devstack sudo[109619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c1c01498-9655-4896-8b2c-4a1e8cc21023 Jun 23 16:44:23 devstack sudo[109619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:24 devstack sudo[109614]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-43d19b86-ed9a-4a0f-ba6a-33a2dae56a50 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-315e3edd-c8a8-413f-8008-dfe4e5961685 1073741824" returned: 0 in 1.009s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-43d19b86-ed9a-4a0f-ba6a-33a2dae56a50 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-315e3edd-c8a8-413f-8008-dfe4e5961685 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:24 devstack sudo[109628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-315e3edd-c8a8-413f-8008-dfe4e5961685 Jun 23 16:44:24 devstack sudo[109628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:24 devstack sudo[109619]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e6cbefb3-35c3-4bf4-a022-37cac0b785f4 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c1c01498-9655-4896-8b2c-4a1e8cc21023" returned: 0 in 1.001s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e6cbefb3-35c3-4bf4-a022-37cac0b785f4 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c1c01498-9655-4896-8b2c-4a1e8cc21023.7fd4ae60-f276-491c-a14a-614b3586aefe {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:24 devstack sudo[109633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c1c01498-9655-4896-8b2c-4a1e8cc21023.7fd4ae60-f276-491c-a14a-614b3586aefe Jun 23 16:44:24 devstack sudo[109633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:25 devstack sudo[109628]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-43d19b86-ed9a-4a0f-ba6a-33a2dae56a50 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-315e3edd-c8a8-413f-8008-dfe4e5961685" returned: 0 in 0.741s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:25 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-43d19b86-ed9a-4a0f-ba6a-33a2dae56a50 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] <== create_volume: return (1816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:44:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-43d19b86-ed9a-4a0f-ba6a-33a2dae56a50 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.819s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:44:25 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-43d19b86-ed9a-4a0f-ba6a-33a2dae56a50 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f04cd02-f618-4bb4-9083-b69bed64bfd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-315e3edd-c8a8-413f-8008-dfe4e5961685', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:25 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-43d19b86-ed9a-4a0f-ba6a-33a2dae56a50 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (643612bf-ed9d-415a-b380-348013d923c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:25 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-43d19b86-ed9a-4a0f-ba6a-33a2dae56a50 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Volume volume-315e3edd-c8a8-413f-8008-dfe4e5961685 (315e3edd-c8a8-413f-8008-dfe4e5961685): created successfully Jun 23 16:44:25 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-43d19b86-ed9a-4a0f-ba6a-33a2dae56a50 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (643612bf-ed9d-415a-b380-348013d923c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:25 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-43d19b86-ed9a-4a0f-ba6a-33a2dae56a50 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Flow 'volume_create_manager' (828515e0-c205-403f-92e2-7d0232d70ad3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:44:25 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-43d19b86-ed9a-4a0f-ba6a-33a2dae56a50 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Created volume successfully. Jun 23 16:44:25 devstack sudo[109633]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e6cbefb3-35c3-4bf4-a022-37cac0b785f4 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c1c01498-9655-4896-8b2c-4a1e8cc21023.7fd4ae60-f276-491c-a14a-614b3586aefe" returned: 0 in 0.873s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e6cbefb3-35c3-4bf4-a022-37cac0b785f4 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c1c01498-9655-4896-8b2c-4a1e8cc21023.7fd4ae60-f276-491c-a14a-614b3586aefe {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:25 devstack sudo[109640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c1c01498-9655-4896-8b2c-4a1e8cc21023.7fd4ae60-f276-491c-a14a-614b3586aefe Jun 23 16:44:25 devstack sudo[109640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:26 devstack sudo[109640]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e6cbefb3-35c3-4bf4-a022-37cac0b785f4 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c1c01498-9655-4896-8b2c-4a1e8cc21023.7fd4ae60-f276-491c-a14a-614b3586aefe" returned: 0 in 0.736s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:26 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:UPDATE=115,cinder:SELECT=95,cinder:INSERT=27,cinder:DELETE=8 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:44:26 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e6cbefb3-35c3-4bf4-a022-37cac0b785f4 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Lock "cinder-quobyte-7fd4ae60-f276-491c-a14a-614b3586aefe" released by "_delete_snapshot" :: held 3.667s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:44:26 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e6cbefb3-35c3-4bf4-a022-37cac0b785f4 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Lock "cinder-quobyte-c1c01498-9655-4896-8b2c-4a1e8cc21023" released by "delete_snapshot" :: held 3.714s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:44:26 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-b04acc63-ae76-4b3d-bd28-2e7c3da70560 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:44:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b04acc63-ae76-4b3d-bd28-2e7c3da70560 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Flow 'volume_create_manager' (d19e6400-9f5c-4fd4-a922-7213d06d8068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:44:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b04acc63-ae76-4b3d-bd28-2e7c3da70560 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26d65d78-9cc9-4481-b08f-90c763dfac7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b04acc63-ae76-4b3d-bd28-2e7c3da70560 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26d65d78-9cc9-4481-b08f-90c763dfac7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:44:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1918197392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35bf5e5f-ad7f-401d-8053-286f319f406c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4954058dc8dd4ee5aa442e7f5f95740b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:44:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:44:26Z,use_quota=True,user_id='29173dda70c54ca3a5cbac76e5e7533d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b04acc63-ae76-4b3d-bd28-2e7c3da70560 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a6adbd1-36ee-4003-80e1-62df35b753dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b04acc63-ae76-4b3d-bd28-2e7c3da70560 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a6adbd1-36ee-4003-80e1-62df35b753dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b04acc63-ae76-4b3d-bd28-2e7c3da70560 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98c30232-5839-4b68-8731-f4d13f860202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b04acc63-ae76-4b3d-bd28-2e7c3da70560 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98c30232-5839-4b68-8731-f4d13f860202) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35bf5e5f-ad7f-401d-8053-286f319f406c', 'volume_name': 'volume-35bf5e5f-ad7f-401d-8053-286f319f406c', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b04acc63-ae76-4b3d-bd28-2e7c3da70560 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9d3dc40-926f-4686-b618-007b207e90af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b04acc63-ae76-4b3d-bd28-2e7c3da70560 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9d3dc40-926f-4686-b618-007b207e90af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b04acc63-ae76-4b3d-bd28-2e7c3da70560 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6fef0bd-609f-4f23-99cc-35dca6aadf00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:26 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-b04acc63-ae76-4b3d-bd28-2e7c3da70560 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Volume 35bf5e5f-ad7f-401d-8053-286f319f406c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35bf5e5f-ad7f-401d-8053-286f319f406c', 'volume_size': 1} Jun 23 16:44:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b04acc63-ae76-4b3d-bd28-2e7c3da70560 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:44:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b04acc63-ae76-4b3d-bd28-2e7c3da70560 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:44:26 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b04acc63-ae76-4b3d-bd28-2e7c3da70560 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:44:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1918197392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35bf5e5f-ad7f-401d-8053-286f319f406c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4954058dc8dd4ee5aa442e7f5f95740b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:44:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:44:26Z,use_quota=True,user_id='29173dda70c54ca3a5cbac76e5e7533d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:44:26 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-b04acc63-ae76-4b3d-bd28-2e7c3da70560 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Creating volume 35bf5e5f-ad7f-401d-8053-286f319f406c {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:44:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b04acc63-ae76-4b3d-bd28-2e7c3da70560 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:44:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b04acc63-ae76-4b3d-bd28-2e7c3da70560 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:44:26 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b04acc63-ae76-4b3d-bd28-2e7c3da70560 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:44:26 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b04acc63-ae76-4b3d-bd28-2e7c3da70560 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:44:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b04acc63-ae76-4b3d-bd28-2e7c3da70560 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:44:26 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b04acc63-ae76-4b3d-bd28-2e7c3da70560 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:44:26 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-b04acc63-ae76-4b3d-bd28-2e7c3da70560 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:44:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b04acc63-ae76-4b3d-bd28-2e7c3da70560 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-35bf5e5f-ad7f-401d-8053-286f319f406c 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:26 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-e6cbefb3-35c3-4bf4-a022-37cac0b785f4 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Created reservations ['ba94449d-87db-48ca-9664-5a966ff8a856', '1231dc79-fa25-47c4-abd3-408749a5053d', 'a8faef5b-7bfc-49ae-a14b-01155713bb4d', '477d921e-0d38-48f6-97d6-91f7fc934e5f'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:44:26 devstack sudo[109643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-35bf5e5f-ad7f-401d-8053-286f319f406c 1073741824 Jun 23 16:44:26 devstack sudo[109643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:26 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-e6cbefb3-35c3-4bf4-a022-37cac0b785f4 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Delete snapshot completed successfully. Jun 23 16:44:26 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e6cbefb3-35c3-4bf4-a022-37cac0b785f4 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Lock "cinder-7fd4ae60-f276-491c-a14a-614b3586aefe-delete_snapshot" released by "delete_snapshot" :: held 4.178s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:44:26 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b71de46e-eb81-43a8-a39e-a11df51dab87 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Acquiring lock "cinder-c1c01498-9655-4896-8b2c-4a1e8cc21023-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:44:26 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b71de46e-eb81-43a8-a39e-a11df51dab87 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Lock "cinder-c1c01498-9655-4896-8b2c-4a1e8cc21023-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:44:26 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdcd0f89-4ff5-4fb5-831c-00a71bef8ea0 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:44:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-cdcd0f89-4ff5-4fb5-831c-00a71bef8ea0 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Flow 'volume_create_manager' (97b88498-edbf-4142-84f7-763596f19505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:44:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-cdcd0f89-4ff5-4fb5-831c-00a71bef8ea0 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a161ffdf-936f-429f-b78a-49431a6ded0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-cdcd0f89-4ff5-4fb5-831c-00a71bef8ea0 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a161ffdf-936f-429f-b78a-49431a6ded0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:44:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-618998624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c36a89f8-09d4-4cf8-aae9-e3d892defea7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4954058dc8dd4ee5aa442e7f5f95740b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:44:27Z,use_quota=True,user_id='29173dda70c54ca3a5cbac76e5e7533d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-cdcd0f89-4ff5-4fb5-831c-00a71bef8ea0 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86e80198-b9e1-4661-9968-2f46c68f00eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-cdcd0f89-4ff5-4fb5-831c-00a71bef8ea0 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86e80198-b9e1-4661-9968-2f46c68f00eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-cdcd0f89-4ff5-4fb5-831c-00a71bef8ea0 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6584a157-0070-4ae3-97e0-eced2916f516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-cdcd0f89-4ff5-4fb5-831c-00a71bef8ea0 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6584a157-0070-4ae3-97e0-eced2916f516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c36a89f8-09d4-4cf8-aae9-e3d892defea7', 'volume_name': 'volume-c36a89f8-09d4-4cf8-aae9-e3d892defea7', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-cdcd0f89-4ff5-4fb5-831c-00a71bef8ea0 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c009b038-2815-4c79-8333-cf29edd05243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-cdcd0f89-4ff5-4fb5-831c-00a71bef8ea0 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c009b038-2815-4c79-8333-cf29edd05243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-cdcd0f89-4ff5-4fb5-831c-00a71bef8ea0 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f827570a-949b-4a73-8a81-1926f72821f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:27 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-cdcd0f89-4ff5-4fb5-831c-00a71bef8ea0 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Volume c36a89f8-09d4-4cf8-aae9-e3d892defea7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c36a89f8-09d4-4cf8-aae9-e3d892defea7', 'volume_size': 1} Jun 23 16:44:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-cdcd0f89-4ff5-4fb5-831c-00a71bef8ea0 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:44:27 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b71de46e-eb81-43a8-a39e-a11df51dab87 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Acquiring lock "cinder-quobyte-c1c01498-9655-4896-8b2c-4a1e8cc21023" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:44:27 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b71de46e-eb81-43a8-a39e-a11df51dab87 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Lock "cinder-quobyte-c1c01498-9655-4896-8b2c-4a1e8cc21023" acquired by "delete_volume" :: waited 0.024s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:44:27 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b155a750-acf2-466a-8704-390d225ac526]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:44:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b71de46e-eb81-43a8-a39e-a11df51dab87 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c1c01498-9655-4896-8b2c-4a1e8cc21023 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:27 devstack sudo[109661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c1c01498-9655-4896-8b2c-4a1e8cc21023 Jun 23 16:44:27 devstack sudo[109661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:27 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef340771-6b2f-4cc0-83fc-6066a066432f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:44:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ef340771-6b2f-4cc0-83fc-6066a066432f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Flow 'volume_create_manager' (9bb4dac3-d3fa-4c70-a50a-a06b99a69f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:44:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ef340771-6b2f-4cc0-83fc-6066a066432f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92940750-1b4b-477e-afb7-efeb5f71cefb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ef340771-6b2f-4cc0-83fc-6066a066432f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92940750-1b4b-477e-afb7-efeb5f71cefb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-60346278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41f88b80-dd04-4fa2-96e2-3e97de7d2c0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4954058dc8dd4ee5aa442e7f5f95740b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:44:28Z,use_quota=True,user_id='29173dda70c54ca3a5cbac76e5e7533d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ef340771-6b2f-4cc0-83fc-6066a066432f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f5e78a6-3a9d-4f3c-b727-29dd5a9c581e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ef340771-6b2f-4cc0-83fc-6066a066432f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f5e78a6-3a9d-4f3c-b727-29dd5a9c581e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ef340771-6b2f-4cc0-83fc-6066a066432f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eccad3d-f3b3-43f0-ac80-de4c5059ae2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ef340771-6b2f-4cc0-83fc-6066a066432f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eccad3d-f3b3-43f0-ac80-de4c5059ae2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41f88b80-dd04-4fa2-96e2-3e97de7d2c0d', 'volume_name': 'volume-41f88b80-dd04-4fa2-96e2-3e97de7d2c0d', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ef340771-6b2f-4cc0-83fc-6066a066432f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64a6d1a9-fc19-4dae-830e-4f84370697fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ef340771-6b2f-4cc0-83fc-6066a066432f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64a6d1a9-fc19-4dae-830e-4f84370697fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ef340771-6b2f-4cc0-83fc-6066a066432f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21922662-e93b-4ffc-b043-3cf82a52132d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:27 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-ef340771-6b2f-4cc0-83fc-6066a066432f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Volume 41f88b80-dd04-4fa2-96e2-3e97de7d2c0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41f88b80-dd04-4fa2-96e2-3e97de7d2c0d', 'volume_size': 1} Jun 23 16:44:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ef340771-6b2f-4cc0-83fc-6066a066432f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:44:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-3ee86705-248b-4646-b9d3-659b13c8f8df req-1a933b2c-abd2-4fbe-b0ef-5ea55ae699fc tempest-TestMinimumBasicScenario-494903709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:44:27 devstack sudo[109643]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b04acc63-ae76-4b3d-bd28-2e7c3da70560 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-35bf5e5f-ad7f-401d-8053-286f319f406c 1073741824" returned: 0 in 1.444s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b04acc63-ae76-4b3d-bd28-2e7c3da70560 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-35bf5e5f-ad7f-401d-8053-286f319f406c {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:27 devstack sudo[109675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-35bf5e5f-ad7f-401d-8053-286f319f406c Jun 23 16:44:27 devstack sudo[109675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:28 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a99e088-339d-4c8a-939e-c1fdf2f5a445 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:44:28 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a99e088-339d-4c8a-939e-c1fdf2f5a445 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Flow 'volume_create_manager' (216285de-95ae-4a61-9196-a5fdccc07492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:44:28 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a99e088-339d-4c8a-939e-c1fdf2f5a445 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1227dc7-0ecb-46eb-9637-0137cf603283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:28 devstack sudo[109661]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b71de46e-eb81-43a8-a39e-a11df51dab87 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c1c01498-9655-4896-8b2c-4a1e8cc21023" returned: 0 in 1.053s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b71de46e-eb81-43a8-a39e-a11df51dab87 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c1c01498-9655-4896-8b2c-4a1e8cc21023 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:28 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a99e088-339d-4c8a-939e-c1fdf2f5a445 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1227dc7-0ecb-46eb-9637-0137cf603283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1714015975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c15c59ed-e19f-47af-8706-73ff7907e3fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4954058dc8dd4ee5aa442e7f5f95740b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:44:28Z,use_quota=True,user_id='29173dda70c54ca3a5cbac76e5e7533d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:28 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a99e088-339d-4c8a-939e-c1fdf2f5a445 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de9d2ae5-0e55-4829-a9f0-b30066878b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:28 devstack sudo[109681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c1c01498-9655-4896-8b2c-4a1e8cc21023 Jun 23 16:44:28 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a99e088-339d-4c8a-939e-c1fdf2f5a445 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de9d2ae5-0e55-4829-a9f0-b30066878b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:28 devstack sudo[109681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:28 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a99e088-339d-4c8a-939e-c1fdf2f5a445 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aee561a-7f00-4ad7-9532-57551eb51ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:28 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a99e088-339d-4c8a-939e-c1fdf2f5a445 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aee561a-7f00-4ad7-9532-57551eb51ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c15c59ed-e19f-47af-8706-73ff7907e3fa', 'volume_name': 'volume-c15c59ed-e19f-47af-8706-73ff7907e3fa', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:28 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a99e088-339d-4c8a-939e-c1fdf2f5a445 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c5946e5-e02a-4daa-86fe-f8e0d61cf30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:28 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a99e088-339d-4c8a-939e-c1fdf2f5a445 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c5946e5-e02a-4daa-86fe-f8e0d61cf30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:28 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a99e088-339d-4c8a-939e-c1fdf2f5a445 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcd676b6-6582-4e43-9bd7-b66d5297ab07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:28 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-0a99e088-339d-4c8a-939e-c1fdf2f5a445 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Volume c15c59ed-e19f-47af-8706-73ff7907e3fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c15c59ed-e19f-47af-8706-73ff7907e3fa', 'volume_size': 1} Jun 23 16:44:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-0a99e088-339d-4c8a-939e-c1fdf2f5a445 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:44:28 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-72846867-4979-41b6-9a60-94049e68f1af tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:44:28 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-72846867-4979-41b6-9a60-94049e68f1af tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Flow 'volume_create_manager' (4d65af0e-352c-49ce-b184-873f307a3f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:44:28 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-72846867-4979-41b6-9a60-94049e68f1af tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42d26aff-c95d-4d07-a787-000ce872e0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:28 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-72846867-4979-41b6-9a60-94049e68f1af tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42d26aff-c95d-4d07-a787-000ce872e0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-687994249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18ffdd3e-367a-447c-95e2-48daf7d1bd1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4954058dc8dd4ee5aa442e7f5f95740b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:44:28Z,use_quota=True,user_id='29173dda70c54ca3a5cbac76e5e7533d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:28 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-72846867-4979-41b6-9a60-94049e68f1af tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd789665-0019-421f-a788-5125a6fc4b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:28 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-72846867-4979-41b6-9a60-94049e68f1af tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd789665-0019-421f-a788-5125a6fc4b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:28 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-72846867-4979-41b6-9a60-94049e68f1af tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31806c8a-0bcc-4ead-83db-04fdc3ef087e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:28 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-72846867-4979-41b6-9a60-94049e68f1af tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31806c8a-0bcc-4ead-83db-04fdc3ef087e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18ffdd3e-367a-447c-95e2-48daf7d1bd1c', 'volume_name': 'volume-18ffdd3e-367a-447c-95e2-48daf7d1bd1c', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:28 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-72846867-4979-41b6-9a60-94049e68f1af tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d31f363-1ac7-4c4e-a32e-ded5c5bd3abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:28 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-72846867-4979-41b6-9a60-94049e68f1af tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d31f363-1ac7-4c4e-a32e-ded5c5bd3abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:28 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-72846867-4979-41b6-9a60-94049e68f1af tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (840561d6-6851-42c7-9cd0-da267e4fcb5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:28 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-72846867-4979-41b6-9a60-94049e68f1af tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Volume 18ffdd3e-367a-447c-95e2-48daf7d1bd1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18ffdd3e-367a-447c-95e2-48daf7d1bd1c', 'volume_size': 1} Jun 23 16:44:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-72846867-4979-41b6-9a60-94049e68f1af tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:44:28 devstack sudo[109675]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b04acc63-ae76-4b3d-bd28-2e7c3da70560 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-35bf5e5f-ad7f-401d-8053-286f319f406c" returned: 0 in 0.842s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:28 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b04acc63-ae76-4b3d-bd28-2e7c3da70560 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] <== create_volume: return (2345ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:44:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b04acc63-ae76-4b3d-bd28-2e7c3da70560 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.349s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:44:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-cdcd0f89-4ff5-4fb5-831c-00a71bef8ea0 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.659s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:44:28 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-cdcd0f89-4ff5-4fb5-831c-00a71bef8ea0 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:44:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-618998624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c36a89f8-09d4-4cf8-aae9-e3d892defea7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4954058dc8dd4ee5aa442e7f5f95740b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:44:27Z,use_quota=True,user_id='29173dda70c54ca3a5cbac76e5e7533d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:44:28 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-cdcd0f89-4ff5-4fb5-831c-00a71bef8ea0 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Creating volume c36a89f8-09d4-4cf8-aae9-e3d892defea7 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:44:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-cdcd0f89-4ff5-4fb5-831c-00a71bef8ea0 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:44:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-cdcd0f89-4ff5-4fb5-831c-00a71bef8ea0 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:44:28 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-cdcd0f89-4ff5-4fb5-831c-00a71bef8ea0 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:44:28 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-cdcd0f89-4ff5-4fb5-831c-00a71bef8ea0 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:44:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-cdcd0f89-4ff5-4fb5-831c-00a71bef8ea0 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:44:28 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-cdcd0f89-4ff5-4fb5-831c-00a71bef8ea0 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:44:28 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-cdcd0f89-4ff5-4fb5-831c-00a71bef8ea0 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:44:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-cdcd0f89-4ff5-4fb5-831c-00a71bef8ea0 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c36a89f8-09d4-4cf8-aae9-e3d892defea7 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:28 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b04acc63-ae76-4b3d-bd28-2e7c3da70560 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6fef0bd-609f-4f23-99cc-35dca6aadf00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35bf5e5f-ad7f-401d-8053-286f319f406c', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:28 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b04acc63-ae76-4b3d-bd28-2e7c3da70560 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04f8064a-1980-419e-9fa2-1207f8072b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:28 devstack sudo[109684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c36a89f8-09d4-4cf8-aae9-e3d892defea7 1073741824 Jun 23 16:44:28 devstack sudo[109684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:28 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-b04acc63-ae76-4b3d-bd28-2e7c3da70560 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Volume volume-35bf5e5f-ad7f-401d-8053-286f319f406c (35bf5e5f-ad7f-401d-8053-286f319f406c): created successfully Jun 23 16:44:28 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b04acc63-ae76-4b3d-bd28-2e7c3da70560 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04f8064a-1980-419e-9fa2-1207f8072b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:28 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b04acc63-ae76-4b3d-bd28-2e7c3da70560 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Flow 'volume_create_manager' (d19e6400-9f5c-4fd4-a922-7213d06d8068) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:44:28 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-b04acc63-ae76-4b3d-bd28-2e7c3da70560 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Created volume successfully. Jun 23 16:44:29 devstack sudo[109681]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b71de46e-eb81-43a8-a39e-a11df51dab87 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c1c01498-9655-4896-8b2c-4a1e8cc21023" returned: 0 in 0.793s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:29 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b71de46e-eb81-43a8-a39e-a11df51dab87 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Lock "cinder-quobyte-c1c01498-9655-4896-8b2c-4a1e8cc21023" released by "delete_volume" :: held 1.929s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:44:29 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-b71de46e-eb81-43a8-a39e-a11df51dab87 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Created reservations ['5230780f-9ab6-4ca5-b7d5-d7f3f2d17398', '96ebdb03-2769-4d78-a154-97c894881491', '7cd04615-e60d-4473-a723-a1f8abaeae84', 'b30aef70-8bb5-4807-8f85-05276f9ee6dc'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:44:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b71de46e-eb81-43a8-a39e-a11df51dab87 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:44:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b71de46e-eb81-43a8-a39e-a11df51dab87 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:44:29 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b71de46e-eb81-43a8-a39e-a11df51dab87 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:44:29 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b71de46e-eb81-43a8-a39e-a11df51dab87 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:44:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b71de46e-eb81-43a8-a39e-a11df51dab87 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:44:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b71de46e-eb81-43a8-a39e-a11df51dab87 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:29 devstack sudo[109688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:44:29 devstack sudo[109688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:29 devstack sudo[109684]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-cdcd0f89-4ff5-4fb5-831c-00a71bef8ea0 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c36a89f8-09d4-4cf8-aae9-e3d892defea7 1073741824" returned: 0 in 0.936s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-cdcd0f89-4ff5-4fb5-831c-00a71bef8ea0 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c36a89f8-09d4-4cf8-aae9-e3d892defea7 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:29 devstack sudo[109694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c36a89f8-09d4-4cf8-aae9-e3d892defea7 Jun 23 16:44:29 devstack sudo[109694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:30 devstack sudo[109688]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b71de46e-eb81-43a8-a39e-a11df51dab87 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.780s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:30 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-b71de46e-eb81-43a8-a39e-a11df51dab87 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:44:30 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-b71de46e-eb81-43a8-a39e-a11df51dab87 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Deleted volume successfully. Jun 23 16:44:30 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b71de46e-eb81-43a8-a39e-a11df51dab87 tempest-VolumesSnapshotNegativeTestJSON-1818130922 None] Lock "cinder-c1c01498-9655-4896-8b2c-4a1e8cc21023-delete_volume" released by "delete_volume" :: held 3.098s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:44:30 devstack sudo[109694]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-cdcd0f89-4ff5-4fb5-831c-00a71bef8ea0 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c36a89f8-09d4-4cf8-aae9-e3d892defea7" returned: 0 in 0.719s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:30 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-cdcd0f89-4ff5-4fb5-831c-00a71bef8ea0 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] <== create_volume: return (1704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:44:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-cdcd0f89-4ff5-4fb5-831c-00a71bef8ea0 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:44:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ef340771-6b2f-4cc0-83fc-6066a066432f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.710s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:44:30 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-ef340771-6b2f-4cc0-83fc-6066a066432f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-60346278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41f88b80-dd04-4fa2-96e2-3e97de7d2c0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4954058dc8dd4ee5aa442e7f5f95740b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:44:28Z,use_quota=True,user_id='29173dda70c54ca3a5cbac76e5e7533d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:44:30 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-ef340771-6b2f-4cc0-83fc-6066a066432f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Creating volume 41f88b80-dd04-4fa2-96e2-3e97de7d2c0d {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:44:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ef340771-6b2f-4cc0-83fc-6066a066432f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:44:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ef340771-6b2f-4cc0-83fc-6066a066432f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:44:30 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-ef340771-6b2f-4cc0-83fc-6066a066432f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:44:30 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-ef340771-6b2f-4cc0-83fc-6066a066432f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:44:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ef340771-6b2f-4cc0-83fc-6066a066432f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:44:30 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-ef340771-6b2f-4cc0-83fc-6066a066432f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:44:30 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-ef340771-6b2f-4cc0-83fc-6066a066432f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:44:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ef340771-6b2f-4cc0-83fc-6066a066432f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-41f88b80-dd04-4fa2-96e2-3e97de7d2c0d 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:30 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-cdcd0f89-4ff5-4fb5-831c-00a71bef8ea0 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f827570a-949b-4a73-8a81-1926f72821f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c36a89f8-09d4-4cf8-aae9-e3d892defea7', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:30 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-cdcd0f89-4ff5-4fb5-831c-00a71bef8ea0 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6003ed38-7108-4f46-a8e9-954df8f23c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:30 devstack sudo[109698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-41f88b80-dd04-4fa2-96e2-3e97de7d2c0d 1073741824 Jun 23 16:44:30 devstack sudo[109698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:30 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-cdcd0f89-4ff5-4fb5-831c-00a71bef8ea0 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Volume volume-c36a89f8-09d4-4cf8-aae9-e3d892defea7 (c36a89f8-09d4-4cf8-aae9-e3d892defea7): created successfully Jun 23 16:44:30 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-cdcd0f89-4ff5-4fb5-831c-00a71bef8ea0 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6003ed38-7108-4f46-a8e9-954df8f23c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:30 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-cdcd0f89-4ff5-4fb5-831c-00a71bef8ea0 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Flow 'volume_create_manager' (97b88498-edbf-4142-84f7-763596f19505) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:44:30 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-cdcd0f89-4ff5-4fb5-831c-00a71bef8ea0 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Created volume successfully. Jun 23 16:44:31 devstack sudo[109698]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:31 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ef340771-6b2f-4cc0-83fc-6066a066432f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-41f88b80-dd04-4fa2-96e2-3e97de7d2c0d 1073741824" returned: 0 in 1.019s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:31 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ef340771-6b2f-4cc0-83fc-6066a066432f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-41f88b80-dd04-4fa2-96e2-3e97de7d2c0d {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:31 devstack sudo[109706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-41f88b80-dd04-4fa2-96e2-3e97de7d2c0d Jun 23 16:44:31 devstack sudo[109706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:32 devstack sudo[109706]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ef340771-6b2f-4cc0-83fc-6066a066432f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-41f88b80-dd04-4fa2-96e2-3e97de7d2c0d" returned: 0 in 0.714s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:32 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-ef340771-6b2f-4cc0-83fc-6066a066432f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] <== create_volume: return (1785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:44:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ef340771-6b2f-4cc0-83fc-6066a066432f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.787s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:44:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-3ee86705-248b-4646-b9d3-659b13c8f8df req-1a933b2c-abd2-4fbe-b0ef-5ea55ae699fc tempest-TestMinimumBasicScenario-494903709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.450s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:44:32 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ef340771-6b2f-4cc0-83fc-6066a066432f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21922662-e93b-4ffc-b043-3cf82a52132d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41f88b80-dd04-4fa2-96e2-3e97de7d2c0d', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:32 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ef340771-6b2f-4cc0-83fc-6066a066432f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11688511-7475-4476-931c-141f8f4e1452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:32 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d505500e-2d1a-4343-91b4-8ca1f9ce2f72]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:44:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-3ee86705-248b-4646-b9d3-659b13c8f8df req-1a933b2c-abd2-4fbe-b0ef-5ea55ae699fc tempest-TestMinimumBasicScenario-494903709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b672584d-3406-45b6-a8be-d9d44e47df66 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:32 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-ef340771-6b2f-4cc0-83fc-6066a066432f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Volume volume-41f88b80-dd04-4fa2-96e2-3e97de7d2c0d (41f88b80-dd04-4fa2-96e2-3e97de7d2c0d): created successfully Jun 23 16:44:32 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ef340771-6b2f-4cc0-83fc-6066a066432f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11688511-7475-4476-931c-141f8f4e1452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:32 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ef340771-6b2f-4cc0-83fc-6066a066432f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Flow 'volume_create_manager' (9bb4dac3-d3fa-4c70-a50a-a06b99a69f0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:44:32 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-ef340771-6b2f-4cc0-83fc-6066a066432f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Created volume successfully. Jun 23 16:44:32 devstack sudo[109716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b672584d-3406-45b6-a8be-d9d44e47df66 Jun 23 16:44:32 devstack sudo[109716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:33 devstack sudo[109716]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:33 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-3ee86705-248b-4646-b9d3-659b13c8f8df req-1a933b2c-abd2-4fbe-b0ef-5ea55ae699fc tempest-TestMinimumBasicScenario-494903709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b672584d-3406-45b6-a8be-d9d44e47df66" returned: 0 in 0.926s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:33 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-3ee86705-248b-4646-b9d3-659b13c8f8df req-1a933b2c-abd2-4fbe-b0ef-5ea55ae699fc tempest-TestMinimumBasicScenario-494903709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.954s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:44:33 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-0a99e088-339d-4c8a-939e-c1fdf2f5a445 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.863s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:44:33 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-0a99e088-339d-4c8a-939e-c1fdf2f5a445 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1714015975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c15c59ed-e19f-47af-8706-73ff7907e3fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4954058dc8dd4ee5aa442e7f5f95740b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:44:28Z,use_quota=True,user_id='29173dda70c54ca3a5cbac76e5e7533d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:44:33 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-0a99e088-339d-4c8a-939e-c1fdf2f5a445 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Creating volume c15c59ed-e19f-47af-8706-73ff7907e3fa {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:44:33 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-0a99e088-339d-4c8a-939e-c1fdf2f5a445 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:44:33 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-0a99e088-339d-4c8a-939e-c1fdf2f5a445 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:44:33 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-0a99e088-339d-4c8a-939e-c1fdf2f5a445 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:44:33 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-0a99e088-339d-4c8a-939e-c1fdf2f5a445 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:44:33 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-0a99e088-339d-4c8a-939e-c1fdf2f5a445 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:44:33 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-0a99e088-339d-4c8a-939e-c1fdf2f5a445 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:44:33 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-0a99e088-339d-4c8a-939e-c1fdf2f5a445 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:44:33 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0a99e088-339d-4c8a-939e-c1fdf2f5a445 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c15c59ed-e19f-47af-8706-73ff7907e3fa 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:33 devstack sudo[109722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c15c59ed-e19f-47af-8706-73ff7907e3fa 1073741824 Jun 23 16:44:33 devstack sudo[109722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:33 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-3ee86705-248b-4646-b9d3-659b13c8f8df req-1a933b2c-abd2-4fbe-b0ef-5ea55ae699fc tempest-TestMinimumBasicScenario-494903709 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e', 'name': 'volume-b672584d-3406-45b6-a8be-d9d44e47df66', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ef04fc7f-9f84-4461-af06-34e9e760996c', 'enforce_multipath': True} {{(pid=93788) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 16:44:33 devstack cinder-volume[93788]: INFO cinder.volume.manager [req-3ee86705-248b-4646-b9d3-659b13c8f8df req-1a933b2c-abd2-4fbe-b0ef-5ea55ae699fc tempest-TestMinimumBasicScenario-494903709 None] attachment_update completed successfully. Jun 23 16:44:34 devstack sudo[109722]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0a99e088-339d-4c8a-939e-c1fdf2f5a445 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c15c59ed-e19f-47af-8706-73ff7907e3fa 1073741824" returned: 0 in 1.105s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0a99e088-339d-4c8a-939e-c1fdf2f5a445 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c15c59ed-e19f-47af-8706-73ff7907e3fa {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:34 devstack sudo[109795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c15c59ed-e19f-47af-8706-73ff7907e3fa Jun 23 16:44:34 devstack sudo[109795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:35 devstack sudo[109795]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0a99e088-339d-4c8a-939e-c1fdf2f5a445 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c15c59ed-e19f-47af-8706-73ff7907e3fa" returned: 0 in 0.738s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:35 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-0a99e088-339d-4c8a-939e-c1fdf2f5a445 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] <== create_volume: return (1905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:44:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-0a99e088-339d-4c8a-939e-c1fdf2f5a445 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.910s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:44:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-72846867-4979-41b6-9a60-94049e68f1af tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.559s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:44:35 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-72846867-4979-41b6-9a60-94049e68f1af tempest-CreateVolumesFromSourceVolumeTest-597973162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-687994249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18ffdd3e-367a-447c-95e2-48daf7d1bd1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4954058dc8dd4ee5aa442e7f5f95740b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:44:28Z,use_quota=True,user_id='29173dda70c54ca3a5cbac76e5e7533d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:44:35 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-72846867-4979-41b6-9a60-94049e68f1af tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Creating volume 18ffdd3e-367a-447c-95e2-48daf7d1bd1c {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:44:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-72846867-4979-41b6-9a60-94049e68f1af tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:44:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-72846867-4979-41b6-9a60-94049e68f1af tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:44:35 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-72846867-4979-41b6-9a60-94049e68f1af tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:44:35 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-72846867-4979-41b6-9a60-94049e68f1af tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:44:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-72846867-4979-41b6-9a60-94049e68f1af tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:44:35 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-72846867-4979-41b6-9a60-94049e68f1af tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:44:35 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-72846867-4979-41b6-9a60-94049e68f1af tempest-CreateVolumesFromSourceVolumeTest-597973162 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:44:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-72846867-4979-41b6-9a60-94049e68f1af tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-18ffdd3e-367a-447c-95e2-48daf7d1bd1c 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:35 devstack sudo[110116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-18ffdd3e-367a-447c-95e2-48daf7d1bd1c 1073741824 Jun 23 16:44:35 devstack sudo[110116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:35 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a99e088-339d-4c8a-939e-c1fdf2f5a445 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcd676b6-6582-4e43-9bd7-b66d5297ab07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c15c59ed-e19f-47af-8706-73ff7907e3fa', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:35 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a99e088-339d-4c8a-939e-c1fdf2f5a445 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af0484f1-cdc8-4315-b98c-1114d102d7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:35 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-0a99e088-339d-4c8a-939e-c1fdf2f5a445 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Volume volume-c15c59ed-e19f-47af-8706-73ff7907e3fa (c15c59ed-e19f-47af-8706-73ff7907e3fa): created successfully Jun 23 16:44:35 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a99e088-339d-4c8a-939e-c1fdf2f5a445 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af0484f1-cdc8-4315-b98c-1114d102d7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:35 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a99e088-339d-4c8a-939e-c1fdf2f5a445 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Flow 'volume_create_manager' (216285de-95ae-4a61-9196-a5fdccc07492) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:44:35 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-0a99e088-339d-4c8a-939e-c1fdf2f5a445 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Created volume successfully. Jun 23 16:44:36 devstack sudo[110116]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-72846867-4979-41b6-9a60-94049e68f1af tempest-CreateVolumesFromSourceVolumeTest-597973162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-18ffdd3e-367a-447c-95e2-48daf7d1bd1c 1073741824" returned: 0 in 0.878s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-72846867-4979-41b6-9a60-94049e68f1af tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-18ffdd3e-367a-447c-95e2-48daf7d1bd1c {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:36 devstack sudo[110122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-18ffdd3e-367a-447c-95e2-48daf7d1bd1c Jun 23 16:44:36 devstack sudo[110122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:36 devstack sudo[110122]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-72846867-4979-41b6-9a60-94049e68f1af tempest-CreateVolumesFromSourceVolumeTest-597973162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-18ffdd3e-367a-447c-95e2-48daf7d1bd1c" returned: 0 in 0.687s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:36 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-72846867-4979-41b6-9a60-94049e68f1af tempest-CreateVolumesFromSourceVolumeTest-597973162 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:44:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-72846867-4979-41b6-9a60-94049e68f1af tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.616s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:44:36 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-72846867-4979-41b6-9a60-94049e68f1af tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (840561d6-6851-42c7-9cd0-da267e4fcb5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18ffdd3e-367a-447c-95e2-48daf7d1bd1c', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:36 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-72846867-4979-41b6-9a60-94049e68f1af tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9a0ddc6-a906-4870-9fde-fef0eecb4c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:36 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-72846867-4979-41b6-9a60-94049e68f1af tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Volume volume-18ffdd3e-367a-447c-95e2-48daf7d1bd1c (18ffdd3e-367a-447c-95e2-48daf7d1bd1c): created successfully Jun 23 16:44:36 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-72846867-4979-41b6-9a60-94049e68f1af tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9a0ddc6-a906-4870-9fde-fef0eecb4c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:36 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-72846867-4979-41b6-9a60-94049e68f1af tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Flow 'volume_create_manager' (4d65af0e-352c-49ce-b184-873f307a3f80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:44:36 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-72846867-4979-41b6-9a60-94049e68f1af tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Created volume successfully. Jun 23 16:44:36 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:44:36 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Flow 'volume_create_manager' (ffa3165b-10d2-42a2-b5e2-7cb8d5a9dd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:44:36 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4863eb7-3547-4474-90a9-b0a6bf0d9270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:36 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4863eb7-3547-4474-90a9-b0a6bf0d9270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:44:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e4262fa-b141-449f-b5e5-e5bb7200bd5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7696547c32a467a88b2d0a2129816c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:44:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:44:37Z,use_quota=True,user_id='2e37160f8fd94ad9858f3d290fc06fe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7cd9c07f-942f-47a3-be3c-4d518396298d),volume_type_id=7cd9c07f-942f-47a3-be3c-4d518396298d)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:36 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (492b4d9a-aa3c-4de9-9123-7ae1fbe01b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:36 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (492b4d9a-aa3c-4de9-9123-7ae1fbe01b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:36 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87cd18a4-08c8-4122-82f1-81cadbc26b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:36 devstack cinder-volume[93788]: DEBUG cinder.image.glance [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Creating Keystone auth plugin from conf {{(pid=93788) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 16:44:37 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87cd18a4-08c8-4122-82f1-81cadbc26b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2e4262fa-b141-449f-b5e5-e5bb7200bd5e', 'volume_name': 'volume-2e4262fa-b141-449f-b5e5-e5bb7200bd5e', 'volume_size': 1, 'image_id': 'bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '007445494c94e5039178e7377a4fd9d9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd7696547c32a467a88b2d0a2129816c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'aec30e27cc8d0dcb189c7fd70612dfcd1fba5e45cb13b39daa59a9c997c2949c6f7cd82fd856150051ecab27c6a9eaf29c26b8ca32b58e68b9e002a874050c06', 'id': 'bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694', 'created_at': datetime.datetime(2026, 6, 23, 14, 44, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 14, 44, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:37 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f8d6f81-6566-439f-8d6e-f335d60bfa41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:37 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f8d6f81-6566-439f-8d6e-f335d60bfa41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:37 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2226aac4-0002-4242-8444-40905b7a253b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:37 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Volume 2e4262fa-b141-449f-b5e5-e5bb7200bd5e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2e4262fa-b141-449f-b5e5-e5bb7200bd5e', 'volume_size': 1, 'image_id': 'bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '007445494c94e5039178e7377a4fd9d9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd7696547c32a467a88b2d0a2129816c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'aec30e27cc8d0dcb189c7fd70612dfcd1fba5e45cb13b39daa59a9c997c2949c6f7cd82fd856150051ecab27c6a9eaf29c26b8ca32b58e68b9e002a874050c06', 'id': 'bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694', 'created_at': datetime.datetime(2026, 6, 23, 14, 44, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 14, 44, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 23 16:44:37 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Trying to clone 2e4262fa-b141-449f-b5e5-e5bb7200bd5e from image bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694 at location (None, [{'url': 'file:///opt/stack/data/glance/images/bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694', 'metadata': {}}]). {{(pid=93788) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 16:44:37 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694_s1qbvjztdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93788) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 16:44:37 devstack cinder-volume[93788]: INFO cinder.image.image_utils [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Image download 0.00 MB at 0.00 MB/s Jun 23 16:44:37 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c74f3a6-a19e-4b2e-983d-8868442f6194]: (4, 'raw') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:44:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694_s1qbvjztdevstack@QuobyteHD {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:37 devstack sudo[110125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694_s1qbvjztdevstack@QuobyteHD Jun 23 16:44:37 devstack sudo[110125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:37 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-70a36ead-cab4-4f6b-a777-5f90f81d4269 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Acquiring lock "cinder-18ffdd3e-367a-447c-95e2-48daf7d1bd1c-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:44:37 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-70a36ead-cab4-4f6b-a777-5f90f81d4269 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "cinder-18ffdd3e-367a-447c-95e2-48daf7d1bd1c-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:44:37 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-70a36ead-cab4-4f6b-a777-5f90f81d4269 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Acquiring lock "cinder-quobyte-18ffdd3e-367a-447c-95e2-48daf7d1bd1c" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:44:37 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-70a36ead-cab4-4f6b-a777-5f90f81d4269 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "cinder-quobyte-18ffdd3e-367a-447c-95e2-48daf7d1bd1c" acquired by "delete_volume" :: waited 0.024s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:44:37 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6faa7142-e1c4-415f-b8bf-0918bd8f9d39]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:44:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-70a36ead-cab4-4f6b-a777-5f90f81d4269 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-18ffdd3e-367a-447c-95e2-48daf7d1bd1c {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:38 devstack sudo[110127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-18ffdd3e-367a-447c-95e2-48daf7d1bd1c Jun 23 16:44:38 devstack sudo[110127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:38 devstack sudo[110125]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694_s1qbvjztdevstack@QuobyteHD" returned: 0 in 0.871s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694_s1qbvjztdevstack@QuobyteHD {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:38 devstack sudo[110165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694_s1qbvjztdevstack@QuobyteHD Jun 23 16:44:38 devstack sudo[110165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:38 devstack sudo[110127]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-70a36ead-cab4-4f6b-a777-5f90f81d4269 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-18ffdd3e-367a-447c-95e2-48daf7d1bd1c" returned: 0 in 0.819s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-70a36ead-cab4-4f6b-a777-5f90f81d4269 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-18ffdd3e-367a-447c-95e2-48daf7d1bd1c {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:38 devstack sudo[110172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-18ffdd3e-367a-447c-95e2-48daf7d1bd1c Jun 23 16:44:38 devstack sudo[110172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:39 devstack sudo[110165]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694_s1qbvjztdevstack@QuobyteHD" returned: 1 in 0.816s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694_s1qbvjztdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:44:39 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Temporary image bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694 is fetched for user 2e37160f8fd94ad9858f3d290fc06fe6. {{(pid=93788) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 16:44:39 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc06ed1c-f1be-4110-b54c-e16d03820567]: (4, 'raw') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:44:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694_s1qbvjztdevstack@QuobyteHD {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:39 devstack sudo[110180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694_s1qbvjztdevstack@QuobyteHD Jun 23 16:44:39 devstack sudo[110180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:39 devstack sudo[110172]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-70a36ead-cab4-4f6b-a777-5f90f81d4269 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-18ffdd3e-367a-447c-95e2-48daf7d1bd1c" returned: 0 in 0.783s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:39 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-70a36ead-cab4-4f6b-a777-5f90f81d4269 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "cinder-quobyte-18ffdd3e-367a-447c-95e2-48daf7d1bd1c" released by "delete_volume" :: held 1.681s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:44:39 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-70a36ead-cab4-4f6b-a777-5f90f81d4269 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Created reservations ['149b80b7-f933-44d8-8d74-a981645d063b', 'bbf602dd-a0a2-464b-a232-f9c718238547', 'c70ccb3e-63e7-4b97-823e-7b5c0457915e', 'e9d6f6d3-6247-466c-b63a-866e30bef6f2'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:44:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-70a36ead-cab4-4f6b-a777-5f90f81d4269 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:44:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-70a36ead-cab4-4f6b-a777-5f90f81d4269 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:44:39 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-70a36ead-cab4-4f6b-a777-5f90f81d4269 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:44:39 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-70a36ead-cab4-4f6b-a777-5f90f81d4269 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:44:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-70a36ead-cab4-4f6b-a777-5f90f81d4269 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:44:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-70a36ead-cab4-4f6b-a777-5f90f81d4269 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:39 devstack sudo[110183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:44:39 devstack sudo[110183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:39 devstack sudo[110180]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694_s1qbvjztdevstack@QuobyteHD" returned: 0 in 0.768s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694_s1qbvjztdevstack@QuobyteHD {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:40 devstack sudo[110187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694_s1qbvjztdevstack@QuobyteHD Jun 23 16:44:40 devstack sudo[110187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:40 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-108f4c2b-eb35-4771-b2ec-f39a0a211491 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Acquiring lock "cinder-c15c59ed-e19f-47af-8706-73ff7907e3fa-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:44:40 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-108f4c2b-eb35-4771-b2ec-f39a0a211491 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "cinder-c15c59ed-e19f-47af-8706-73ff7907e3fa-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:44:40 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-108f4c2b-eb35-4771-b2ec-f39a0a211491 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Acquiring lock "cinder-quobyte-c15c59ed-e19f-47af-8706-73ff7907e3fa" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:44:40 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-108f4c2b-eb35-4771-b2ec-f39a0a211491 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "cinder-quobyte-c15c59ed-e19f-47af-8706-73ff7907e3fa" acquired by "delete_volume" :: waited 0.017s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:44:40 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b76f6c1-eb16-4438-a8bb-c07f1167e1b6]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:44:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-108f4c2b-eb35-4771-b2ec-f39a0a211491 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c15c59ed-e19f-47af-8706-73ff7907e3fa {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:40 devstack sudo[110189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c15c59ed-e19f-47af-8706-73ff7907e3fa Jun 23 16:44:40 devstack sudo[110189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:40 devstack sudo[110183]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-70a36ead-cab4-4f6b-a777-5f90f81d4269 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.798s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:40 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-70a36ead-cab4-4f6b-a777-5f90f81d4269 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:44:40 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-70a36ead-cab4-4f6b-a777-5f90f81d4269 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Deleted volume successfully. Jun 23 16:44:40 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-70a36ead-cab4-4f6b-a777-5f90f81d4269 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "cinder-18ffdd3e-367a-447c-95e2-48daf7d1bd1c-delete_volume" released by "delete_volume" :: held 2.756s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:44:40 devstack sudo[110187]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694_s1qbvjztdevstack@QuobyteHD" returned: 1 in 0.914s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694_s1qbvjztdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:44:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:44:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:44:40 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:44:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e4262fa-b141-449f-b5e5-e5bb7200bd5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7696547c32a467a88b2d0a2129816c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:44:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:44:37Z,use_quota=True,user_id='2e37160f8fd94ad9858f3d290fc06fe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7cd9c07f-942f-47a3-be3c-4d518396298d),volume_type_id=7cd9c07f-942f-47a3-be3c-4d518396298d)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:44:40 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Creating volume 2e4262fa-b141-449f-b5e5-e5bb7200bd5e {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:44:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:44:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:44:40 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:44:40 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:44:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:44:40 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:44:40 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:44:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2e4262fa-b141-449f-b5e5-e5bb7200bd5e 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:40 devstack sudo[110195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2e4262fa-b141-449f-b5e5-e5bb7200bd5e 1073741824 Jun 23 16:44:40 devstack sudo[110195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:41 devstack sudo[110189]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-108f4c2b-eb35-4771-b2ec-f39a0a211491 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c15c59ed-e19f-47af-8706-73ff7907e3fa" returned: 0 in 0.858s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-108f4c2b-eb35-4771-b2ec-f39a0a211491 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c15c59ed-e19f-47af-8706-73ff7907e3fa {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:41 devstack sudo[110200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c15c59ed-e19f-47af-8706-73ff7907e3fa Jun 23 16:44:41 devstack sudo[110200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:41 devstack sudo[110195]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2e4262fa-b141-449f-b5e5-e5bb7200bd5e 1073741824" returned: 0 in 0.970s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:41 devstack sudo[110200]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-108f4c2b-eb35-4771-b2ec-f39a0a211491 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c15c59ed-e19f-47af-8706-73ff7907e3fa" returned: 0 in 0.710s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:41 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-108f4c2b-eb35-4771-b2ec-f39a0a211491 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "cinder-quobyte-c15c59ed-e19f-47af-8706-73ff7907e3fa" released by "delete_volume" :: held 1.621s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:44:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2e4262fa-b141-449f-b5e5-e5bb7200bd5e {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:41 devstack sudo[110207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2e4262fa-b141-449f-b5e5-e5bb7200bd5e Jun 23 16:44:41 devstack sudo[110207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:41 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-108f4c2b-eb35-4771-b2ec-f39a0a211491 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Created reservations ['64e268b8-60b9-4960-8eb3-f55dca258f6d', '0eba7e04-5e68-45fa-9f8a-96673be9345f', '192e66ae-265c-43db-9dc7-a4e17a34b7aa', 'dde295eb-b2ab-41c2-996d-a7004d2a899f'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:44:42 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-108f4c2b-eb35-4771-b2ec-f39a0a211491 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:44:42 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-108f4c2b-eb35-4771-b2ec-f39a0a211491 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:44:42 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-108f4c2b-eb35-4771-b2ec-f39a0a211491 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:44:42 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-108f4c2b-eb35-4771-b2ec-f39a0a211491 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:44:42 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-108f4c2b-eb35-4771-b2ec-f39a0a211491 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:44:42 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-108f4c2b-eb35-4771-b2ec-f39a0a211491 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:42 devstack sudo[110210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:44:42 devstack sudo[110210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:42 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-4e19efea-285f-4169-a2a3-9727cc54c29b tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Acquiring lock "cinder-41f88b80-dd04-4fa2-96e2-3e97de7d2c0d-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:44:42 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-4e19efea-285f-4169-a2a3-9727cc54c29b tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "cinder-41f88b80-dd04-4fa2-96e2-3e97de7d2c0d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:44:42 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-4e19efea-285f-4169-a2a3-9727cc54c29b tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Acquiring lock "cinder-quobyte-41f88b80-dd04-4fa2-96e2-3e97de7d2c0d" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:44:42 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-4e19efea-285f-4169-a2a3-9727cc54c29b tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "cinder-quobyte-41f88b80-dd04-4fa2-96e2-3e97de7d2c0d" acquired by "delete_volume" :: waited 0.021s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:44:42 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c207452-1e41-4893-a492-64291abb5356]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:44:42 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4e19efea-285f-4169-a2a3-9727cc54c29b tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-41f88b80-dd04-4fa2-96e2-3e97de7d2c0d {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:42 devstack sudo[110212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-41f88b80-dd04-4fa2-96e2-3e97de7d2c0d Jun 23 16:44:42 devstack sudo[110212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:42 devstack sudo[110207]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:42 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2e4262fa-b141-449f-b5e5-e5bb7200bd5e" returned: 0 in 0.935s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:42 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] <== create_volume: return (1992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:44:42 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.996s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:44:42 devstack cinder-volume[93788]: DEBUG cinder.volume.volume_utils [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Attempting download of bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694 ((None, [{'url': 'file:///opt/stack/data/glance/images/bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694', 'metadata': {}}])) to volume 2e4262fa-b141-449f-b5e5-e5bb7200bd5e. {{(pid=93788) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 16:44:42 devstack sudo[110210]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:42 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-108f4c2b-eb35-4771-b2ec-f39a0a211491 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.892s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:42 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-108f4c2b-eb35-4771-b2ec-f39a0a211491 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:44:42 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-108f4c2b-eb35-4771-b2ec-f39a0a211491 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Deleted volume successfully. Jun 23 16:44:42 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a926861-6bdc-4338-8229-8ce9ba745afe]: (4, 'raw') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:44:42 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694_ehqsjyha {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:43 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-108f4c2b-eb35-4771-b2ec-f39a0a211491 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "cinder-c15c59ed-e19f-47af-8706-73ff7907e3fa-delete_volume" released by "delete_volume" :: held 2.852s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:44:43 devstack sudo[110216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694_ehqsjyha Jun 23 16:44:43 devstack sudo[110216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:43 devstack sudo[110212]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4e19efea-285f-4169-a2a3-9727cc54c29b tempest-CreateVolumesFromSourceVolumeTest-597973162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-41f88b80-dd04-4fa2-96e2-3e97de7d2c0d" returned: 0 in 1.064s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4e19efea-285f-4169-a2a3-9727cc54c29b tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-41f88b80-dd04-4fa2-96e2-3e97de7d2c0d {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:43 devstack sudo[110221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-41f88b80-dd04-4fa2-96e2-3e97de7d2c0d Jun 23 16:44:43 devstack sudo[110221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:43 devstack sudo[110216]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694_ehqsjyha" returned: 0 in 0.988s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694_ehqsjyha {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:44 devstack sudo[110225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694_ehqsjyha Jun 23 16:44:44 devstack sudo[110225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:44 devstack sudo[110221]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4e19efea-285f-4169-a2a3-9727cc54c29b tempest-CreateVolumesFromSourceVolumeTest-597973162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-41f88b80-dd04-4fa2-96e2-3e97de7d2c0d" returned: 0 in 0.722s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:44 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-4e19efea-285f-4169-a2a3-9727cc54c29b tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "cinder-quobyte-41f88b80-dd04-4fa2-96e2-3e97de7d2c0d" released by "delete_volume" :: held 1.847s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:44:44 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:SELECT=100,cinder:UPDATE=130,cinder:INSERT=33,cinder:DELETE=14 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:44:44 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-4e19efea-285f-4169-a2a3-9727cc54c29b tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Created reservations ['4b283203-6f1f-4a75-9434-0703f8e9802d', '57122d88-4006-44f2-a901-cc90bbc5c66a', 'dcd2dbfa-ad00-490f-ab1d-8049c1e57e57', '3657002e-5efd-4bcc-950f-c9c0788f7bbd'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:44:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-4e19efea-285f-4169-a2a3-9727cc54c29b tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:44:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-4e19efea-285f-4169-a2a3-9727cc54c29b tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:44:44 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-4e19efea-285f-4169-a2a3-9727cc54c29b tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:44:44 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-4e19efea-285f-4169-a2a3-9727cc54c29b tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:44:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-4e19efea-285f-4169-a2a3-9727cc54c29b tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:44:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4e19efea-285f-4169-a2a3-9727cc54c29b tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:44 devstack sudo[110228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:44:44 devstack sudo[110228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:44 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-7867a41f-a478-468e-b740-330a75baad9f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Acquiring lock "cinder-c36a89f8-09d4-4cf8-aae9-e3d892defea7-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:44:44 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-7867a41f-a478-468e-b740-330a75baad9f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "cinder-c36a89f8-09d4-4cf8-aae9-e3d892defea7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:44:44 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-7867a41f-a478-468e-b740-330a75baad9f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Acquiring lock "cinder-quobyte-c36a89f8-09d4-4cf8-aae9-e3d892defea7" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:44:44 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-7867a41f-a478-468e-b740-330a75baad9f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "cinder-quobyte-c36a89f8-09d4-4cf8-aae9-e3d892defea7" acquired by "delete_volume" :: waited 0.022s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:44:44 devstack sudo[110225]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694_ehqsjyha" returned: 1 in 0.862s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694_ehqsjyha' failed. Not Retrying. {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:44:44 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d37741d-25ab-46d0-b713-bde59a244bff]: (4, 'raw') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:44:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694_s1qbvjztdevstack@QuobyteHD {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:44 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed35f140-3807-4c95-87d0-2b286e338dbe]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:44:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-7867a41f-a478-468e-b740-330a75baad9f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c36a89f8-09d4-4cf8-aae9-e3d892defea7 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:45 devstack sudo[110232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694_s1qbvjztdevstack@QuobyteHD Jun 23 16:44:45 devstack sudo[110232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:45 devstack sudo[110233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c36a89f8-09d4-4cf8-aae9-e3d892defea7 Jun 23 16:44:45 devstack sudo[110233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:45 devstack sudo[110228]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:45 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4e19efea-285f-4169-a2a3-9727cc54c29b tempest-CreateVolumesFromSourceVolumeTest-597973162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.906s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:45 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-4e19efea-285f-4169-a2a3-9727cc54c29b tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:44:45 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-4e19efea-285f-4169-a2a3-9727cc54c29b tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Deleted volume successfully. Jun 23 16:44:45 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-4e19efea-285f-4169-a2a3-9727cc54c29b tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "cinder-41f88b80-dd04-4fa2-96e2-3e97de7d2c0d-delete_volume" released by "delete_volume" :: held 3.031s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:44:45 devstack sudo[110232]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:45 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694_s1qbvjztdevstack@QuobyteHD" returned: 0 in 0.932s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:45 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694_s1qbvjztdevstack@QuobyteHD {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:45 devstack sudo[110233]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:45 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-7867a41f-a478-468e-b740-330a75baad9f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c36a89f8-09d4-4cf8-aae9-e3d892defea7" returned: 0 in 0.938s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:45 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-7867a41f-a478-468e-b740-330a75baad9f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c36a89f8-09d4-4cf8-aae9-e3d892defea7 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:45 devstack sudo[110243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c36a89f8-09d4-4cf8-aae9-e3d892defea7 Jun 23 16:44:45 devstack sudo[110243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:45 devstack sudo[110242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694_s1qbvjztdevstack@QuobyteHD Jun 23 16:44:45 devstack sudo[110242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:46 devstack sudo[110243]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-7867a41f-a478-468e-b740-330a75baad9f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c36a89f8-09d4-4cf8-aae9-e3d892defea7" returned: 0 in 0.826s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:46 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-7867a41f-a478-468e-b740-330a75baad9f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "cinder-quobyte-c36a89f8-09d4-4cf8-aae9-e3d892defea7" released by "delete_volume" :: held 1.847s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:44:46 devstack sudo[110242]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694_s1qbvjztdevstack@QuobyteHD" returned: 1 in 0.900s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694_s1qbvjztdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:44:46 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694 was raw, converting to raw {{(pid=93788) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 16:44:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694_s1qbvjztdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2e4262fa-b141-449f-b5e5-e5bb7200bd5e {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:46 devstack sudo[110253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694_s1qbvjztdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2e4262fa-b141-449f-b5e5-e5bb7200bd5e Jun 23 16:44:46 devstack sudo[110253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:46 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-7867a41f-a478-468e-b740-330a75baad9f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Created reservations ['564edd3d-b135-4ac2-a52c-3ee75daaf8bd', '9ab67769-2d42-4ad1-9410-c98b7b04bef2', '5aca2c64-2594-4eed-912b-820eeb9f51ca', '62cb20eb-ef71-449a-b5da-a800ba62799a'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:44:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-7867a41f-a478-468e-b740-330a75baad9f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:44:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-7867a41f-a478-468e-b740-330a75baad9f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:44:46 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-7867a41f-a478-468e-b740-330a75baad9f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:44:46 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-7867a41f-a478-468e-b740-330a75baad9f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:44:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-7867a41f-a478-468e-b740-330a75baad9f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:44:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-7867a41f-a478-468e-b740-330a75baad9f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:46 devstack sudo[110255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:44:46 devstack sudo[110255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:47 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-7fb1d7d2-6e16-4c85-b203-3e5a04f047d1 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Acquiring lock "cinder-35bf5e5f-ad7f-401d-8053-286f319f406c-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:44:47 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-7fb1d7d2-6e16-4c85-b203-3e5a04f047d1 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "cinder-35bf5e5f-ad7f-401d-8053-286f319f406c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:44:47 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-7fb1d7d2-6e16-4c85-b203-3e5a04f047d1 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Acquiring lock "cinder-quobyte-35bf5e5f-ad7f-401d-8053-286f319f406c" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:44:47 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-7fb1d7d2-6e16-4c85-b203-3e5a04f047d1 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "cinder-quobyte-35bf5e5f-ad7f-401d-8053-286f319f406c" acquired by "delete_volume" :: waited 0.018s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:44:47 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecef67da-5008-4861-bfd6-abcb1c544366]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:44:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-7fb1d7d2-6e16-4c85-b203-3e5a04f047d1 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-35bf5e5f-ad7f-401d-8053-286f319f406c {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:47 devstack sudo[110260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-35bf5e5f-ad7f-401d-8053-286f319f406c Jun 23 16:44:47 devstack sudo[110260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:47 devstack sudo[110253]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694_s1qbvjztdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2e4262fa-b141-449f-b5e5-e5bb7200bd5e" returned: 0 in 0.887s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:47 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694_s1qbvjztdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2e4262fa-b141-449f-b5e5-e5bb7200bd5e {{(pid=93788) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 16:44:47 devstack cinder-volume[93788]: INFO cinder.image.image_utils [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Converted 0.00 MB image at 0.00 MB/s Jun 23 16:44:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2e4262fa-b141-449f-b5e5-e5bb7200bd5e 1G {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:47 devstack sudo[110270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2e4262fa-b141-449f-b5e5-e5bb7200bd5e 1G Jun 23 16:44:47 devstack sudo[110270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:47 devstack sudo[110255]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-7867a41f-a478-468e-b740-330a75baad9f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.821s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:47 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-7867a41f-a478-468e-b740-330a75baad9f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:44:47 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-7867a41f-a478-468e-b740-330a75baad9f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Deleted volume successfully. Jun 23 16:44:47 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-7867a41f-a478-468e-b740-330a75baad9f tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "cinder-c36a89f8-09d4-4cf8-aae9-e3d892defea7-delete_volume" released by "delete_volume" :: held 2.963s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:44:48 devstack sudo[110260]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-7fb1d7d2-6e16-4c85-b203-3e5a04f047d1 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-35bf5e5f-ad7f-401d-8053-286f319f406c" returned: 0 in 0.873s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-7fb1d7d2-6e16-4c85-b203-3e5a04f047d1 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-35bf5e5f-ad7f-401d-8053-286f319f406c {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:48 devstack sudo[110275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-35bf5e5f-ad7f-401d-8053-286f319f406c Jun 23 16:44:48 devstack sudo[110275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:48 devstack sudo[110270]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2e4262fa-b141-449f-b5e5-e5bb7200bd5e 1G" returned: 0 in 0.773s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:48 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bcec448-fe15-4736-9fb0-c2269bb40045]: (4, 'raw') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:44:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2e4262fa-b141-449f-b5e5-e5bb7200bd5e {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:48 devstack sudo[110280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2e4262fa-b141-449f-b5e5-e5bb7200bd5e Jun 23 16:44:48 devstack sudo[110280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:48 devstack sudo[110275]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-7fb1d7d2-6e16-4c85-b203-3e5a04f047d1 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-35bf5e5f-ad7f-401d-8053-286f319f406c" returned: 0 in 0.683s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:48 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-7fb1d7d2-6e16-4c85-b203-3e5a04f047d1 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "cinder-quobyte-35bf5e5f-ad7f-401d-8053-286f319f406c" released by "delete_volume" :: held 1.617s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:44:48 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-7fb1d7d2-6e16-4c85-b203-3e5a04f047d1 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Created reservations ['bdafa4b8-eca5-4a08-9e14-f773533ec05d', '93eec1d6-5b40-4f26-9c19-563e28838ad6', '418b2d64-c35a-4ea8-8778-ab99a30a554d', '16148b30-0ddd-45f9-931c-f1eb830b5966'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:44:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-7fb1d7d2-6e16-4c85-b203-3e5a04f047d1 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:44:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-7fb1d7d2-6e16-4c85-b203-3e5a04f047d1 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:44:48 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-7fb1d7d2-6e16-4c85-b203-3e5a04f047d1 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:44:48 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-7fb1d7d2-6e16-4c85-b203-3e5a04f047d1 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:44:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-7fb1d7d2-6e16-4c85-b203-3e5a04f047d1 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:44:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-7fb1d7d2-6e16-4c85-b203-3e5a04f047d1 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:48 devstack sudo[110283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:44:48 devstack sudo[110283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:49 devstack sudo[110280]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2e4262fa-b141-449f-b5e5-e5bb7200bd5e" returned: 0 in 0.807s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2e4262fa-b141-449f-b5e5-e5bb7200bd5e {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:49 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e5c0c0aa-40cd-4c2e-a8f6-b627607419dc tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Acquiring lock "cinder-315e3edd-c8a8-413f-8008-dfe4e5961685-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:44:49 devstack sudo[110288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2e4262fa-b141-449f-b5e5-e5bb7200bd5e Jun 23 16:44:49 devstack sudo[110288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:49 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e5c0c0aa-40cd-4c2e-a8f6-b627607419dc tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "cinder-315e3edd-c8a8-413f-8008-dfe4e5961685-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:44:49 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e5c0c0aa-40cd-4c2e-a8f6-b627607419dc tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Acquiring lock "cinder-quobyte-315e3edd-c8a8-413f-8008-dfe4e5961685" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:44:49 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e5c0c0aa-40cd-4c2e-a8f6-b627607419dc tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "cinder-quobyte-315e3edd-c8a8-413f-8008-dfe4e5961685" acquired by "delete_volume" :: waited 0.019s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:44:49 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c08450-e7d2-4784-9699-4ca573105276]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:44:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e5c0c0aa-40cd-4c2e-a8f6-b627607419dc tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-315e3edd-c8a8-413f-8008-dfe4e5961685 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:49 devstack sudo[110290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-315e3edd-c8a8-413f-8008-dfe4e5961685 Jun 23 16:44:49 devstack sudo[110290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:49 devstack sudo[110283]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-7fb1d7d2-6e16-4c85-b203-3e5a04f047d1 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.675s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:49 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-7fb1d7d2-6e16-4c85-b203-3e5a04f047d1 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:44:49 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-7fb1d7d2-6e16-4c85-b203-3e5a04f047d1 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Deleted volume successfully. Jun 23 16:44:49 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-7fb1d7d2-6e16-4c85-b203-3e5a04f047d1 tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "cinder-35bf5e5f-ad7f-401d-8053-286f319f406c-delete_volume" released by "delete_volume" :: held 2.561s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:44:50 devstack sudo[110288]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2e4262fa-b141-449f-b5e5-e5bb7200bd5e" returned: 1 in 0.797s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2e4262fa-b141-449f-b5e5-e5bb7200bd5e' failed. Not Retrying. {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:44:50 devstack cinder-volume[93788]: DEBUG cinder.volume.volume_utils [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Downloaded image bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694 ((None, [{'url': 'file:///opt/stack/data/glance/images/bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694', 'metadata': {}}])) to volume 2e4262fa-b141-449f-b5e5-e5bb7200bd5e successfully. {{(pid=93788) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 16:44:50 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Temporary image bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694 for user 2e37160f8fd94ad9858f3d290fc06fe6 is deleted. {{(pid=93788) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 16:44:50 devstack cinder-volume[93788]: DEBUG cinder.volume.volume_utils [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Marking volume 2e4262fa-b141-449f-b5e5-e5bb7200bd5e as bootable. {{(pid=93788) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 16:44:50 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Copying metadata from image bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694 to 2e4262fa-b141-449f-b5e5-e5bb7200bd5e. {{(pid=93788) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 16:44:50 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Creating volume glance metadata for volume 2e4262fa-b141-449f-b5e5-e5bb7200bd5e backed by image bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '007445494c94e5039178e7377a4fd9d9', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93788) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 16:44:50 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2226aac4-0002-4242-8444-40905b7a253b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e4262fa-b141-449f-b5e5-e5bb7200bd5e', 'volume_size': 1, 'image_id': 'bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '007445494c94e5039178e7377a4fd9d9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd7696547c32a467a88b2d0a2129816c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'aec30e27cc8d0dcb189c7fd70612dfcd1fba5e45cb13b39daa59a9c997c2949c6f7cd82fd856150051ecab27c6a9eaf29c26b8ca32b58e68b9e002a874050c06', 'id': 'bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694', 'created_at': datetime.datetime(2026, 6, 23, 14, 44, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 14, 44, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bcb7ba06-d9a0-4e4c-8b42-da5a0fc4a694/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:50 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e12fbebe-74cd-452d-8934-bfcf407137a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:44:50 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Volume volume-2e4262fa-b141-449f-b5e5-e5bb7200bd5e (2e4262fa-b141-449f-b5e5-e5bb7200bd5e): created successfully Jun 23 16:44:50 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e12fbebe-74cd-452d-8934-bfcf407137a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:44:50 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Flow 'volume_create_manager' (ffa3165b-10d2-42a2-b5e2-7cb8d5a9dd80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:44:50 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-f0a5b98e-75d1-404f-850c-af12cba93eac tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Created volume successfully. Jun 23 16:44:50 devstack sudo[110290]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e5c0c0aa-40cd-4c2e-a8f6-b627607419dc tempest-CreateVolumesFromSourceVolumeTest-597973162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-315e3edd-c8a8-413f-8008-dfe4e5961685" returned: 0 in 0.808s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e5c0c0aa-40cd-4c2e-a8f6-b627607419dc tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-315e3edd-c8a8-413f-8008-dfe4e5961685 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:50 devstack sudo[110299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-315e3edd-c8a8-413f-8008-dfe4e5961685 Jun 23 16:44:50 devstack sudo[110299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:50 devstack sudo[110299]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e5c0c0aa-40cd-4c2e-a8f6-b627607419dc tempest-CreateVolumesFromSourceVolumeTest-597973162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-315e3edd-c8a8-413f-8008-dfe4e5961685" returned: 0 in 0.655s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:50 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e5c0c0aa-40cd-4c2e-a8f6-b627607419dc tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "cinder-quobyte-315e3edd-c8a8-413f-8008-dfe4e5961685" released by "delete_volume" :: held 1.502s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:44:50 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-e5c0c0aa-40cd-4c2e-a8f6-b627607419dc tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Created reservations ['84f9ab2b-0ed2-480b-94c9-8b0d3915d545', '97deb923-59cd-4845-b77d-77ac8b1a2fd7', '4afef87d-f99b-4aee-9571-77d7ce515f44', 'b911c28b-ef7e-4376-b478-4940462857df'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:44:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e5c0c0aa-40cd-4c2e-a8f6-b627607419dc tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:44:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e5c0c0aa-40cd-4c2e-a8f6-b627607419dc tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:44:51 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e5c0c0aa-40cd-4c2e-a8f6-b627607419dc tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:44:51 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e5c0c0aa-40cd-4c2e-a8f6-b627607419dc tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:44:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e5c0c0aa-40cd-4c2e-a8f6-b627607419dc tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:44:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e5c0c0aa-40cd-4c2e-a8f6-b627607419dc tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:51 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-1004cc2a-e6bd-4ac8-bb0c-a065e0dca907 tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Acquiring lock "cinder-2e4262fa-b141-449f-b5e5-e5bb7200bd5e-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:44:51 devstack sudo[110302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:44:51 devstack sudo[110302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:51 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-1004cc2a-e6bd-4ac8-bb0c-a065e0dca907 tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Lock "cinder-2e4262fa-b141-449f-b5e5-e5bb7200bd5e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:44:51 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-1004cc2a-e6bd-4ac8-bb0c-a065e0dca907 tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Acquiring lock "cinder-quobyte-2e4262fa-b141-449f-b5e5-e5bb7200bd5e" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:44:51 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-1004cc2a-e6bd-4ac8-bb0c-a065e0dca907 tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Lock "cinder-quobyte-2e4262fa-b141-449f-b5e5-e5bb7200bd5e" acquired by "delete_volume" :: waited 0.016s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:44:51 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5a8ec1-d58f-4cec-b2cc-ac08484d2124]: (4, 'raw') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:44:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1004cc2a-e6bd-4ac8-bb0c-a065e0dca907 tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2e4262fa-b141-449f-b5e5-e5bb7200bd5e {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:51 devstack sudo[110304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2e4262fa-b141-449f-b5e5-e5bb7200bd5e Jun 23 16:44:51 devstack sudo[110304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:51 devstack sudo[110302]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e5c0c0aa-40cd-4c2e-a8f6-b627607419dc tempest-CreateVolumesFromSourceVolumeTest-597973162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.693s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:51 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-e5c0c0aa-40cd-4c2e-a8f6-b627607419dc tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:44:51 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-e5c0c0aa-40cd-4c2e-a8f6-b627607419dc tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Deleted volume successfully. Jun 23 16:44:51 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e5c0c0aa-40cd-4c2e-a8f6-b627607419dc tempest-CreateVolumesFromSourceVolumeTest-597973162 None] Lock "cinder-315e3edd-c8a8-413f-8008-dfe4e5961685-delete_volume" released by "delete_volume" :: held 2.436s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:44:52 devstack sudo[110304]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1004cc2a-e6bd-4ac8-bb0c-a065e0dca907 tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2e4262fa-b141-449f-b5e5-e5bb7200bd5e" returned: 0 in 0.860s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1004cc2a-e6bd-4ac8-bb0c-a065e0dca907 tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2e4262fa-b141-449f-b5e5-e5bb7200bd5e {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:52 devstack sudo[110310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2e4262fa-b141-449f-b5e5-e5bb7200bd5e Jun 23 16:44:52 devstack sudo[110310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:52 devstack sudo[110310]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1004cc2a-e6bd-4ac8-bb0c-a065e0dca907 tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2e4262fa-b141-449f-b5e5-e5bb7200bd5e" returned: 1 in 0.806s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1004cc2a-e6bd-4ac8-bb0c-a065e0dca907 tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2e4262fa-b141-449f-b5e5-e5bb7200bd5e' failed. Not Retrying. {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:44:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1004cc2a-e6bd-4ac8-bb0c-a065e0dca907 tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2e4262fa-b141-449f-b5e5-e5bb7200bd5e {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:52 devstack sudo[110315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2e4262fa-b141-449f-b5e5-e5bb7200bd5e Jun 23 16:44:52 devstack sudo[110315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:53 devstack sudo[110315]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:53 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1004cc2a-e6bd-4ac8-bb0c-a065e0dca907 tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-2e4262fa-b141-449f-b5e5-e5bb7200bd5e" returned: 0 in 0.704s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:53 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-1004cc2a-e6bd-4ac8-bb0c-a065e0dca907 tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Lock "cinder-quobyte-2e4262fa-b141-449f-b5e5-e5bb7200bd5e" released by "delete_volume" :: held 2.434s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:44:53 devstack cinder-volume[93788]: WARNING cinder.quota [None req-1004cc2a-e6bd-4ac8-bb0c-a065e0dca907 tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:44:53 devstack cinder-volume[93788]: WARNING cinder.quota [None req-1004cc2a-e6bd-4ac8-bb0c-a065e0dca907 tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:44:53 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-1004cc2a-e6bd-4ac8-bb0c-a065e0dca907 tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Created reservations ['a6b38997-0f12-4963-9f3e-4596b560bc17', '160d4a72-c3d0-423b-ba4f-480280eeabb3', '3586efb4-13a9-4f10-909b-14cf754a168c', '20f4a196-99e4-43f0-a5ec-bb40c76ece8c'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:44:53 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-1004cc2a-e6bd-4ac8-bb0c-a065e0dca907 tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:44:53 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-1004cc2a-e6bd-4ac8-bb0c-a065e0dca907 tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:44:53 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-1004cc2a-e6bd-4ac8-bb0c-a065e0dca907 tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:44:53 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-1004cc2a-e6bd-4ac8-bb0c-a065e0dca907 tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:44:53 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-1004cc2a-e6bd-4ac8-bb0c-a065e0dca907 tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:44:53 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1004cc2a-e6bd-4ac8-bb0c-a065e0dca907 tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:44:53 devstack sudo[110318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:44:53 devstack sudo[110318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:44:54 devstack sudo[110318]: pam_unix(sudo:session): session closed for user root Jun 23 16:44:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1004cc2a-e6bd-4ac8-bb0c-a065e0dca907 tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.732s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:44:54 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-1004cc2a-e6bd-4ac8-bb0c-a065e0dca907 tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:44:54 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-1004cc2a-e6bd-4ac8-bb0c-a065e0dca907 tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Deleted volume successfully. Jun 23 16:44:54 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-1004cc2a-e6bd-4ac8-bb0c-a065e0dca907 tempest-VolumeAndVolumeTypeFromImageTest-421255937 None] Lock "cinder-2e4262fa-b141-449f-b5e5-e5bb7200bd5e-delete_volume" released by "delete_volume" :: held 3.398s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:45:01 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:45:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:45:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:45:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:45:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:45:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:45:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:45:01 devstack sudo[110460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:45:01 devstack sudo[110460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:45:02 devstack sudo[110460]: pam_unix(sudo:session): session closed for user root Jun 23 16:45:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.221s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:45:02 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:45:02 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager._thread_info {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:45:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread count: 28 {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 16:45:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread info: [<_MainThread(MainThread, started 126303828988032)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 16:45:03 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:45:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Flow 'volume_create_manager' (4a11ef04-89b2-45c5-a793-532d23ae5a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:45:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e55e500-5e98-4da7-9b83-d0c1cb7d2b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:45:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e55e500-5e98-4da7-9b83-d0c1cb7d2b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:45:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4610f3af-d531-4da1-8407-3ca177bdf3c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bc61f95cac344419b9e2cdcaf2ee363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:45:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:45:04Z,use_quota=True,user_id='037712d82b554ffc966dcef7ca0826a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:45:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75249b17-4779-4097-b39b-44a6bedad1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:45:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75249b17-4779-4097-b39b-44a6bedad1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:45:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e67c00f1-7907-43c0-a3ef-d3864ec09b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:45:03 devstack cinder-volume[93788]: DEBUG cinder.image.glance [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Creating Keystone auth plugin from conf {{(pid=93788) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 16:45:04 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e67c00f1-7907-43c0-a3ef-d3864ec09b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4610f3af-d531-4da1-8407-3ca177bdf3c9', 'volume_name': 'volume-4610f3af-d531-4da1-8407-3ca177bdf3c9', 'volume_size': 1, 'image_id': '7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd648160e8badd0c9ab6ab11e8ee4dcda', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9bc61f95cac344419b9e2cdcaf2ee363', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e00f53e07370a6aafb5e1fe98a69890d6f175d30a55fe48b8a31e5a7e4dfc721cd3ddeacf3c5355cc12ed6806c3e80298c61f565364fcec379dc3f1306c2a0b8', 'id': '7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a', 'created_at': datetime.datetime(2026, 6, 23, 14, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 14, 45, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a/file', 'properties': {}}, 'image_service': }' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:45:04 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dd55d37-8ab5-4e61-b43e-73352bc077e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:45:04 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dd55d37-8ab5-4e61-b43e-73352bc077e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:45:04 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22f4b3fb-22c0-4960-ae33-92a87622bc78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:45:04 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Volume 4610f3af-d531-4da1-8407-3ca177bdf3c9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4610f3af-d531-4da1-8407-3ca177bdf3c9', 'volume_size': 1, 'image_id': '7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd648160e8badd0c9ab6ab11e8ee4dcda', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9bc61f95cac344419b9e2cdcaf2ee363', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e00f53e07370a6aafb5e1fe98a69890d6f175d30a55fe48b8a31e5a7e4dfc721cd3ddeacf3c5355cc12ed6806c3e80298c61f565364fcec379dc3f1306c2a0b8', 'id': '7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a', 'created_at': datetime.datetime(2026, 6, 23, 14, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 14, 45, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a/file', 'properties': {}}, 'image_service': } Jun 23 16:45:04 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Trying to clone 4610f3af-d531-4da1-8407-3ca177bdf3c9 from image 7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a at location (None, [{'url': 'file:///opt/stack/data/glance/images/7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a', 'metadata': {}}]). {{(pid=93788) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 16:45:04 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a_4j_hu4z9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93788) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 16:45:04 devstack cinder-volume[93788]: INFO cinder.image.image_utils [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Image download 0.00 MB at 0.00 MB/s Jun 23 16:45:04 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ece56d6-84a3-40df-abe2-ad806c422d83]: (4, 'raw') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:45:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a_4j_hu4z9devstack@QuobyteHD {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:45:04 devstack sudo[110476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a_4j_hu4z9devstack@QuobyteHD Jun 23 16:45:04 devstack sudo[110476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:45:05 devstack sudo[110476]: pam_unix(sudo:session): session closed for user root Jun 23 16:45:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a_4j_hu4z9devstack@QuobyteHD" returned: 0 in 0.983s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:45:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a_4j_hu4z9devstack@QuobyteHD {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:45:05 devstack sudo[110480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a_4j_hu4z9devstack@QuobyteHD Jun 23 16:45:05 devstack sudo[110480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:45:06 devstack sudo[110480]: pam_unix(sudo:session): session closed for user root Jun 23 16:45:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a_4j_hu4z9devstack@QuobyteHD" returned: 1 in 0.793s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:45:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a_4j_hu4z9devstack@QuobyteHD' failed. Not Retrying. {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:45:06 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Temporary image 7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a is fetched for user 037712d82b554ffc966dcef7ca0826a3. {{(pid=93788) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 16:45:06 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f15d5b-d782-46cd-973e-09bc239a7b0d]: (4, 'raw') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:45:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a_4j_hu4z9devstack@QuobyteHD {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:45:06 devstack sudo[110485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a_4j_hu4z9devstack@QuobyteHD Jun 23 16:45:06 devstack sudo[110485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:45:07 devstack sudo[110485]: pam_unix(sudo:session): session closed for user root Jun 23 16:45:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a_4j_hu4z9devstack@QuobyteHD" returned: 0 in 0.916s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:45:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a_4j_hu4z9devstack@QuobyteHD {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:45:07 devstack sudo[110490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a_4j_hu4z9devstack@QuobyteHD Jun 23 16:45:07 devstack sudo[110490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:45:08 devstack sudo[110490]: pam_unix(sudo:session): session closed for user root Jun 23 16:45:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a_4j_hu4z9devstack@QuobyteHD" returned: 1 in 0.822s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:45:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a_4j_hu4z9devstack@QuobyteHD' failed. Not Retrying. {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:45:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:45:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:45:08 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:45:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4610f3af-d531-4da1-8407-3ca177bdf3c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bc61f95cac344419b9e2cdcaf2ee363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:45:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:45:04Z,use_quota=True,user_id='037712d82b554ffc966dcef7ca0826a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:45:08 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Creating volume 4610f3af-d531-4da1-8407-3ca177bdf3c9 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:45:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:45:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:45:08 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:45:08 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:45:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:45:08 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:45:08 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:45:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4610f3af-d531-4da1-8407-3ca177bdf3c9 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:45:08 devstack sudo[110496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4610f3af-d531-4da1-8407-3ca177bdf3c9 1073741824 Jun 23 16:45:08 devstack sudo[110496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:45:09 devstack sudo[110496]: pam_unix(sudo:session): session closed for user root Jun 23 16:45:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4610f3af-d531-4da1-8407-3ca177bdf3c9 1073741824" returned: 0 in 0.989s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:45:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4610f3af-d531-4da1-8407-3ca177bdf3c9 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:45:09 devstack sudo[110503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4610f3af-d531-4da1-8407-3ca177bdf3c9 Jun 23 16:45:09 devstack sudo[110503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:45:09 devstack sudo[110503]: pam_unix(sudo:session): session closed for user root Jun 23 16:45:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4610f3af-d531-4da1-8407-3ca177bdf3c9" returned: 0 in 0.802s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:45:09 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] <== create_volume: return (1866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:45:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.869s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:45:10 devstack cinder-volume[93788]: DEBUG cinder.volume.volume_utils [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Attempting download of 7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a ((None, [{'url': 'file:///opt/stack/data/glance/images/7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a', 'metadata': {}}])) to volume 4610f3af-d531-4da1-8407-3ca177bdf3c9. {{(pid=93788) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 16:45:10 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a4a31b-8a24-49bf-8c15-ee5ba91939d4]: (4, 'raw') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:45:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a_budy_60n {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:45:10 devstack sudo[110506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a_budy_60n Jun 23 16:45:10 devstack sudo[110506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:45:10 devstack sudo[110506]: pam_unix(sudo:session): session closed for user root Jun 23 16:45:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a_budy_60n" returned: 0 in 0.876s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:45:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a_budy_60n {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:45:11 devstack sudo[110510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a_budy_60n Jun 23 16:45:11 devstack sudo[110510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:45:11 devstack sudo[110510]: pam_unix(sudo:session): session closed for user root Jun 23 16:45:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a_budy_60n" returned: 1 in 0.908s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:45:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a_budy_60n' failed. Not Retrying. {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:45:11 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0156a96-c43b-4890-8af5-77c0e697e044]: (4, 'raw') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:45:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a_4j_hu4z9devstack@QuobyteHD {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:45:12 devstack sudo[110515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a_4j_hu4z9devstack@QuobyteHD Jun 23 16:45:12 devstack sudo[110515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:45:12 devstack sudo[110515]: pam_unix(sudo:session): session closed for user root Jun 23 16:45:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a_4j_hu4z9devstack@QuobyteHD" returned: 0 in 0.776s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:45:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a_4j_hu4z9devstack@QuobyteHD {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:45:12 devstack sudo[110519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a_4j_hu4z9devstack@QuobyteHD Jun 23 16:45:12 devstack sudo[110519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:45:13 devstack sudo[110519]: pam_unix(sudo:session): session closed for user root Jun 23 16:45:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a_4j_hu4z9devstack@QuobyteHD" returned: 1 in 0.828s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:45:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a_4j_hu4z9devstack@QuobyteHD' failed. Not Retrying. {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:45:13 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] 7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a was raw, converting to raw {{(pid=93788) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 16:45:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a_4j_hu4z9devstack@QuobyteHD /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4610f3af-d531-4da1-8407-3ca177bdf3c9 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:45:13 devstack sudo[110524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a_4j_hu4z9devstack@QuobyteHD /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4610f3af-d531-4da1-8407-3ca177bdf3c9 Jun 23 16:45:13 devstack sudo[110524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:45:14 devstack sudo[110524]: pam_unix(sudo:session): session closed for user root Jun 23 16:45:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a_4j_hu4z9devstack@QuobyteHD /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4610f3af-d531-4da1-8407-3ca177bdf3c9" returned: 0 in 0.824s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:45:14 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a_4j_hu4z9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4610f3af-d531-4da1-8407-3ca177bdf3c9 {{(pid=93788) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 16:45:14 devstack cinder-volume[93788]: INFO cinder.image.image_utils [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Converted 0.00 MB image at 0.00 MB/s Jun 23 16:45:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4610f3af-d531-4da1-8407-3ca177bdf3c9 1G {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:45:14 devstack sudo[110531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4610f3af-d531-4da1-8407-3ca177bdf3c9 1G Jun 23 16:45:14 devstack sudo[110531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:45:15 devstack sudo[110531]: pam_unix(sudo:session): session closed for user root Jun 23 16:45:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4610f3af-d531-4da1-8407-3ca177bdf3c9 1G" returned: 0 in 0.813s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:45:15 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d92ae86-a97d-441e-9a79-bd942ac4bad6]: (4, 'raw') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:45:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4610f3af-d531-4da1-8407-3ca177bdf3c9 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:45:15 devstack sudo[110545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4610f3af-d531-4da1-8407-3ca177bdf3c9 Jun 23 16:45:15 devstack sudo[110545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:45:16 devstack sudo[110545]: pam_unix(sudo:session): session closed for user root Jun 23 16:45:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4610f3af-d531-4da1-8407-3ca177bdf3c9" returned: 0 in 0.955s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:45:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4610f3af-d531-4da1-8407-3ca177bdf3c9 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:45:16 devstack sudo[110549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4610f3af-d531-4da1-8407-3ca177bdf3c9 Jun 23 16:45:16 devstack sudo[110549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:45:17 devstack sudo[110549]: pam_unix(sudo:session): session closed for user root Jun 23 16:45:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4610f3af-d531-4da1-8407-3ca177bdf3c9" returned: 1 in 0.920s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:45:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4610f3af-d531-4da1-8407-3ca177bdf3c9' failed. Not Retrying. {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:45:17 devstack cinder-volume[93788]: DEBUG cinder.volume.volume_utils [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Downloaded image 7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a ((None, [{'url': 'file:///opt/stack/data/glance/images/7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a', 'metadata': {}}])) to volume 4610f3af-d531-4da1-8407-3ca177bdf3c9 successfully. {{(pid=93788) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 16:45:17 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Temporary image 7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a for user 037712d82b554ffc966dcef7ca0826a3 is deleted. {{(pid=93788) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 16:45:17 devstack cinder-volume[93788]: DEBUG cinder.volume.volume_utils [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Marking volume 4610f3af-d531-4da1-8407-3ca177bdf3c9 as bootable. {{(pid=93788) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 16:45:17 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Copying metadata from image 7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a to 4610f3af-d531-4da1-8407-3ca177bdf3c9. {{(pid=93788) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 16:45:17 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Creating volume glance metadata for volume 4610f3af-d531-4da1-8407-3ca177bdf3c9 backed by image 7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a with: {'image_id': '7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'd648160e8badd0c9ab6ab11e8ee4dcda', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93788) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 16:45:17 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22f4b3fb-22c0-4960-ae33-92a87622bc78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4610f3af-d531-4da1-8407-3ca177bdf3c9', 'volume_size': 1, 'image_id': '7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd648160e8badd0c9ab6ab11e8ee4dcda', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9bc61f95cac344419b9e2cdcaf2ee363', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e00f53e07370a6aafb5e1fe98a69890d6f175d30a55fe48b8a31e5a7e4dfc721cd3ddeacf3c5355cc12ed6806c3e80298c61f565364fcec379dc3f1306c2a0b8', 'id': '7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a', 'created_at': datetime.datetime(2026, 6, 23, 14, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 14, 45, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7b44ff8a-bb69-401a-9d2f-cbbfe7367c8a/file', 'properties': {}}, 'image_service': }' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:45:17 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d23d7c8-f280-437f-b4e1-3c81aec0f3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:45:17 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Volume volume-4610f3af-d531-4da1-8407-3ca177bdf3c9 (4610f3af-d531-4da1-8407-3ca177bdf3c9): created successfully Jun 23 16:45:17 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d23d7c8-f280-437f-b4e1-3c81aec0f3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:45:17 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Flow 'volume_create_manager' (4a11ef04-89b2-45c5-a793-532d23ae5a4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:45:17 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-98e8b67d-96fd-445e-b809-69747ca40e9c tempest-VolumeImageDependencyTests-6563223 None] Created volume successfully. Jun 23 16:45:17 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ab34e784-dc6f-4d1c-b687-242f7faac808 tempest-VolumeImageDependencyTests-6563223 None] Acquiring lock "cinder-4610f3af-d531-4da1-8407-3ca177bdf3c9-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:45:17 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ab34e784-dc6f-4d1c-b687-242f7faac808 tempest-VolumeImageDependencyTests-6563223 None] Lock "cinder-4610f3af-d531-4da1-8407-3ca177bdf3c9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:45:17 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ab34e784-dc6f-4d1c-b687-242f7faac808 tempest-VolumeImageDependencyTests-6563223 None] Acquiring lock "cinder-quobyte-4610f3af-d531-4da1-8407-3ca177bdf3c9" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:45:17 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ab34e784-dc6f-4d1c-b687-242f7faac808 tempest-VolumeImageDependencyTests-6563223 None] Lock "cinder-quobyte-4610f3af-d531-4da1-8407-3ca177bdf3c9" acquired by "delete_volume" :: waited 0.029s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:45:18 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4646b6-7c4e-4472-a402-8edac313e527]: (4, 'raw') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:45:18 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ab34e784-dc6f-4d1c-b687-242f7faac808 tempest-VolumeImageDependencyTests-6563223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4610f3af-d531-4da1-8407-3ca177bdf3c9 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:45:18 devstack sudo[110554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4610f3af-d531-4da1-8407-3ca177bdf3c9 Jun 23 16:45:18 devstack sudo[110554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:45:18 devstack sudo[110554]: pam_unix(sudo:session): session closed for user root Jun 23 16:45:18 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ab34e784-dc6f-4d1c-b687-242f7faac808 tempest-VolumeImageDependencyTests-6563223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4610f3af-d531-4da1-8407-3ca177bdf3c9" returned: 0 in 0.855s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:45:18 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ab34e784-dc6f-4d1c-b687-242f7faac808 tempest-VolumeImageDependencyTests-6563223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4610f3af-d531-4da1-8407-3ca177bdf3c9 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:45:19 devstack sudo[110558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4610f3af-d531-4da1-8407-3ca177bdf3c9 Jun 23 16:45:19 devstack sudo[110558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:45:19 devstack sudo[110558]: pam_unix(sudo:session): session closed for user root Jun 23 16:45:19 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ab34e784-dc6f-4d1c-b687-242f7faac808 tempest-VolumeImageDependencyTests-6563223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4610f3af-d531-4da1-8407-3ca177bdf3c9" returned: 1 in 0.801s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:45:19 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ab34e784-dc6f-4d1c-b687-242f7faac808 tempest-VolumeImageDependencyTests-6563223 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4610f3af-d531-4da1-8407-3ca177bdf3c9' failed. Not Retrying. {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:45:19 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ab34e784-dc6f-4d1c-b687-242f7faac808 tempest-VolumeImageDependencyTests-6563223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4610f3af-d531-4da1-8407-3ca177bdf3c9 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:45:19 devstack sudo[110564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4610f3af-d531-4da1-8407-3ca177bdf3c9 Jun 23 16:45:19 devstack sudo[110564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:45:20 devstack sudo[110564]: pam_unix(sudo:session): session closed for user root Jun 23 16:45:20 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ab34e784-dc6f-4d1c-b687-242f7faac808 tempest-VolumeImageDependencyTests-6563223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4610f3af-d531-4da1-8407-3ca177bdf3c9" returned: 0 in 0.739s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:45:20 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ab34e784-dc6f-4d1c-b687-242f7faac808 tempest-VolumeImageDependencyTests-6563223 None] Lock "cinder-quobyte-4610f3af-d531-4da1-8407-3ca177bdf3c9" released by "delete_volume" :: held 2.474s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:45:20 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-ab34e784-dc6f-4d1c-b687-242f7faac808 tempest-VolumeImageDependencyTests-6563223 None] Created reservations ['6aadf908-298a-4465-aedd-c6e833554a25', 'ad9fc4eb-8812-45a7-a1a7-24e238e75fcf', 'e02320fa-be00-4e6d-a468-19de0b43dc1a', '0389500a-028b-40de-827e-f3c512ae34c3'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:45:20 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ab34e784-dc6f-4d1c-b687-242f7faac808 tempest-VolumeImageDependencyTests-6563223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:45:20 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ab34e784-dc6f-4d1c-b687-242f7faac808 tempest-VolumeImageDependencyTests-6563223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:45:20 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-ab34e784-dc6f-4d1c-b687-242f7faac808 tempest-VolumeImageDependencyTests-6563223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:45:20 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-ab34e784-dc6f-4d1c-b687-242f7faac808 tempest-VolumeImageDependencyTests-6563223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:45:20 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ab34e784-dc6f-4d1c-b687-242f7faac808 tempest-VolumeImageDependencyTests-6563223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:45:20 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ab34e784-dc6f-4d1c-b687-242f7faac808 tempest-VolumeImageDependencyTests-6563223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:45:20 devstack sudo[110567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:45:20 devstack sudo[110567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:45:21 devstack sudo[110567]: pam_unix(sudo:session): session closed for user root Jun 23 16:45:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ab34e784-dc6f-4d1c-b687-242f7faac808 tempest-VolumeImageDependencyTests-6563223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.692s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:45:21 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-ab34e784-dc6f-4d1c-b687-242f7faac808 tempest-VolumeImageDependencyTests-6563223 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:45:21 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-ab34e784-dc6f-4d1c-b687-242f7faac808 tempest-VolumeImageDependencyTests-6563223 None] Deleted volume successfully. Jun 23 16:45:21 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ab34e784-dc6f-4d1c-b687-242f7faac808 tempest-VolumeImageDependencyTests-6563223 None] Lock "cinder-4610f3af-d531-4da1-8407-3ca177bdf3c9-delete_volume" released by "delete_volume" :: held 3.443s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:45:21 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7070d3a-8645-4c8f-8109-320823951b53 tempest-SnapshotDependencyTests-1848611555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:45:21 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d7070d3a-8645-4c8f-8109-320823951b53 tempest-SnapshotDependencyTests-1848611555 None] Flow 'volume_create_manager' (61148bce-fa35-468f-8505-7bd0244c77d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:45:21 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d7070d3a-8645-4c8f-8109-320823951b53 tempest-SnapshotDependencyTests-1848611555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbf66c47-8dad-4b5b-b295-604f0390b662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:45:21 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d7070d3a-8645-4c8f-8109-320823951b53 tempest-SnapshotDependencyTests-1848611555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbf66c47-8dad-4b5b-b295-604f0390b662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1600246831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7747f905-6281-43d7-8e26-18d638598318,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73655deb47f244fca784b47f89c63e39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:45:21Z,use_quota=True,user_id='ecb748e31db145b88e2404c13e22f71b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:45:21 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d7070d3a-8645-4c8f-8109-320823951b53 tempest-SnapshotDependencyTests-1848611555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f58d82f1-944a-4dbc-9f8e-6c1a3a7d63e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:45:21 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d7070d3a-8645-4c8f-8109-320823951b53 tempest-SnapshotDependencyTests-1848611555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f58d82f1-944a-4dbc-9f8e-6c1a3a7d63e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:45:21 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d7070d3a-8645-4c8f-8109-320823951b53 tempest-SnapshotDependencyTests-1848611555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9b9a27a-7339-4b5e-888a-10b008cfda73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:45:21 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d7070d3a-8645-4c8f-8109-320823951b53 tempest-SnapshotDependencyTests-1848611555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9b9a27a-7339-4b5e-888a-10b008cfda73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7747f905-6281-43d7-8e26-18d638598318', 'volume_name': 'volume-7747f905-6281-43d7-8e26-18d638598318', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:45:21 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d7070d3a-8645-4c8f-8109-320823951b53 tempest-SnapshotDependencyTests-1848611555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2085f7fc-d7d2-4385-8c7b-7ed5f3ec9dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:45:21 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d7070d3a-8645-4c8f-8109-320823951b53 tempest-SnapshotDependencyTests-1848611555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2085f7fc-d7d2-4385-8c7b-7ed5f3ec9dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:45:21 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d7070d3a-8645-4c8f-8109-320823951b53 tempest-SnapshotDependencyTests-1848611555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0ddd77c-7bcb-480e-ba49-e951beeeebe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:45:21 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-d7070d3a-8645-4c8f-8109-320823951b53 tempest-SnapshotDependencyTests-1848611555 None] Volume 7747f905-6281-43d7-8e26-18d638598318: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7747f905-6281-43d7-8e26-18d638598318', 'volume_size': 1} Jun 23 16:45:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d7070d3a-8645-4c8f-8109-320823951b53 tempest-SnapshotDependencyTests-1848611555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:45:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d7070d3a-8645-4c8f-8109-320823951b53 tempest-SnapshotDependencyTests-1848611555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:45:21 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-d7070d3a-8645-4c8f-8109-320823951b53 tempest-SnapshotDependencyTests-1848611555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1600246831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7747f905-6281-43d7-8e26-18d638598318,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73655deb47f244fca784b47f89c63e39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:45:21Z,use_quota=True,user_id='ecb748e31db145b88e2404c13e22f71b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:45:21 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-d7070d3a-8645-4c8f-8109-320823951b53 tempest-SnapshotDependencyTests-1848611555 None] Creating volume 7747f905-6281-43d7-8e26-18d638598318 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:45:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d7070d3a-8645-4c8f-8109-320823951b53 tempest-SnapshotDependencyTests-1848611555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:45:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d7070d3a-8645-4c8f-8109-320823951b53 tempest-SnapshotDependencyTests-1848611555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:45:21 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-d7070d3a-8645-4c8f-8109-320823951b53 tempest-SnapshotDependencyTests-1848611555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:45:21 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-d7070d3a-8645-4c8f-8109-320823951b53 tempest-SnapshotDependencyTests-1848611555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:45:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d7070d3a-8645-4c8f-8109-320823951b53 tempest-SnapshotDependencyTests-1848611555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:45:21 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-d7070d3a-8645-4c8f-8109-320823951b53 tempest-SnapshotDependencyTests-1848611555 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:45:21 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-d7070d3a-8645-4c8f-8109-320823951b53 tempest-SnapshotDependencyTests-1848611555 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:45:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d7070d3a-8645-4c8f-8109-320823951b53 tempest-SnapshotDependencyTests-1848611555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:45:21 devstack sudo[110570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318 1073741824 Jun 23 16:45:21 devstack sudo[110570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:45:22 devstack sudo[110570]: pam_unix(sudo:session): session closed for user root Jun 23 16:45:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d7070d3a-8645-4c8f-8109-320823951b53 tempest-SnapshotDependencyTests-1848611555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318 1073741824" returned: 0 in 0.945s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:45:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d7070d3a-8645-4c8f-8109-320823951b53 tempest-SnapshotDependencyTests-1848611555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:45:22 devstack sudo[110576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318 Jun 23 16:45:22 devstack sudo[110576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:45:23 devstack sudo[110576]: pam_unix(sudo:session): session closed for user root Jun 23 16:45:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d7070d3a-8645-4c8f-8109-320823951b53 tempest-SnapshotDependencyTests-1848611555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318" returned: 0 in 0.747s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:45:23 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-d7070d3a-8645-4c8f-8109-320823951b53 tempest-SnapshotDependencyTests-1848611555 None] <== create_volume: return (1737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:45:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d7070d3a-8645-4c8f-8109-320823951b53 tempest-SnapshotDependencyTests-1848611555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.741s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:45:23 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d7070d3a-8645-4c8f-8109-320823951b53 tempest-SnapshotDependencyTests-1848611555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0ddd77c-7bcb-480e-ba49-e951beeeebe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7747f905-6281-43d7-8e26-18d638598318', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:45:23 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d7070d3a-8645-4c8f-8109-320823951b53 tempest-SnapshotDependencyTests-1848611555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecd6c660-1e95-414c-aa03-0ce7a07f8e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:45:23 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-d7070d3a-8645-4c8f-8109-320823951b53 tempest-SnapshotDependencyTests-1848611555 None] Volume volume-7747f905-6281-43d7-8e26-18d638598318 (7747f905-6281-43d7-8e26-18d638598318): created successfully Jun 23 16:45:23 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d7070d3a-8645-4c8f-8109-320823951b53 tempest-SnapshotDependencyTests-1848611555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecd6c660-1e95-414c-aa03-0ce7a07f8e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:45:23 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-d7070d3a-8645-4c8f-8109-320823951b53 tempest-SnapshotDependencyTests-1848611555 None] Flow 'volume_create_manager' (61148bce-fa35-468f-8505-7bd0244c77d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:45:23 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-d7070d3a-8645-4c8f-8109-320823951b53 tempest-SnapshotDependencyTests-1848611555 None] Created volume successfully. Jun 23 16:45:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-2f93f733-3579-46ce-990f-afbbc2ac3c94 tempest-SnapshotDependencyTests-1848611555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:45:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-2f93f733-3579-46ce-990f-afbbc2ac3c94 tempest-SnapshotDependencyTests-1848611555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:45:23 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-2f93f733-3579-46ce-990f-afbbc2ac3c94 tempest-SnapshotDependencyTests-1848611555 None] Creating offline snapshot f6d3f24c-2e65-40b4-9442-5e4f6ee404d6 of volume 7747f905-6281-43d7-8e26-18d638598318 {{(pid=93788) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:45:23 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b69d98-997c-4597-87a3-ab96859e38c4]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:45:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2f93f733-3579-46ce-990f-afbbc2ac3c94 tempest-SnapshotDependencyTests-1848611555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:45:24 devstack sudo[110579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318 Jun 23 16:45:24 devstack sudo[110579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:45:24 devstack sudo[110579]: pam_unix(sudo:session): session closed for user root Jun 23 16:45:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2f93f733-3579-46ce-990f-afbbc2ac3c94 tempest-SnapshotDependencyTests-1848611555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318" returned: 0 in 0.827s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:45:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2f93f733-3579-46ce-990f-afbbc2ac3c94 tempest-SnapshotDependencyTests-1848611555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318.f6d3f24c-2e65-40b4-9442-5e4f6ee404d6 1G {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:45:24 devstack sudo[110584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318.f6d3f24c-2e65-40b4-9442-5e4f6ee404d6 1G Jun 23 16:45:24 devstack sudo[110584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:45:25 devstack sudo[110584]: pam_unix(sudo:session): session closed for user root Jun 23 16:45:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2f93f733-3579-46ce-990f-afbbc2ac3c94 tempest-SnapshotDependencyTests-1848611555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318.f6d3f24c-2e65-40b4-9442-5e4f6ee404d6 1G" returned: 0 in 0.824s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:45:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2f93f733-3579-46ce-990f-afbbc2ac3c94 tempest-SnapshotDependencyTests-1848611555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7747f905-6281-43d7-8e26-18d638598318 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318.f6d3f24c-2e65-40b4-9442-5e4f6ee404d6 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:45:25 devstack sudo[110589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7747f905-6281-43d7-8e26-18d638598318 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318.f6d3f24c-2e65-40b4-9442-5e4f6ee404d6 Jun 23 16:45:25 devstack sudo[110589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:45:26 devstack sudo[110589]: pam_unix(sudo:session): session closed for user root Jun 23 16:45:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2f93f733-3579-46ce-990f-afbbc2ac3c94 tempest-SnapshotDependencyTests-1848611555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7747f905-6281-43d7-8e26-18d638598318 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318.f6d3f24c-2e65-40b4-9442-5e4f6ee404d6" returned: 0 in 0.753s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:45:26 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-2f93f733-3579-46ce-990f-afbbc2ac3c94 tempest-SnapshotDependencyTests-1848611555 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318.f6d3f24c-2e65-40b4-9442-5e4f6ee404d6 is being set with open permissions: ugo+rw Jun 23 16:45:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2f93f733-3579-46ce-990f-afbbc2ac3c94 tempest-SnapshotDependencyTests-1848611555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318.f6d3f24c-2e65-40b4-9442-5e4f6ee404d6 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:45:26 devstack sudo[110598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318.f6d3f24c-2e65-40b4-9442-5e4f6ee404d6 Jun 23 16:45:26 devstack sudo[110598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:45:27 devstack sudo[110598]: pam_unix(sudo:session): session closed for user root Jun 23 16:45:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2f93f733-3579-46ce-990f-afbbc2ac3c94 tempest-SnapshotDependencyTests-1848611555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318.f6d3f24c-2e65-40b4-9442-5e4f6ee404d6" returned: 0 in 0.727s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:45:27 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:SELECT=89,cinder:INSERT=34,cinder:UPDATE=114,cinder:DELETE=10 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:45:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2f93f733-3579-46ce-990f-afbbc2ac3c94 tempest-SnapshotDependencyTests-1848611555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:45:27 devstack sudo[110602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318.info Jun 23 16:45:27 devstack sudo[110602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:45:27 devstack sudo[110602]: pam_unix(sudo:session): session closed for user root Jun 23 16:45:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2f93f733-3579-46ce-990f-afbbc2ac3c94 tempest-SnapshotDependencyTests-1848611555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318.info" returned: 0 in 0.730s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:45:27 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-2f93f733-3579-46ce-990f-afbbc2ac3c94 tempest-SnapshotDependencyTests-1848611555 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318.info is being set with open permissions: ugo+rw Jun 23 16:45:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2f93f733-3579-46ce-990f-afbbc2ac3c94 tempest-SnapshotDependencyTests-1848611555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:45:27 devstack sudo[110605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318.info Jun 23 16:45:27 devstack sudo[110605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:45:28 devstack sudo[110605]: pam_unix(sudo:session): session closed for user root Jun 23 16:45:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2f93f733-3579-46ce-990f-afbbc2ac3c94 tempest-SnapshotDependencyTests-1848611555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318.info" returned: 0 in 0.784s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:45:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-2f93f733-3579-46ce-990f-afbbc2ac3c94 tempest-SnapshotDependencyTests-1848611555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.755s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:45:28 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-2f93f733-3579-46ce-990f-afbbc2ac3c94 tempest-SnapshotDependencyTests-1848611555 None] Create snapshot completed successfully Jun 23 16:45:29 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:45:29 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] Flow 'volume_create_manager' (a247d859-8266-4f6e-b2d8-8c3c64578603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:45:29 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee6295b3-41b4-4315-9f2b-f2bd11008694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:45:29 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee6295b3-41b4-4315-9f2b-f2bd11008694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:45:29Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc800555-b4e8-47c0-9eed-76aedc7fbcc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73655deb47f244fca784b47f89c63e39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:45:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f6d3f24c-2e65-40b4-9442-5e4f6ee404d6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:45:30Z,use_quota=True,user_id='ecb748e31db145b88e2404c13e22f71b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:45:29 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2cc7b95-0f68-4c62-a828-70b7cfad542f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:45:29 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2cc7b95-0f68-4c62-a828-70b7cfad542f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:45:29 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9378041a-e3e1-41e8-910e-277041415f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:45:29 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9378041a-e3e1-41e8-910e-277041415f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dc800555-b4e8-47c0-9eed-76aedc7fbcc4', 'volume_name': 'volume-dc800555-b4e8-47c0-9eed-76aedc7fbcc4', 'volume_size': 1, 'snapshot_id': 'f6d3f24c-2e65-40b4-9442-5e4f6ee404d6'}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:45:29 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15bb4756-a844-425c-9ef8-dda1e8cbc5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:45:29 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15bb4756-a844-425c-9ef8-dda1e8cbc5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:45:29 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0637a0b-4fdf-481b-84b9-4388d844827f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:45:29 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] Volume dc800555-b4e8-47c0-9eed-76aedc7fbcc4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dc800555-b4e8-47c0-9eed-76aedc7fbcc4', 'volume_size': 1, 'snapshot_id': 'f6d3f24c-2e65-40b4-9442-5e4f6ee404d6'} Jun 23 16:45:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:45:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:45:29 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] Acquiring lock "cinder-quobyte-f6d3f24c-2e65-40b4-9442-5e4f6ee404d6-dc800555-b4e8-47c0-9eed-76aedc7fbcc4" by "_create_volume_from_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:45:29 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] Lock "cinder-quobyte-f6d3f24c-2e65-40b4-9442-5e4f6ee404d6-dc800555-b4e8-47c0-9eed-76aedc7fbcc4" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:45:29 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] Creating volume dc800555-b4e8-47c0-9eed-76aedc7fbcc4 from snapshot f6d3f24c-2e65-40b4-9442-5e4f6ee404d6 {{(pid=93788) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 16:45:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:45:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:45:29 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:45:29 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:45:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:45:29 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:45:29 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] Acquiring lock "cinder-quobyte-dc800555-b4e8-47c0-9eed-76aedc7fbcc4" by "_copy_volume_from_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:45:29 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] Lock "cinder-quobyte-dc800555-b4e8-47c0-9eed-76aedc7fbcc4" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:45:29 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] snapshot: f6d3f24c-2e65-40b4-9442-5e4f6ee404d6, volume: dc800555-b4e8-47c0-9eed-76aedc7fbcc4, {{(pid=93788) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 16:45:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:45:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:45:29 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:45:29 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:45:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:45:29 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[48bb1f90-2b1e-46ca-bcbf-40769fc91084]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:45:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318.f6d3f24c-2e65-40b4-9442-5e4f6ee404d6 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:45:30 devstack cinder-volume[93788]: INFO cinder.volume.manager [req-895678de-3852-412c-bde4-89f19854481a req-48794c82-b1bc-4ad6-aa65-9e5138e3f366 tempest-TestMinimumBasicScenario-494903709 None] Terminate volume connection completed successfully. Jun 23 16:45:30 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-895678de-3852-412c-bde4-89f19854481a req-48794c82-b1bc-4ad6-aa65-9e5138e3f366 tempest-TestMinimumBasicScenario-494903709 None] Deleting attachment ef04fc7f-9f84-4461-af06-34e9e760996c. {{(pid=93788) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 16:45:30 devstack sudo[110617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318.f6d3f24c-2e65-40b4-9442-5e4f6ee404d6 Jun 23 16:45:30 devstack sudo[110617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:45:30 devstack sudo[110617]: pam_unix(sudo:session): session closed for user root Jun 23 16:45:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318.f6d3f24c-2e65-40b4-9442-5e4f6ee404d6" returned: 0 in 0.855s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:45:30 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7747f905-6281-43d7-8e26-18d638598318(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:45:30 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318 {{(pid=93788) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 16:45:30 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] Creating direct copy from snapshot {{(pid=93788) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 16:45:30 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[300da3c2-c2c6-4a97-a1af-ba7fda66e7a5]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:45:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:45:30 devstack sudo[110622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318 Jun 23 16:45:30 devstack sudo[110622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:45:31 devstack sudo[110622]: pam_unix(sudo:session): session closed for user root Jun 23 16:45:31 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318" returned: 0 in 0.788s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:45:31 devstack cinder-volume[93788]: DEBUG cinder.utils [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] Path /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-dc800555-b4e8-47c0-9eed-76aedc7fbcc4 not found in is_blk_device check {{(pid=93788) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 16:45:31 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-dc800555-b4e8-47c0-9eed-76aedc7fbcc4 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:45:31 devstack sudo[110627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-dc800555-b4e8-47c0-9eed-76aedc7fbcc4 Jun 23 16:45:31 devstack sudo[110627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:45:31 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-8c872871-0e64-4171-b1a4-29f56bfb27be tempest-TestMinimumBasicScenario-494903709 None] Acquiring lock "cinder-b672584d-3406-45b6-a8be-d9d44e47df66-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:45:31 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-8c872871-0e64-4171-b1a4-29f56bfb27be tempest-TestMinimumBasicScenario-494903709 None] Lock "cinder-b672584d-3406-45b6-a8be-d9d44e47df66-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:45:32 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-8c872871-0e64-4171-b1a4-29f56bfb27be tempest-TestMinimumBasicScenario-494903709 None] Acquiring lock "cinder-quobyte-b672584d-3406-45b6-a8be-d9d44e47df66" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:45:32 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-8c872871-0e64-4171-b1a4-29f56bfb27be tempest-TestMinimumBasicScenario-494903709 None] Lock "cinder-quobyte-b672584d-3406-45b6-a8be-d9d44e47df66" acquired by "delete_volume" :: waited 0.019s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:45:32 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd31a07-c286-4c69-a001-ea821b6f9c9c]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:45:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8c872871-0e64-4171-b1a4-29f56bfb27be tempest-TestMinimumBasicScenario-494903709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b672584d-3406-45b6-a8be-d9d44e47df66 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:45:32 devstack sudo[110630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b672584d-3406-45b6-a8be-d9d44e47df66 Jun 23 16:45:32 devstack sudo[110630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:45:33 devstack sudo[110630]: pam_unix(sudo:session): session closed for user root Jun 23 16:45:33 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8c872871-0e64-4171-b1a4-29f56bfb27be tempest-TestMinimumBasicScenario-494903709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b672584d-3406-45b6-a8be-d9d44e47df66" returned: 0 in 1.306s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:45:33 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8c872871-0e64-4171-b1a4-29f56bfb27be tempest-TestMinimumBasicScenario-494903709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b672584d-3406-45b6-a8be-d9d44e47df66 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:45:33 devstack sudo[110650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b672584d-3406-45b6-a8be-d9d44e47df66 Jun 23 16:45:33 devstack sudo[110650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:45:34 devstack sudo[110650]: pam_unix(sudo:session): session closed for user root Jun 23 16:45:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8c872871-0e64-4171-b1a4-29f56bfb27be tempest-TestMinimumBasicScenario-494903709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-b672584d-3406-45b6-a8be-d9d44e47df66" returned: 0 in 1.454s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:45:34 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-8c872871-0e64-4171-b1a4-29f56bfb27be tempest-TestMinimumBasicScenario-494903709 None] Lock "cinder-quobyte-b672584d-3406-45b6-a8be-d9d44e47df66" released by "delete_volume" :: held 2.825s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:45:35 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-8c872871-0e64-4171-b1a4-29f56bfb27be tempest-TestMinimumBasicScenario-494903709 None] Created reservations ['56554a04-31b5-469e-a071-b080f8d803f6', '1b056cff-d23c-401f-88bc-bee6427a3b5c', '17006e2b-518e-4b65-afe7-5aeb21f2e971', '1f69ce16-b17b-4d0a-8e35-79a05f68a2af'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:45:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8c872871-0e64-4171-b1a4-29f56bfb27be tempest-TestMinimumBasicScenario-494903709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:45:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8c872871-0e64-4171-b1a4-29f56bfb27be tempest-TestMinimumBasicScenario-494903709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:45:35 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-8c872871-0e64-4171-b1a4-29f56bfb27be tempest-TestMinimumBasicScenario-494903709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:45:35 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-8c872871-0e64-4171-b1a4-29f56bfb27be tempest-TestMinimumBasicScenario-494903709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:45:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8c872871-0e64-4171-b1a4-29f56bfb27be tempest-TestMinimumBasicScenario-494903709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:45:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8c872871-0e64-4171-b1a4-29f56bfb27be tempest-TestMinimumBasicScenario-494903709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:45:35 devstack sudo[110658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:45:35 devstack sudo[110658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:45:36 devstack sudo[110658]: pam_unix(sudo:session): session closed for user root Jun 23 16:45:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8c872871-0e64-4171-b1a4-29f56bfb27be tempest-TestMinimumBasicScenario-494903709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.057s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:45:36 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-8c872871-0e64-4171-b1a4-29f56bfb27be tempest-TestMinimumBasicScenario-494903709 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:45:36 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-8c872871-0e64-4171-b1a4-29f56bfb27be tempest-TestMinimumBasicScenario-494903709 None] Deleted volume successfully. Jun 23 16:45:36 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-8c872871-0e64-4171-b1a4-29f56bfb27be tempest-TestMinimumBasicScenario-494903709 None] Lock "cinder-b672584d-3406-45b6-a8be-d9d44e47df66-delete_volume" released by "delete_volume" :: held 4.466s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:45:37 devstack sudo[110627]: pam_unix(sudo:session): session closed for user root Jun 23 16:45:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-dc800555-b4e8-47c0-9eed-76aedc7fbcc4" returned: 0 in 6.029s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:45:37 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8616fce-d886-4faa-a59a-c623d9acb660]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:45:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:45:37 devstack sudo[110701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318 Jun 23 16:45:37 devstack sudo[110701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:45:38 devstack sudo[110701]: pam_unix(sudo:session): session closed for user root Jun 23 16:45:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318" returned: 0 in 1.033s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:45:38 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] Image conversion details: src /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318, size 1024.00 MB, duration 6.03 sec, destination /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-dc800555-b4e8-47c0-9eed-76aedc7fbcc4 {{(pid=93788) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 16:45:38 devstack cinder-volume[93788]: INFO cinder.image.image_utils [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] Converted 1024.00 MB image at 169.81 MB/s Jun 23 16:45:38 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-dc800555-b4e8-47c0-9eed-76aedc7fbcc4 is being set with open permissions: ugo+rw Jun 23 16:45:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-dc800555-b4e8-47c0-9eed-76aedc7fbcc4 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:45:38 devstack sudo[110744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-dc800555-b4e8-47c0-9eed-76aedc7fbcc4 Jun 23 16:45:38 devstack sudo[110744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:45:39 devstack sudo[110744]: pam_unix(sudo:session): session closed for user root Jun 23 16:45:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-dc800555-b4e8-47c0-9eed-76aedc7fbcc4" returned: 0 in 0.730s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:45:39 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] Lock "cinder-quobyte-dc800555-b4e8-47c0-9eed-76aedc7fbcc4" released by "_copy_volume_from_snapshot" :: held 9.551s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:45:39 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] Lock "cinder-quobyte-f6d3f24c-2e65-40b4-9442-5e4f6ee404d6-dc800555-b4e8-47c0-9eed-76aedc7fbcc4" released by "_create_volume_from_snapshot" :: held 9.586s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:45:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.604s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:45:39 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0637a0b-4fdf-481b-84b9-4388d844827f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc800555-b4e8-47c0-9eed-76aedc7fbcc4', 'volume_size': 1, 'snapshot_id': 'f6d3f24c-2e65-40b4-9442-5e4f6ee404d6'}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:45:39 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7ba9360-2cb1-4d96-bbc3-9d26955a350e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:45:39 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] Volume volume-dc800555-b4e8-47c0-9eed-76aedc7fbcc4 (dc800555-b4e8-47c0-9eed-76aedc7fbcc4): created successfully Jun 23 16:45:39 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7ba9360-2cb1-4d96-bbc3-9d26955a350e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:45:39 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] Flow 'volume_create_manager' (a247d859-8266-4f6e-b2d8-8c3c64578603) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:45:39 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-b17dc46c-42c5-4dda-b33d-109f286536e5 tempest-SnapshotDependencyTests-1848611555 None] Created volume successfully. Jun 23 16:45:39 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-581b4ccd-56ab-407f-b258-32515e621267 tempest-SnapshotDependencyTests-1848611555 None] Acquiring lock "cinder-f6d3f24c-2e65-40b4-9442-5e4f6ee404d6-delete_snapshot" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:45:39 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-581b4ccd-56ab-407f-b258-32515e621267 tempest-SnapshotDependencyTests-1848611555 None] Lock "cinder-f6d3f24c-2e65-40b4-9442-5e4f6ee404d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:45:39 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-581b4ccd-56ab-407f-b258-32515e621267 tempest-SnapshotDependencyTests-1848611555 None] Acquiring lock "cinder-quobyte-7747f905-6281-43d7-8e26-18d638598318" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:45:39 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-581b4ccd-56ab-407f-b258-32515e621267 tempest-SnapshotDependencyTests-1848611555 None] Lock "cinder-quobyte-7747f905-6281-43d7-8e26-18d638598318" acquired by "delete_snapshot" :: waited 0.014s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:45:39 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-581b4ccd-56ab-407f-b258-32515e621267 tempest-SnapshotDependencyTests-1848611555 None] Acquiring lock "cinder-quobyte-f6d3f24c-2e65-40b4-9442-5e4f6ee404d6" by "_delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:45:39 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-581b4ccd-56ab-407f-b258-32515e621267 tempest-SnapshotDependencyTests-1848611555 None] Lock "cinder-quobyte-f6d3f24c-2e65-40b4-9442-5e4f6ee404d6" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:45:39 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-581b4ccd-56ab-407f-b258-32515e621267 tempest-SnapshotDependencyTests-1848611555 None] Deleting offline snapshot f6d3f24c-2e65-40b4-9442-5e4f6ee404d6 of volume 7747f905-6281-43d7-8e26-18d638598318 {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:45:39 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-581b4ccd-56ab-407f-b258-32515e621267 tempest-SnapshotDependencyTests-1848611555 None] snapshot_file for this snap is: volume-7747f905-6281-43d7-8e26-18d638598318.f6d3f24c-2e65-40b4-9442-5e4f6ee404d6 {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:45:39 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e646e7-a4ad-4eb2-980d-ebcef462fcfc]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:45:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-581b4ccd-56ab-407f-b258-32515e621267 tempest-SnapshotDependencyTests-1848611555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318.f6d3f24c-2e65-40b4-9442-5e4f6ee404d6 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:45:39 devstack sudo[110750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318.f6d3f24c-2e65-40b4-9442-5e4f6ee404d6 Jun 23 16:45:39 devstack sudo[110750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:45:40 devstack sudo[110750]: pam_unix(sudo:session): session closed for user root Jun 23 16:45:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-581b4ccd-56ab-407f-b258-32515e621267 tempest-SnapshotDependencyTests-1848611555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318.f6d3f24c-2e65-40b4-9442-5e4f6ee404d6" returned: 0 in 0.775s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:45:40 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-581b4ccd-56ab-407f-b258-32515e621267 tempest-SnapshotDependencyTests-1848611555 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7747f905-6281-43d7-8e26-18d638598318(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:45:40 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[07af85bc-3211-42b6-afd9-7e643702073a]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:45:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-581b4ccd-56ab-407f-b258-32515e621267 tempest-SnapshotDependencyTests-1848611555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:45:40 devstack sudo[110755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318 Jun 23 16:45:40 devstack sudo[110755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:45:41 devstack sudo[110755]: pam_unix(sudo:session): session closed for user root Jun 23 16:45:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-581b4ccd-56ab-407f-b258-32515e621267 tempest-SnapshotDependencyTests-1848611555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318" returned: 0 in 0.792s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:45:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-581b4ccd-56ab-407f-b258-32515e621267 tempest-SnapshotDependencyTests-1848611555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318.f6d3f24c-2e65-40b4-9442-5e4f6ee404d6 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:45:41 devstack sudo[110761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318.f6d3f24c-2e65-40b4-9442-5e4f6ee404d6 Jun 23 16:45:41 devstack sudo[110761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:45:42 devstack sudo[110761]: pam_unix(sudo:session): session closed for user root Jun 23 16:45:42 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-581b4ccd-56ab-407f-b258-32515e621267 tempest-SnapshotDependencyTests-1848611555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318.f6d3f24c-2e65-40b4-9442-5e4f6ee404d6" returned: 0 in 0.748s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:45:42 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-581b4ccd-56ab-407f-b258-32515e621267 tempest-SnapshotDependencyTests-1848611555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318.f6d3f24c-2e65-40b4-9442-5e4f6ee404d6 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:45:42 devstack sudo[110766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318.f6d3f24c-2e65-40b4-9442-5e4f6ee404d6 Jun 23 16:45:42 devstack sudo[110766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:45:42 devstack sudo[110766]: pam_unix(sudo:session): session closed for user root Jun 23 16:45:42 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-581b4ccd-56ab-407f-b258-32515e621267 tempest-SnapshotDependencyTests-1848611555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318.f6d3f24c-2e65-40b4-9442-5e4f6ee404d6" returned: 0 in 0.701s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:45:42 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-581b4ccd-56ab-407f-b258-32515e621267 tempest-SnapshotDependencyTests-1848611555 None] Lock "cinder-quobyte-f6d3f24c-2e65-40b4-9442-5e4f6ee404d6" released by "_delete_snapshot" :: held 3.127s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:45:42 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-581b4ccd-56ab-407f-b258-32515e621267 tempest-SnapshotDependencyTests-1848611555 None] Lock "cinder-quobyte-7747f905-6281-43d7-8e26-18d638598318" released by "delete_snapshot" :: held 3.151s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:45:43 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-581b4ccd-56ab-407f-b258-32515e621267 tempest-SnapshotDependencyTests-1848611555 None] Created reservations ['a4e4ecf6-4e26-43fa-b302-d5c4055e77cb', '5dc57fc6-d596-4646-ac93-57244deb0f18', 'b1e24a06-c33e-4e33-891b-5d05a5e9018a', 'fcda80b0-4b70-4bed-9316-e52d5f068626'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:45:43 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-581b4ccd-56ab-407f-b258-32515e621267 tempest-SnapshotDependencyTests-1848611555 None] Delete snapshot completed successfully. Jun 23 16:45:43 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-581b4ccd-56ab-407f-b258-32515e621267 tempest-SnapshotDependencyTests-1848611555 None] Lock "cinder-f6d3f24c-2e65-40b4-9442-5e4f6ee404d6-delete_snapshot" released by "delete_snapshot" :: held 3.282s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:45:44 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ed4c071b-8714-472b-9ae6-c1959b7a95d5 tempest-SnapshotDependencyTests-1848611555 None] Acquiring lock "cinder-7747f905-6281-43d7-8e26-18d638598318-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:45:44 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ed4c071b-8714-472b-9ae6-c1959b7a95d5 tempest-SnapshotDependencyTests-1848611555 None] Lock "cinder-7747f905-6281-43d7-8e26-18d638598318-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:45:44 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ed4c071b-8714-472b-9ae6-c1959b7a95d5 tempest-SnapshotDependencyTests-1848611555 None] Acquiring lock "cinder-quobyte-7747f905-6281-43d7-8e26-18d638598318" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:45:44 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ed4c071b-8714-472b-9ae6-c1959b7a95d5 tempest-SnapshotDependencyTests-1848611555 None] Lock "cinder-quobyte-7747f905-6281-43d7-8e26-18d638598318" acquired by "delete_volume" :: waited 0.019s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:45:44 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1b2e15-2f9c-4876-bb81-bc10df8f19c9]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:45:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ed4c071b-8714-472b-9ae6-c1959b7a95d5 tempest-SnapshotDependencyTests-1848611555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:45:44 devstack sudo[110769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318 Jun 23 16:45:44 devstack sudo[110769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:45:45 devstack sudo[110769]: pam_unix(sudo:session): session closed for user root Jun 23 16:45:45 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ed4c071b-8714-472b-9ae6-c1959b7a95d5 tempest-SnapshotDependencyTests-1848611555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318" returned: 0 in 0.818s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:45:45 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ed4c071b-8714-472b-9ae6-c1959b7a95d5 tempest-SnapshotDependencyTests-1848611555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:45:45 devstack sudo[110774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318 Jun 23 16:45:45 devstack sudo[110774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:45:45 devstack sudo[110774]: pam_unix(sudo:session): session closed for user root Jun 23 16:45:45 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ed4c071b-8714-472b-9ae6-c1959b7a95d5 tempest-SnapshotDependencyTests-1848611555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-7747f905-6281-43d7-8e26-18d638598318" returned: 0 in 0.726s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:45:45 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ed4c071b-8714-472b-9ae6-c1959b7a95d5 tempest-SnapshotDependencyTests-1848611555 None] Lock "cinder-quobyte-7747f905-6281-43d7-8e26-18d638598318" released by "delete_volume" :: held 1.617s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:45:45 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:INSERT=27,cinder:UPDATE=72,cinder:SELECT=64,cinder:DELETE=1 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:45:45 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-ed4c071b-8714-472b-9ae6-c1959b7a95d5 tempest-SnapshotDependencyTests-1848611555 None] Created reservations ['be6cf397-b5f5-4ac6-8ef0-95cab8d3b4d4', '9d505a13-d65b-40b1-bb0e-5acf01c060c0', 'f4e098cc-120b-46e7-bb8b-43817bc5cb25', 'a03a55f7-5efe-4f1c-8f8f-a4828cec63d4'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:45:45 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ed4c071b-8714-472b-9ae6-c1959b7a95d5 tempest-SnapshotDependencyTests-1848611555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:45:45 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ed4c071b-8714-472b-9ae6-c1959b7a95d5 tempest-SnapshotDependencyTests-1848611555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:45:45 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-ed4c071b-8714-472b-9ae6-c1959b7a95d5 tempest-SnapshotDependencyTests-1848611555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:45:45 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-ed4c071b-8714-472b-9ae6-c1959b7a95d5 tempest-SnapshotDependencyTests-1848611555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:45:45 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ed4c071b-8714-472b-9ae6-c1959b7a95d5 tempest-SnapshotDependencyTests-1848611555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:45:45 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ed4c071b-8714-472b-9ae6-c1959b7a95d5 tempest-SnapshotDependencyTests-1848611555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:45:45 devstack sudo[110778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:45:45 devstack sudo[110778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:45:46 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-1379800c-38ee-41b3-a8f3-9b61b90e2667 tempest-SnapshotDependencyTests-1848611555 None] Acquiring lock "cinder-dc800555-b4e8-47c0-9eed-76aedc7fbcc4-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:45:46 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-1379800c-38ee-41b3-a8f3-9b61b90e2667 tempest-SnapshotDependencyTests-1848611555 None] Lock "cinder-dc800555-b4e8-47c0-9eed-76aedc7fbcc4-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:45:46 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-1379800c-38ee-41b3-a8f3-9b61b90e2667 tempest-SnapshotDependencyTests-1848611555 None] Acquiring lock "cinder-quobyte-dc800555-b4e8-47c0-9eed-76aedc7fbcc4" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:45:46 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-1379800c-38ee-41b3-a8f3-9b61b90e2667 tempest-SnapshotDependencyTests-1848611555 None] Lock "cinder-quobyte-dc800555-b4e8-47c0-9eed-76aedc7fbcc4" acquired by "delete_volume" :: waited 0.015s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:45:46 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[13bd3d69-98e9-430d-9076-ea0b9c76df2d]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:45:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1379800c-38ee-41b3-a8f3-9b61b90e2667 tempest-SnapshotDependencyTests-1848611555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-dc800555-b4e8-47c0-9eed-76aedc7fbcc4 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:45:46 devstack sudo[110780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-dc800555-b4e8-47c0-9eed-76aedc7fbcc4 Jun 23 16:45:46 devstack sudo[110780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:45:46 devstack sudo[110778]: pam_unix(sudo:session): session closed for user root Jun 23 16:45:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ed4c071b-8714-472b-9ae6-c1959b7a95d5 tempest-SnapshotDependencyTests-1848611555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.921s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:45:46 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-ed4c071b-8714-472b-9ae6-c1959b7a95d5 tempest-SnapshotDependencyTests-1848611555 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:45:46 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-ed4c071b-8714-472b-9ae6-c1959b7a95d5 tempest-SnapshotDependencyTests-1848611555 None] Deleted volume successfully. Jun 23 16:45:46 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ed4c071b-8714-472b-9ae6-c1959b7a95d5 tempest-SnapshotDependencyTests-1848611555 None] Lock "cinder-7747f905-6281-43d7-8e26-18d638598318-delete_volume" released by "delete_volume" :: held 2.814s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:45:47 devstack sudo[110780]: pam_unix(sudo:session): session closed for user root Jun 23 16:45:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1379800c-38ee-41b3-a8f3-9b61b90e2667 tempest-SnapshotDependencyTests-1848611555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-dc800555-b4e8-47c0-9eed-76aedc7fbcc4" returned: 0 in 0.967s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:45:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1379800c-38ee-41b3-a8f3-9b61b90e2667 tempest-SnapshotDependencyTests-1848611555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-dc800555-b4e8-47c0-9eed-76aedc7fbcc4 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:45:47 devstack sudo[110794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-dc800555-b4e8-47c0-9eed-76aedc7fbcc4 Jun 23 16:45:47 devstack sudo[110794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:45:48 devstack sudo[110794]: pam_unix(sudo:session): session closed for user root Jun 23 16:45:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1379800c-38ee-41b3-a8f3-9b61b90e2667 tempest-SnapshotDependencyTests-1848611555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-dc800555-b4e8-47c0-9eed-76aedc7fbcc4" returned: 0 in 0.742s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:45:48 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-1379800c-38ee-41b3-a8f3-9b61b90e2667 tempest-SnapshotDependencyTests-1848611555 None] Lock "cinder-quobyte-dc800555-b4e8-47c0-9eed-76aedc7fbcc4" released by "delete_volume" :: held 1.756s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:45:48 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-1379800c-38ee-41b3-a8f3-9b61b90e2667 tempest-SnapshotDependencyTests-1848611555 None] Created reservations ['7d3c0465-156f-4d2c-87ba-12c785d7fa07', '77b90d60-cafb-4526-ac53-8008fd4674e5', 'ecb1f4e1-1d14-4b73-801e-c2b9d041ea7a', '6fc010cf-31f4-4720-918e-f3bd36eabc15'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:45:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-1379800c-38ee-41b3-a8f3-9b61b90e2667 tempest-SnapshotDependencyTests-1848611555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:45:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-1379800c-38ee-41b3-a8f3-9b61b90e2667 tempest-SnapshotDependencyTests-1848611555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:45:48 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-1379800c-38ee-41b3-a8f3-9b61b90e2667 tempest-SnapshotDependencyTests-1848611555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:45:48 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-1379800c-38ee-41b3-a8f3-9b61b90e2667 tempest-SnapshotDependencyTests-1848611555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:45:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-1379800c-38ee-41b3-a8f3-9b61b90e2667 tempest-SnapshotDependencyTests-1848611555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:45:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1379800c-38ee-41b3-a8f3-9b61b90e2667 tempest-SnapshotDependencyTests-1848611555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:45:48 devstack sudo[110798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:45:48 devstack sudo[110798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:45:49 devstack sudo[110798]: pam_unix(sudo:session): session closed for user root Jun 23 16:45:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1379800c-38ee-41b3-a8f3-9b61b90e2667 tempest-SnapshotDependencyTests-1848611555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.718s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:45:49 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-1379800c-38ee-41b3-a8f3-9b61b90e2667 tempest-SnapshotDependencyTests-1848611555 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:45:49 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-1379800c-38ee-41b3-a8f3-9b61b90e2667 tempest-SnapshotDependencyTests-1848611555 None] Deleted volume successfully. Jun 23 16:45:49 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-1379800c-38ee-41b3-a8f3-9b61b90e2667 tempest-SnapshotDependencyTests-1848611555 None] Lock "cinder-dc800555-b4e8-47c0-9eed-76aedc7fbcc4-delete_volume" released by "delete_volume" :: held 2.700s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:45:58 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:INSERT=4,cinder:UPDATE=20,cinder:SELECT=6,cinder:DELETE=1 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:45:59 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:SELECT=27,cinder:DELETE=4,cinder:INSERT=7,cinder:UPDATE=27 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:46:01 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:46:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:46:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:46:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:46:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:46:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:46:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:46:01 devstack sudo[110809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:46:01 devstack sudo[110809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:46:02 devstack sudo[110809]: pam_unix(sudo:session): session closed for user root Jun 23 16:46:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.735s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:46:02 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:46:02 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager._thread_info {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:46:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread count: 28 {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 16:46:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread info: [<_MainThread(MainThread, started 126303828988032)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 16:46:36 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:46:52 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ed75318-18f2-461a-97dd-cd8d472f7025 tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:46:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8ed75318-18f2-461a-97dd-cd8d472f7025 tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Flow 'volume_create_manager' (17cc808b-2b9c-444e-baa9-a5c6f863498b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:46:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8ed75318-18f2-461a-97dd-cd8d472f7025 tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (619235e6-5f0f-4ca0-9547-b70c23bfb8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:46:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8ed75318-18f2-461a-97dd-cd8d472f7025 tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (619235e6-5f0f-4ca0-9547-b70c23bfb8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1638015041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c4083b8-2235-4034-b2b6-92bb9e75c83f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac831ec2c3074d5faacf4d1faf14de72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:46:52Z,use_quota=True,user_id='dcb99aa20fad45329a8f0ac7ccc9275f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:46:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8ed75318-18f2-461a-97dd-cd8d472f7025 tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd6a50d1-9c21-4af6-ae42-88b53ffeb420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:46:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8ed75318-18f2-461a-97dd-cd8d472f7025 tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd6a50d1-9c21-4af6-ae42-88b53ffeb420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:46:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8ed75318-18f2-461a-97dd-cd8d472f7025 tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ee3269d-fec0-48b6-bd9b-6a2c01599d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:46:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8ed75318-18f2-461a-97dd-cd8d472f7025 tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ee3269d-fec0-48b6-bd9b-6a2c01599d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c4083b8-2235-4034-b2b6-92bb9e75c83f', 'volume_name': 'volume-4c4083b8-2235-4034-b2b6-92bb9e75c83f', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:46:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8ed75318-18f2-461a-97dd-cd8d472f7025 tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53dd395b-6e28-4fc7-a974-b5aba56fb761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:46:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8ed75318-18f2-461a-97dd-cd8d472f7025 tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53dd395b-6e28-4fc7-a974-b5aba56fb761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:46:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8ed75318-18f2-461a-97dd-cd8d472f7025 tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8612c585-135b-4826-9328-36ed14e8db20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:46:52 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-8ed75318-18f2-461a-97dd-cd8d472f7025 tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Volume 4c4083b8-2235-4034-b2b6-92bb9e75c83f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c4083b8-2235-4034-b2b6-92bb9e75c83f', 'volume_size': 1} Jun 23 16:46:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8ed75318-18f2-461a-97dd-cd8d472f7025 tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:46:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8ed75318-18f2-461a-97dd-cd8d472f7025 tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:46:52 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-8ed75318-18f2-461a-97dd-cd8d472f7025 tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1638015041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c4083b8-2235-4034-b2b6-92bb9e75c83f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac831ec2c3074d5faacf4d1faf14de72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:46:52Z,use_quota=True,user_id='dcb99aa20fad45329a8f0ac7ccc9275f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:46:52 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-8ed75318-18f2-461a-97dd-cd8d472f7025 tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Creating volume 4c4083b8-2235-4034-b2b6-92bb9e75c83f {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:46:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8ed75318-18f2-461a-97dd-cd8d472f7025 tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:46:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8ed75318-18f2-461a-97dd-cd8d472f7025 tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:46:52 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-8ed75318-18f2-461a-97dd-cd8d472f7025 tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:46:52 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-8ed75318-18f2-461a-97dd-cd8d472f7025 tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:46:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8ed75318-18f2-461a-97dd-cd8d472f7025 tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:46:52 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-8ed75318-18f2-461a-97dd-cd8d472f7025 tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:46:52 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-8ed75318-18f2-461a-97dd-cd8d472f7025 tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:46:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8ed75318-18f2-461a-97dd-cd8d472f7025 tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c4083b8-2235-4034-b2b6-92bb9e75c83f 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:46:52 devstack sudo[110997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c4083b8-2235-4034-b2b6-92bb9e75c83f 1073741824 Jun 23 16:46:52 devstack sudo[110997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:46:53 devstack sudo[110997]: pam_unix(sudo:session): session closed for user root Jun 23 16:46:53 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8ed75318-18f2-461a-97dd-cd8d472f7025 tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c4083b8-2235-4034-b2b6-92bb9e75c83f 1073741824" returned: 0 in 0.851s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:46:53 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8ed75318-18f2-461a-97dd-cd8d472f7025 tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c4083b8-2235-4034-b2b6-92bb9e75c83f {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:46:53 devstack sudo[111003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c4083b8-2235-4034-b2b6-92bb9e75c83f Jun 23 16:46:53 devstack sudo[111003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:46:54 devstack sudo[111003]: pam_unix(sudo:session): session closed for user root Jun 23 16:46:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8ed75318-18f2-461a-97dd-cd8d472f7025 tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c4083b8-2235-4034-b2b6-92bb9e75c83f" returned: 0 in 0.690s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:46:54 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-8ed75318-18f2-461a-97dd-cd8d472f7025 tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] <== create_volume: return (1588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:46:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8ed75318-18f2-461a-97dd-cd8d472f7025 tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.590s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:46:54 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8ed75318-18f2-461a-97dd-cd8d472f7025 tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8612c585-135b-4826-9328-36ed14e8db20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c4083b8-2235-4034-b2b6-92bb9e75c83f', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:46:54 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8ed75318-18f2-461a-97dd-cd8d472f7025 tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99f39002-94a9-425c-938b-f00f390828bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:46:54 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-8ed75318-18f2-461a-97dd-cd8d472f7025 tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Volume volume-4c4083b8-2235-4034-b2b6-92bb9e75c83f (4c4083b8-2235-4034-b2b6-92bb9e75c83f): created successfully Jun 23 16:46:54 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8ed75318-18f2-461a-97dd-cd8d472f7025 tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99f39002-94a9-425c-938b-f00f390828bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:46:54 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-8ed75318-18f2-461a-97dd-cd8d472f7025 tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Flow 'volume_create_manager' (17cc808b-2b9c-444e-baa9-a5c6f863498b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:46:54 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-8ed75318-18f2-461a-97dd-cd8d472f7025 tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Created volume successfully. Jun 23 16:46:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-9fde00fd-4e4e-4b32-bc23-7b02a28d05e2 req-37711eb5-bfa1-4489-b1a6-7170352f6ae4 tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:46:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-9fde00fd-4e4e-4b32-bc23-7b02a28d05e2 req-37711eb5-bfa1-4489-b1a6-7170352f6ae4 tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:46:57 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[28119872-9235-472f-ac1b-2fedf2cdbd0e]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:46:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-9fde00fd-4e4e-4b32-bc23-7b02a28d05e2 req-37711eb5-bfa1-4489-b1a6-7170352f6ae4 tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c4083b8-2235-4034-b2b6-92bb9e75c83f {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:46:57 devstack sudo[111017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c4083b8-2235-4034-b2b6-92bb9e75c83f Jun 23 16:46:57 devstack sudo[111017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:46:58 devstack sudo[111017]: pam_unix(sudo:session): session closed for user root Jun 23 16:46:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-9fde00fd-4e4e-4b32-bc23-7b02a28d05e2 req-37711eb5-bfa1-4489-b1a6-7170352f6ae4 tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c4083b8-2235-4034-b2b6-92bb9e75c83f" returned: 0 in 0.793s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:46:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-9fde00fd-4e4e-4b32-bc23-7b02a28d05e2 req-37711eb5-bfa1-4489-b1a6-7170352f6ae4 tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.812s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:46:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-9fde00fd-4e4e-4b32-bc23-7b02a28d05e2 req-37711eb5-bfa1-4489-b1a6-7170352f6ae4 tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e', 'name': 'volume-4c4083b8-2235-4034-b2b6-92bb9e75c83f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '249181b3-88dd-4455-b3d9-22f070c228a8', 'enforce_multipath': True} {{(pid=93788) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 16:46:58 devstack cinder-volume[93788]: INFO cinder.volume.manager [req-9fde00fd-4e4e-4b32-bc23-7b02a28d05e2 req-37711eb5-bfa1-4489-b1a6-7170352f6ae4 tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] attachment_update completed successfully. Jun 23 16:47:01 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:47:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:47:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:47:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:47:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:47:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:47:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:47:01 devstack sudo[111408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:47:01 devstack sudo[111408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:47:02 devstack sudo[111408]: pam_unix(sudo:session): session closed for user root Jun 23 16:47:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.640s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:47:02 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:47:02 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager._thread_info {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:47:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread count: 28 {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 16:47:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread info: [<_MainThread(MainThread, started 126303828988032)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 16:47:04 devstack cinder-volume[93788]: INFO cinder.volume.manager [req-b782708e-d1c5-4836-b5b3-8c8cf7c56ab7 req-8897d609-4144-4276-8182-1b313d622ac0 tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Terminate volume connection completed successfully. Jun 23 16:47:04 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-b782708e-d1c5-4836-b5b3-8c8cf7c56ab7 req-8897d609-4144-4276-8182-1b313d622ac0 tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Deleting attachment 249181b3-88dd-4455-b3d9-22f070c228a8. {{(pid=93788) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 16:47:06 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e33f4ad9-ac68-48cf-a375-6d9277de9ccd tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Acquiring lock "cinder-4c4083b8-2235-4034-b2b6-92bb9e75c83f-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:47:06 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e33f4ad9-ac68-48cf-a375-6d9277de9ccd tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Lock "cinder-4c4083b8-2235-4034-b2b6-92bb9e75c83f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:47:06 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e33f4ad9-ac68-48cf-a375-6d9277de9ccd tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Acquiring lock "cinder-quobyte-4c4083b8-2235-4034-b2b6-92bb9e75c83f" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:47:06 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e33f4ad9-ac68-48cf-a375-6d9277de9ccd tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Lock "cinder-quobyte-4c4083b8-2235-4034-b2b6-92bb9e75c83f" acquired by "delete_volume" :: waited 0.015s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:47:06 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8e6be0-4f97-4521-9ac4-bf9af49a7d31]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:47:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e33f4ad9-ac68-48cf-a375-6d9277de9ccd tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c4083b8-2235-4034-b2b6-92bb9e75c83f {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:47:07 devstack sudo[111442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c4083b8-2235-4034-b2b6-92bb9e75c83f Jun 23 16:47:07 devstack sudo[111442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:47:07 devstack sudo[111442]: pam_unix(sudo:session): session closed for user root Jun 23 16:47:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e33f4ad9-ac68-48cf-a375-6d9277de9ccd tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c4083b8-2235-4034-b2b6-92bb9e75c83f" returned: 0 in 0.782s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:47:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e33f4ad9-ac68-48cf-a375-6d9277de9ccd tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c4083b8-2235-4034-b2b6-92bb9e75c83f {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:47:07 devstack sudo[111447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c4083b8-2235-4034-b2b6-92bb9e75c83f Jun 23 16:47:07 devstack sudo[111447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:47:08 devstack sudo[111447]: pam_unix(sudo:session): session closed for user root Jun 23 16:47:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e33f4ad9-ac68-48cf-a375-6d9277de9ccd tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4c4083b8-2235-4034-b2b6-92bb9e75c83f" returned: 0 in 0.680s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:47:08 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e33f4ad9-ac68-48cf-a375-6d9277de9ccd tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Lock "cinder-quobyte-4c4083b8-2235-4034-b2b6-92bb9e75c83f" released by "delete_volume" :: held 1.504s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:47:08 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-e33f4ad9-ac68-48cf-a375-6d9277de9ccd tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Created reservations ['c098c617-5345-405a-b590-d0a9bc1b552d', '80b9abe7-5ff8-4b59-8a19-c60bb07e8e26', '2ce94193-0c83-445a-9113-2e12c3f098a4', '2a9e9d80-154a-46cd-a4ee-54075bf3a671'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:47:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e33f4ad9-ac68-48cf-a375-6d9277de9ccd tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:47:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e33f4ad9-ac68-48cf-a375-6d9277de9ccd tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:47:08 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e33f4ad9-ac68-48cf-a375-6d9277de9ccd tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:47:08 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e33f4ad9-ac68-48cf-a375-6d9277de9ccd tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:47:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e33f4ad9-ac68-48cf-a375-6d9277de9ccd tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:47:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e33f4ad9-ac68-48cf-a375-6d9277de9ccd tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:47:08 devstack sudo[111450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:47:08 devstack sudo[111450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:47:09 devstack sudo[111450]: pam_unix(sudo:session): session closed for user root Jun 23 16:47:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e33f4ad9-ac68-48cf-a375-6d9277de9ccd tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.722s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:47:09 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-e33f4ad9-ac68-48cf-a375-6d9277de9ccd tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:47:09 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-e33f4ad9-ac68-48cf-a375-6d9277de9ccd tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Deleted volume successfully. Jun 23 16:47:09 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e33f4ad9-ac68-48cf-a375-6d9277de9ccd tempest-TestServerVolumeAttachScenarioOldVersion-697277488 None] Lock "cinder-4c4083b8-2235-4034-b2b6-92bb9e75c83f-delete_volume" released by "delete_volume" :: held 2.427s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:47:18 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:UPDATE=11,cinder:SELECT=15,cinder:INSERT=3 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:47:19 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:SELECT=12,cinder:UPDATE=14,cinder:DELETE=2,cinder:INSERT=2 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:47:48 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:47:48 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] Flow 'volume_create_manager' (b962515e-8a70-4b6c-afe1-4bece5ad16b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:47:48 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (389f6e47-98c2-4382-a173-91d44345e723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:47:48 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (389f6e47-98c2-4382-a173-91d44345e723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-17512651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c924c814-a5ac-46c0-9bdb-5b9b3675e50e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edc5e0ce8bb34792966c10a46db4d6f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:47:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:47:48Z,use_quota=True,user_id='c85bceaf4c55480a9fcdd6089082fc8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:47:48 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08a2ff51-9af2-41a5-8f5e-279e194fb63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:47:48 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08a2ff51-9af2-41a5-8f5e-279e194fb63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:47:48 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e10e0204-8305-48df-9a66-8b0c0ba6dbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:47:48 devstack cinder-volume[93788]: DEBUG cinder.image.glance [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] Creating Keystone auth plugin from conf {{(pid=93788) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 16:47:48 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e10e0204-8305-48df-9a66-8b0c0ba6dbb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c924c814-a5ac-46c0-9bdb-5b9b3675e50e', 'volume_name': 'volume-c924c814-a5ac-46c0-9bdb-5b9b3675e50e', 'volume_size': 1, 'image_id': '36d19347-ef32-4018-a0b0-67c4eb356ff0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/36d19347-ef32-4018-a0b0-67c4eb356ff0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '96f86ae628444b53b4eb7231789566de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '36d19347-ef32-4018-a0b0-67c4eb356ff0', 'created_at': datetime.datetime(2026, 6, 23, 14, 20, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 14, 20, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36d19347-ef32-4018-a0b0-67c4eb356ff0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:47:48 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (795845d5-d83d-4007-a880-0b4dd216273e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:47:48 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (795845d5-d83d-4007-a880-0b4dd216273e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:47:48 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8cf65d7-db0e-44c8-b1b0-0dd07de4e821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:47:48 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] Volume c924c814-a5ac-46c0-9bdb-5b9b3675e50e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c924c814-a5ac-46c0-9bdb-5b9b3675e50e', 'volume_size': 1, 'image_id': '36d19347-ef32-4018-a0b0-67c4eb356ff0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/36d19347-ef32-4018-a0b0-67c4eb356ff0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '96f86ae628444b53b4eb7231789566de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '36d19347-ef32-4018-a0b0-67c4eb356ff0', 'created_at': datetime.datetime(2026, 6, 23, 14, 20, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 14, 20, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36d19347-ef32-4018-a0b0-67c4eb356ff0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 23 16:47:48 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] Trying to clone c924c814-a5ac-46c0-9bdb-5b9b3675e50e from image 36d19347-ef32-4018-a0b0-67c4eb356ff0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/36d19347-ef32-4018-a0b0-67c4eb356ff0', 'metadata': {}}]). {{(pid=93788) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 16:47:49 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_bbqds_mwdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93788) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 16:47:49 devstack cinder-volume[93788]: INFO cinder.image.image_utils [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] Image download 20.69 MB at 20.69 MB/s Jun 23 16:47:49 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[31148aae-04d1-4ba1-8489-085fc82215e7]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:47:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_bbqds_mwdevstack@QuobyteHD {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:47:49 devstack sudo[111606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_bbqds_mwdevstack@QuobyteHD Jun 23 16:47:49 devstack sudo[111606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:47:49 devstack sudo[111606]: pam_unix(sudo:session): session closed for user root Jun 23 16:47:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_bbqds_mwdevstack@QuobyteHD" returned: 0 in 0.727s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:47:49 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] Temporary image 36d19347-ef32-4018-a0b0-67c4eb356ff0 is fetched for user c85bceaf4c55480a9fcdd6089082fc8c. {{(pid=93788) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 16:47:49 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4483f01-4cca-415f-ad37-55ab1118e834]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:47:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_bbqds_mwdevstack@QuobyteHD {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:47:50 devstack sudo[111611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_bbqds_mwdevstack@QuobyteHD Jun 23 16:47:50 devstack sudo[111611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:47:50 devstack sudo[111611]: pam_unix(sudo:session): session closed for user root Jun 23 16:47:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_bbqds_mwdevstack@QuobyteHD" returned: 0 in 0.756s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:47:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:47:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:47:50 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-17512651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c924c814-a5ac-46c0-9bdb-5b9b3675e50e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edc5e0ce8bb34792966c10a46db4d6f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:47:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:47:48Z,use_quota=True,user_id='c85bceaf4c55480a9fcdd6089082fc8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:47:50 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] Creating volume c924c814-a5ac-46c0-9bdb-5b9b3675e50e {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:47:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:47:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:47:50 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:47:50 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:47:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:47:50 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:47:50 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:47:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c924c814-a5ac-46c0-9bdb-5b9b3675e50e 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:47:50 devstack sudo[111616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c924c814-a5ac-46c0-9bdb-5b9b3675e50e 1073741824 Jun 23 16:47:50 devstack sudo[111616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:47:51 devstack sudo[111616]: pam_unix(sudo:session): session closed for user root Jun 23 16:47:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c924c814-a5ac-46c0-9bdb-5b9b3675e50e 1073741824" returned: 0 in 0.800s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:47:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c924c814-a5ac-46c0-9bdb-5b9b3675e50e {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:47:51 devstack sudo[111622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c924c814-a5ac-46c0-9bdb-5b9b3675e50e Jun 23 16:47:51 devstack sudo[111622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:47:52 devstack sudo[111622]: pam_unix(sudo:session): session closed for user root Jun 23 16:47:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c924c814-a5ac-46c0-9bdb-5b9b3675e50e" returned: 0 in 0.659s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:47:52 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:47:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.503s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:47:52 devstack cinder-volume[93788]: DEBUG cinder.volume.volume_utils [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] Attempting download of 36d19347-ef32-4018-a0b0-67c4eb356ff0 ((None, [{'url': 'file:///opt/stack/data/glance/images/36d19347-ef32-4018-a0b0-67c4eb356ff0', 'metadata': {}}])) to volume c924c814-a5ac-46c0-9bdb-5b9b3675e50e. {{(pid=93788) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 16:47:52 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e446320e-f5f7-4bf6-9465-67e67b879fb9]: (4, 'raw') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:47:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36d19347-ef32-4018-a0b0-67c4eb356ff0_4h0mkr_0 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:47:52 devstack sudo[111625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36d19347-ef32-4018-a0b0-67c4eb356ff0_4h0mkr_0 Jun 23 16:47:52 devstack sudo[111625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:47:52 devstack sudo[111625]: pam_unix(sudo:session): session closed for user root Jun 23 16:47:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36d19347-ef32-4018-a0b0-67c4eb356ff0_4h0mkr_0" returned: 0 in 0.711s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:47:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36d19347-ef32-4018-a0b0-67c4eb356ff0_4h0mkr_0 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:47:53 devstack sudo[111629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36d19347-ef32-4018-a0b0-67c4eb356ff0_4h0mkr_0 Jun 23 16:47:53 devstack sudo[111629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:47:53 devstack sudo[111629]: pam_unix(sudo:session): session closed for user root Jun 23 16:47:53 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36d19347-ef32-4018-a0b0-67c4eb356ff0_4h0mkr_0" returned: 1 in 0.719s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:47:53 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36d19347-ef32-4018-a0b0-67c4eb356ff0_4h0mkr_0' failed. Not Retrying. {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:47:53 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71d6adf-eeb1-4b97-b857-88d288415480]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:47:53 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_bbqds_mwdevstack@QuobyteHD {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:47:53 devstack sudo[111633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_bbqds_mwdevstack@QuobyteHD Jun 23 16:47:53 devstack sudo[111633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:47:54 devstack sudo[111633]: pam_unix(sudo:session): session closed for user root Jun 23 16:47:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_bbqds_mwdevstack@QuobyteHD" returned: 0 in 0.713s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:47:54 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] 36d19347-ef32-4018-a0b0-67c4eb356ff0 was qcow2, converting to raw {{(pid=93788) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 16:47:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_bbqds_mwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c924c814-a5ac-46c0-9bdb-5b9b3675e50e {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:47:54 devstack sudo[111638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_bbqds_mwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c924c814-a5ac-46c0-9bdb-5b9b3675e50e Jun 23 16:47:54 devstack sudo[111638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:47:56 devstack sudo[111638]: pam_unix(sudo:session): session closed for user root Jun 23 16:47:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_bbqds_mwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c924c814-a5ac-46c0-9bdb-5b9b3675e50e" returned: 0 in 1.738s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:47:56 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_36d19347-ef32-4018-a0b0-67c4eb356ff0_bbqds_mwdevstack@QuobyteHD, size 112.00 MB, duration 1.74 sec, destination /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c924c814-a5ac-46c0-9bdb-5b9b3675e50e {{(pid=93788) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 16:47:56 devstack cinder-volume[93788]: INFO cinder.image.image_utils [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] Converted 112.00 MB image at 64.39 MB/s Jun 23 16:47:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c924c814-a5ac-46c0-9bdb-5b9b3675e50e 1G {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:47:56 devstack sudo[111648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c924c814-a5ac-46c0-9bdb-5b9b3675e50e 1G Jun 23 16:47:56 devstack sudo[111648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:47:56 devstack sudo[111648]: pam_unix(sudo:session): session closed for user root Jun 23 16:47:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c924c814-a5ac-46c0-9bdb-5b9b3675e50e 1G" returned: 0 in 0.671s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:47:56 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44c738f-2664-4482-b15e-a88f11296641]: (4, 'raw') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:47:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c924c814-a5ac-46c0-9bdb-5b9b3675e50e {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:47:56 devstack sudo[111653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c924c814-a5ac-46c0-9bdb-5b9b3675e50e Jun 23 16:47:56 devstack sudo[111653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:47:57 devstack sudo[111653]: pam_unix(sudo:session): session closed for user root Jun 23 16:47:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c924c814-a5ac-46c0-9bdb-5b9b3675e50e" returned: 0 in 0.774s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:47:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c924c814-a5ac-46c0-9bdb-5b9b3675e50e {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:47:57 devstack sudo[111657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c924c814-a5ac-46c0-9bdb-5b9b3675e50e Jun 23 16:47:57 devstack sudo[111657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:47:58 devstack sudo[111657]: pam_unix(sudo:session): session closed for user root Jun 23 16:47:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c924c814-a5ac-46c0-9bdb-5b9b3675e50e" returned: 1 in 0.736s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:47:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c924c814-a5ac-46c0-9bdb-5b9b3675e50e' failed. Not Retrying. {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:47:58 devstack cinder-volume[93788]: DEBUG cinder.volume.volume_utils [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] Downloaded image 36d19347-ef32-4018-a0b0-67c4eb356ff0 ((None, [{'url': 'file:///opt/stack/data/glance/images/36d19347-ef32-4018-a0b0-67c4eb356ff0', 'metadata': {}}])) to volume c924c814-a5ac-46c0-9bdb-5b9b3675e50e successfully. {{(pid=93788) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 16:47:58 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] Temporary image 36d19347-ef32-4018-a0b0-67c4eb356ff0 for user c85bceaf4c55480a9fcdd6089082fc8c is deleted. {{(pid=93788) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 16:47:58 devstack cinder-volume[93788]: DEBUG cinder.volume.volume_utils [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] Marking volume c924c814-a5ac-46c0-9bdb-5b9b3675e50e as bootable. {{(pid=93788) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 16:47:58 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] Copying metadata from image 36d19347-ef32-4018-a0b0-67c4eb356ff0 to c924c814-a5ac-46c0-9bdb-5b9b3675e50e. {{(pid=93788) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 16:47:58 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] Creating volume glance metadata for volume c924c814-a5ac-46c0-9bdb-5b9b3675e50e backed by image 36d19347-ef32-4018-a0b0-67c4eb356ff0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '36d19347-ef32-4018-a0b0-67c4eb356ff0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93788) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 16:47:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8cf65d7-db0e-44c8-b1b0-0dd07de4e821) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c924c814-a5ac-46c0-9bdb-5b9b3675e50e', 'volume_size': 1, 'image_id': '36d19347-ef32-4018-a0b0-67c4eb356ff0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/36d19347-ef32-4018-a0b0-67c4eb356ff0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '96f86ae628444b53b4eb7231789566de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '36d19347-ef32-4018-a0b0-67c4eb356ff0', 'created_at': datetime.datetime(2026, 6, 23, 14, 20, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 14, 20, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36d19347-ef32-4018-a0b0-67c4eb356ff0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:47:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (300a38a6-5292-4047-9eb8-ff8e2b8a7fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:47:58 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] Volume volume-c924c814-a5ac-46c0-9bdb-5b9b3675e50e (c924c814-a5ac-46c0-9bdb-5b9b3675e50e): created successfully Jun 23 16:47:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (300a38a6-5292-4047-9eb8-ff8e2b8a7fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:47:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] Flow 'volume_create_manager' (b962515e-8a70-4b6c-afe1-4bece5ad16b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:47:58 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-0392f714-d3a1-47f2-9716-904df6a48cfa tempest-TestShelveInstance-1938681116 None] Created volume successfully. Jun 23 16:48:01 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:48:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:48:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:48:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:48:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:48:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:48:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:48:01 devstack sudo[111666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:48:01 devstack sudo[111666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:48:02 devstack sudo[111666]: pam_unix(sudo:session): session closed for user root Jun 23 16:48:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.666s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:48:02 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:48:02 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager._thread_info {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:48:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread count: 28 {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 16:48:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread info: [<_MainThread(MainThread, started 126303828988032)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 16:48:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-660e0f52-22b5-44c0-a683-638ac0a23786 req-9cb2eccc-ccd0-44eb-a025-5019d668dc49 tempest-TestShelveInstance-1938681116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:48:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-660e0f52-22b5-44c0-a683-638ac0a23786 req-9cb2eccc-ccd0-44eb-a025-5019d668dc49 tempest-TestShelveInstance-1938681116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:48:06 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5bd349-d38a-4649-931a-083a86ab9bcb]: (4, 'raw') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:48:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-660e0f52-22b5-44c0-a683-638ac0a23786 req-9cb2eccc-ccd0-44eb-a025-5019d668dc49 tempest-TestShelveInstance-1938681116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c924c814-a5ac-46c0-9bdb-5b9b3675e50e {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:48:06 devstack sudo[111677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c924c814-a5ac-46c0-9bdb-5b9b3675e50e Jun 23 16:48:06 devstack sudo[111677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:48:06 devstack sudo[111677]: pam_unix(sudo:session): session closed for user root Jun 23 16:48:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-660e0f52-22b5-44c0-a683-638ac0a23786 req-9cb2eccc-ccd0-44eb-a025-5019d668dc49 tempest-TestShelveInstance-1938681116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c924c814-a5ac-46c0-9bdb-5b9b3675e50e" returned: 0 in 0.820s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:48:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-660e0f52-22b5-44c0-a683-638ac0a23786 req-9cb2eccc-ccd0-44eb-a025-5019d668dc49 tempest-TestShelveInstance-1938681116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c924c814-a5ac-46c0-9bdb-5b9b3675e50e {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:48:07 devstack sudo[111682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c924c814-a5ac-46c0-9bdb-5b9b3675e50e Jun 23 16:48:07 devstack sudo[111682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:48:07 devstack sudo[111682]: pam_unix(sudo:session): session closed for user root Jun 23 16:48:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-660e0f52-22b5-44c0-a683-638ac0a23786 req-9cb2eccc-ccd0-44eb-a025-5019d668dc49 tempest-TestShelveInstance-1938681116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c924c814-a5ac-46c0-9bdb-5b9b3675e50e" returned: 1 in 0.755s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:48:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-660e0f52-22b5-44c0-a683-638ac0a23786 req-9cb2eccc-ccd0-44eb-a025-5019d668dc49 tempest-TestShelveInstance-1938681116 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c924c814-a5ac-46c0-9bdb-5b9b3675e50e' failed. Not Retrying. {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:48:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-660e0f52-22b5-44c0-a683-638ac0a23786 req-9cb2eccc-ccd0-44eb-a025-5019d668dc49 tempest-TestShelveInstance-1938681116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.626s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:48:07 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-660e0f52-22b5-44c0-a683-638ac0a23786 req-9cb2eccc-ccd0-44eb-a025-5019d668dc49 tempest-TestShelveInstance-1938681116 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e', 'name': 'volume-c924c814-a5ac-46c0-9bdb-5b9b3675e50e', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '605e06b3-7f8f-4a12-acea-e399bb1e8efa', 'enforce_multipath': True} {{(pid=93788) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 16:48:07 devstack cinder-volume[93788]: INFO cinder.volume.manager [req-660e0f52-22b5-44c0-a683-638ac0a23786 req-9cb2eccc-ccd0-44eb-a025-5019d668dc49 tempest-TestShelveInstance-1938681116 None] attachment_update completed successfully. Jun 23 16:48:17 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:UPDATE=6,cinder:SELECT=16,cinder:INSERT=4,cinder:DELETE=1 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:48:17 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:SELECT=14,cinder:INSERT=10,cinder:UPDATE=6 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:48:36 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:SELECT=1 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:48:36 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:UPDATE=1 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:48:45 devstack cinder-volume[93788]: INFO cinder.volume.manager [req-c18e5a79-f185-4957-8d79-39dfa1e62bf6 req-cead47a7-5f08-437b-8875-b1dba512e316 tempest-TestShelveInstance-1938681116 None] Terminate volume connection completed successfully. Jun 23 16:48:45 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-c18e5a79-f185-4957-8d79-39dfa1e62bf6 req-cead47a7-5f08-437b-8875-b1dba512e316 tempest-TestShelveInstance-1938681116 None] Deleting attachment 605e06b3-7f8f-4a12-acea-e399bb1e8efa. {{(pid=93788) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 16:48:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-39baab63-5636-477d-b414-1be5561817a8 req-dfac6666-e723-4a2c-8e96-3dce7cce9d81 tempest-TestShelveInstance-1938681116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:48:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-39baab63-5636-477d-b414-1be5561817a8 req-dfac6666-e723-4a2c-8e96-3dce7cce9d81 tempest-TestShelveInstance-1938681116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:48:49 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51694d3-1787-441f-9d39-aa9d1dd636a2]: (4, 'raw') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:48:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-39baab63-5636-477d-b414-1be5561817a8 req-dfac6666-e723-4a2c-8e96-3dce7cce9d81 tempest-TestShelveInstance-1938681116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c924c814-a5ac-46c0-9bdb-5b9b3675e50e {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:48:49 devstack sudo[112361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c924c814-a5ac-46c0-9bdb-5b9b3675e50e Jun 23 16:48:49 devstack sudo[112361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:48:50 devstack sudo[112361]: pam_unix(sudo:session): session closed for user root Jun 23 16:48:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-39baab63-5636-477d-b414-1be5561817a8 req-dfac6666-e723-4a2c-8e96-3dce7cce9d81 tempest-TestShelveInstance-1938681116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c924c814-a5ac-46c0-9bdb-5b9b3675e50e" returned: 0 in 0.834s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:48:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-39baab63-5636-477d-b414-1be5561817a8 req-dfac6666-e723-4a2c-8e96-3dce7cce9d81 tempest-TestShelveInstance-1938681116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c924c814-a5ac-46c0-9bdb-5b9b3675e50e {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:48:50 devstack sudo[112365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c924c814-a5ac-46c0-9bdb-5b9b3675e50e Jun 23 16:48:50 devstack sudo[112365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:48:51 devstack sudo[112365]: pam_unix(sudo:session): session closed for user root Jun 23 16:48:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-39baab63-5636-477d-b414-1be5561817a8 req-dfac6666-e723-4a2c-8e96-3dce7cce9d81 tempest-TestShelveInstance-1938681116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c924c814-a5ac-46c0-9bdb-5b9b3675e50e" returned: 1 in 0.827s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:48:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-39baab63-5636-477d-b414-1be5561817a8 req-dfac6666-e723-4a2c-8e96-3dce7cce9d81 tempest-TestShelveInstance-1938681116 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c924c814-a5ac-46c0-9bdb-5b9b3675e50e' failed. Not Retrying. {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:48:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-39baab63-5636-477d-b414-1be5561817a8 req-dfac6666-e723-4a2c-8e96-3dce7cce9d81 tempest-TestShelveInstance-1938681116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.707s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:48:51 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-39baab63-5636-477d-b414-1be5561817a8 req-dfac6666-e723-4a2c-8e96-3dce7cce9d81 tempest-TestShelveInstance-1938681116 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e', 'name': 'volume-c924c814-a5ac-46c0-9bdb-5b9b3675e50e', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '586f92dd-64c0-48ab-b537-02fc5e89223b', 'enforce_multipath': True} {{(pid=93788) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 16:48:51 devstack cinder-volume[93788]: INFO cinder.volume.manager [req-39baab63-5636-477d-b414-1be5561817a8 req-dfac6666-e723-4a2c-8e96-3dce7cce9d81 tempest-TestShelveInstance-1938681116 None] attachment_update completed successfully. Jun 23 16:49:01 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:49:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:49:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:49:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:49:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:49:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:49:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:49:01 devstack sudo[112445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:49:01 devstack sudo[112445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:49:01 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:49:01 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:SELECT=8 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:49:02 devstack sudo[112445]: pam_unix(sudo:session): session closed for user root Jun 23 16:49:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.670s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:49:02 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:49:02 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager._thread_info {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:49:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread count: 28 {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 16:49:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread info: [<_MainThread(MainThread, started 126303828988032)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 16:49:29 devstack cinder-volume[93788]: INFO cinder.volume.manager [req-f174a3c1-e3d0-4a6f-8e54-6f5da4ed74a5 req-af654a3c-6680-4df4-9e06-83ad39e95dc5 tempest-TestShelveInstance-1938681116 None] Terminate volume connection completed successfully. Jun 23 16:49:29 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-f174a3c1-e3d0-4a6f-8e54-6f5da4ed74a5 req-af654a3c-6680-4df4-9e06-83ad39e95dc5 tempest-TestShelveInstance-1938681116 None] Deleting attachment 586f92dd-64c0-48ab-b537-02fc5e89223b. {{(pid=93788) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 16:49:29 devstack cinder-volume[93788]: DEBUG cinder.coordination [req-f174a3c1-e3d0-4a6f-8e54-6f5da4ed74a5 req-139b8906-f541-4a2b-adb2-9c40a5467cef tempest-TestShelveInstance-1938681116 None] Acquiring lock "cinder-c924c814-a5ac-46c0-9bdb-5b9b3675e50e-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:49:29 devstack cinder-volume[93788]: DEBUG cinder.coordination [req-f174a3c1-e3d0-4a6f-8e54-6f5da4ed74a5 req-139b8906-f541-4a2b-adb2-9c40a5467cef tempest-TestShelveInstance-1938681116 None] Lock "cinder-c924c814-a5ac-46c0-9bdb-5b9b3675e50e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:49:29 devstack cinder-volume[93788]: DEBUG cinder.coordination [req-f174a3c1-e3d0-4a6f-8e54-6f5da4ed74a5 req-139b8906-f541-4a2b-adb2-9c40a5467cef tempest-TestShelveInstance-1938681116 None] Acquiring lock "cinder-quobyte-c924c814-a5ac-46c0-9bdb-5b9b3675e50e" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:49:29 devstack cinder-volume[93788]: DEBUG cinder.coordination [req-f174a3c1-e3d0-4a6f-8e54-6f5da4ed74a5 req-139b8906-f541-4a2b-adb2-9c40a5467cef tempest-TestShelveInstance-1938681116 None] Lock "cinder-quobyte-c924c814-a5ac-46c0-9bdb-5b9b3675e50e" acquired by "delete_volume" :: waited 0.020s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:49:30 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c12b01-7560-4870-a276-913917a8f52c]: (4, 'raw') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:49:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-f174a3c1-e3d0-4a6f-8e54-6f5da4ed74a5 req-139b8906-f541-4a2b-adb2-9c40a5467cef tempest-TestShelveInstance-1938681116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c924c814-a5ac-46c0-9bdb-5b9b3675e50e {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:49:30 devstack sudo[112930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c924c814-a5ac-46c0-9bdb-5b9b3675e50e Jun 23 16:49:30 devstack sudo[112930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:49:30 devstack sudo[112930]: pam_unix(sudo:session): session closed for user root Jun 23 16:49:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-f174a3c1-e3d0-4a6f-8e54-6f5da4ed74a5 req-139b8906-f541-4a2b-adb2-9c40a5467cef tempest-TestShelveInstance-1938681116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c924c814-a5ac-46c0-9bdb-5b9b3675e50e" returned: 0 in 0.773s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:49:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-f174a3c1-e3d0-4a6f-8e54-6f5da4ed74a5 req-139b8906-f541-4a2b-adb2-9c40a5467cef tempest-TestShelveInstance-1938681116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c924c814-a5ac-46c0-9bdb-5b9b3675e50e {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:49:30 devstack sudo[112934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c924c814-a5ac-46c0-9bdb-5b9b3675e50e Jun 23 16:49:30 devstack sudo[112934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:49:31 devstack sudo[112934]: pam_unix(sudo:session): session closed for user root Jun 23 16:49:31 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-f174a3c1-e3d0-4a6f-8e54-6f5da4ed74a5 req-139b8906-f541-4a2b-adb2-9c40a5467cef tempest-TestShelveInstance-1938681116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c924c814-a5ac-46c0-9bdb-5b9b3675e50e" returned: 1 in 0.775s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:49:31 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-f174a3c1-e3d0-4a6f-8e54-6f5da4ed74a5 req-139b8906-f541-4a2b-adb2-9c40a5467cef tempest-TestShelveInstance-1938681116 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c924c814-a5ac-46c0-9bdb-5b9b3675e50e' failed. Not Retrying. {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:49:31 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-f174a3c1-e3d0-4a6f-8e54-6f5da4ed74a5 req-139b8906-f541-4a2b-adb2-9c40a5467cef tempest-TestShelveInstance-1938681116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c924c814-a5ac-46c0-9bdb-5b9b3675e50e {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:49:31 devstack sudo[112939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c924c814-a5ac-46c0-9bdb-5b9b3675e50e Jun 23 16:49:31 devstack sudo[112939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:49:32 devstack sudo[112939]: pam_unix(sudo:session): session closed for user root Jun 23 16:49:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-f174a3c1-e3d0-4a6f-8e54-6f5da4ed74a5 req-139b8906-f541-4a2b-adb2-9c40a5467cef tempest-TestShelveInstance-1938681116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c924c814-a5ac-46c0-9bdb-5b9b3675e50e" returned: 0 in 0.650s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:49:32 devstack cinder-volume[93788]: DEBUG cinder.coordination [req-f174a3c1-e3d0-4a6f-8e54-6f5da4ed74a5 req-139b8906-f541-4a2b-adb2-9c40a5467cef tempest-TestShelveInstance-1938681116 None] Lock "cinder-quobyte-c924c814-a5ac-46c0-9bdb-5b9b3675e50e" released by "delete_volume" :: held 2.261s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:49:32 devstack cinder-volume[93788]: DEBUG cinder.quota [req-f174a3c1-e3d0-4a6f-8e54-6f5da4ed74a5 req-139b8906-f541-4a2b-adb2-9c40a5467cef tempest-TestShelveInstance-1938681116 None] Created reservations ['c949153e-96d2-4af3-bf86-40ecc6bba13b', '99201a23-789d-4c7e-8225-c414870b8274', '82400a50-59b6-43c0-a2e3-109d0bfd3f2c', '81de7dae-55bf-4187-918a-c866f29cdbd8'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:49:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-f174a3c1-e3d0-4a6f-8e54-6f5da4ed74a5 req-139b8906-f541-4a2b-adb2-9c40a5467cef tempest-TestShelveInstance-1938681116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:49:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-f174a3c1-e3d0-4a6f-8e54-6f5da4ed74a5 req-139b8906-f541-4a2b-adb2-9c40a5467cef tempest-TestShelveInstance-1938681116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:49:32 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [req-f174a3c1-e3d0-4a6f-8e54-6f5da4ed74a5 req-139b8906-f541-4a2b-adb2-9c40a5467cef tempest-TestShelveInstance-1938681116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:49:32 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [req-f174a3c1-e3d0-4a6f-8e54-6f5da4ed74a5 req-139b8906-f541-4a2b-adb2-9c40a5467cef tempest-TestShelveInstance-1938681116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:49:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-f174a3c1-e3d0-4a6f-8e54-6f5da4ed74a5 req-139b8906-f541-4a2b-adb2-9c40a5467cef tempest-TestShelveInstance-1938681116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:49:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-f174a3c1-e3d0-4a6f-8e54-6f5da4ed74a5 req-139b8906-f541-4a2b-adb2-9c40a5467cef tempest-TestShelveInstance-1938681116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:49:32 devstack sudo[112942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:49:32 devstack sudo[112942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:49:33 devstack sudo[112942]: pam_unix(sudo:session): session closed for user root Jun 23 16:49:33 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-f174a3c1-e3d0-4a6f-8e54-6f5da4ed74a5 req-139b8906-f541-4a2b-adb2-9c40a5467cef tempest-TestShelveInstance-1938681116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.698s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:49:33 devstack cinder-volume[93788]: DEBUG cinder.manager [req-f174a3c1-e3d0-4a6f-8e54-6f5da4ed74a5 req-139b8906-f541-4a2b-adb2-9c40a5467cef tempest-TestShelveInstance-1938681116 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:49:33 devstack cinder-volume[93788]: INFO cinder.volume.manager [req-f174a3c1-e3d0-4a6f-8e54-6f5da4ed74a5 req-139b8906-f541-4a2b-adb2-9c40a5467cef tempest-TestShelveInstance-1938681116 None] Deleted volume successfully. Jun 23 16:49:33 devstack cinder-volume[93788]: DEBUG cinder.coordination [req-f174a3c1-e3d0-4a6f-8e54-6f5da4ed74a5 req-139b8906-f541-4a2b-adb2-9c40a5467cef tempest-TestShelveInstance-1938681116 None] Lock "cinder-c924c814-a5ac-46c0-9bdb-5b9b3675e50e-delete_volume" released by "delete_volume" :: held 3.158s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:49:42 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:SELECT=7,cinder:UPDATE=8,cinder:INSERT=2 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:49:43 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:50:01 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:50:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:50:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:50:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:50:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:50:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:50:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:50:01 devstack sudo[113001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:50:01 devstack sudo[113001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:50:02 devstack sudo[113001]: pam_unix(sudo:session): session closed for user root Jun 23 16:50:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.662s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:50:02 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:50:02 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager._thread_info {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:50:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread count: 28 {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 16:50:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread info: [<_MainThread(MainThread, started 126303828988032)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 16:50:02 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-f119e1b2-5c9e-440a-923c-d5f934034712 tempest-TestStampPattern-1931026436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:50:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f119e1b2-5c9e-440a-923c-d5f934034712 tempest-TestStampPattern-1931026436 None] Flow 'volume_create_manager' (8250d69f-0a11-4d52-900d-09465f7babb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:50:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f119e1b2-5c9e-440a-923c-d5f934034712 tempest-TestStampPattern-1931026436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f6dc83c-c67e-4372-9359-08c5e968c6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:50:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f119e1b2-5c9e-440a-923c-d5f934034712 tempest-TestStampPattern-1931026436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f6dc83c-c67e-4372-9359-08c5e968c6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:50:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1480622028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28baf5e0-9750-4602-a973-54bb3f78a487,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e18cbc8735f044079cd07c79ead01e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:50:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:50:03Z,use_quota=True,user_id='da393a18594d4602a61d30a37441bff0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:50:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f119e1b2-5c9e-440a-923c-d5f934034712 tempest-TestStampPattern-1931026436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1ea6e2c-0a9b-49dc-839a-74f95e4e81bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:50:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f119e1b2-5c9e-440a-923c-d5f934034712 tempest-TestStampPattern-1931026436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1ea6e2c-0a9b-49dc-839a-74f95e4e81bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:50:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f119e1b2-5c9e-440a-923c-d5f934034712 tempest-TestStampPattern-1931026436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (183f8b20-3010-443d-a982-a805fefd8ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:50:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f119e1b2-5c9e-440a-923c-d5f934034712 tempest-TestStampPattern-1931026436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (183f8b20-3010-443d-a982-a805fefd8ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28baf5e0-9750-4602-a973-54bb3f78a487', 'volume_name': 'volume-28baf5e0-9750-4602-a973-54bb3f78a487', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:50:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f119e1b2-5c9e-440a-923c-d5f934034712 tempest-TestStampPattern-1931026436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dbc7934-a713-4d99-b5ff-4cf4fa7cc405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:50:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f119e1b2-5c9e-440a-923c-d5f934034712 tempest-TestStampPattern-1931026436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dbc7934-a713-4d99-b5ff-4cf4fa7cc405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:50:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f119e1b2-5c9e-440a-923c-d5f934034712 tempest-TestStampPattern-1931026436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0489ccb8-faa0-4f8a-92df-4f9f8dad129f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:50:03 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-f119e1b2-5c9e-440a-923c-d5f934034712 tempest-TestStampPattern-1931026436 None] Volume 28baf5e0-9750-4602-a973-54bb3f78a487: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28baf5e0-9750-4602-a973-54bb3f78a487', 'volume_size': 1} Jun 23 16:50:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f119e1b2-5c9e-440a-923c-d5f934034712 tempest-TestStampPattern-1931026436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:50:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f119e1b2-5c9e-440a-923c-d5f934034712 tempest-TestStampPattern-1931026436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:50:03 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-f119e1b2-5c9e-440a-923c-d5f934034712 tempest-TestStampPattern-1931026436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:50:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1480622028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28baf5e0-9750-4602-a973-54bb3f78a487,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e18cbc8735f044079cd07c79ead01e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:50:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:50:03Z,use_quota=True,user_id='da393a18594d4602a61d30a37441bff0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:50:03 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-f119e1b2-5c9e-440a-923c-d5f934034712 tempest-TestStampPattern-1931026436 None] Creating volume 28baf5e0-9750-4602-a973-54bb3f78a487 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:50:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f119e1b2-5c9e-440a-923c-d5f934034712 tempest-TestStampPattern-1931026436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:50:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f119e1b2-5c9e-440a-923c-d5f934034712 tempest-TestStampPattern-1931026436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:50:03 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-f119e1b2-5c9e-440a-923c-d5f934034712 tempest-TestStampPattern-1931026436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:50:03 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-f119e1b2-5c9e-440a-923c-d5f934034712 tempest-TestStampPattern-1931026436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:50:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f119e1b2-5c9e-440a-923c-d5f934034712 tempest-TestStampPattern-1931026436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:50:03 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-f119e1b2-5c9e-440a-923c-d5f934034712 tempest-TestStampPattern-1931026436 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:50:03 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-f119e1b2-5c9e-440a-923c-d5f934034712 tempest-TestStampPattern-1931026436 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:50:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f119e1b2-5c9e-440a-923c-d5f934034712 tempest-TestStampPattern-1931026436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:50:03 devstack sudo[113004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487 1073741824 Jun 23 16:50:03 devstack sudo[113004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:50:03 devstack sudo[113004]: pam_unix(sudo:session): session closed for user root Jun 23 16:50:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f119e1b2-5c9e-440a-923c-d5f934034712 tempest-TestStampPattern-1931026436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487 1073741824" returned: 0 in 0.888s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:50:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f119e1b2-5c9e-440a-923c-d5f934034712 tempest-TestStampPattern-1931026436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:50:04 devstack sudo[113013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487 Jun 23 16:50:04 devstack sudo[113013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:50:04 devstack sudo[113013]: pam_unix(sudo:session): session closed for user root Jun 23 16:50:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f119e1b2-5c9e-440a-923c-d5f934034712 tempest-TestStampPattern-1931026436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487" returned: 0 in 0.639s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:50:04 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-f119e1b2-5c9e-440a-923c-d5f934034712 tempest-TestStampPattern-1931026436 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:50:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f119e1b2-5c9e-440a-923c-d5f934034712 tempest-TestStampPattern-1931026436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.575s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:50:04 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f119e1b2-5c9e-440a-923c-d5f934034712 tempest-TestStampPattern-1931026436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0489ccb8-faa0-4f8a-92df-4f9f8dad129f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28baf5e0-9750-4602-a973-54bb3f78a487', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:50:04 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f119e1b2-5c9e-440a-923c-d5f934034712 tempest-TestStampPattern-1931026436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e59a7c6f-d4ad-4a98-96d7-b9495c15007d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:50:04 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-f119e1b2-5c9e-440a-923c-d5f934034712 tempest-TestStampPattern-1931026436 None] Volume volume-28baf5e0-9750-4602-a973-54bb3f78a487 (28baf5e0-9750-4602-a973-54bb3f78a487): created successfully Jun 23 16:50:04 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f119e1b2-5c9e-440a-923c-d5f934034712 tempest-TestStampPattern-1931026436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e59a7c6f-d4ad-4a98-96d7-b9495c15007d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:50:04 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f119e1b2-5c9e-440a-923c-d5f934034712 tempest-TestStampPattern-1931026436 None] Flow 'volume_create_manager' (8250d69f-0a11-4d52-900d-09465f7babb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:50:04 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-f119e1b2-5c9e-440a-923c-d5f934034712 tempest-TestStampPattern-1931026436 None] Created volume successfully. Jun 23 16:50:14 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:50:14 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:INSERT=1,cinder:DELETE=1 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:50:36 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:SELECT=1 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:50:36 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:UPDATE=1 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:50:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-d42a4563-81a3-4cfa-ab84-83f9c6bd3006 req-f6d758f0-8bb6-43da-af0b-8a62a812dea8 tempest-TestStampPattern-1931026436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:50:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-d42a4563-81a3-4cfa-ab84-83f9c6bd3006 req-f6d758f0-8bb6-43da-af0b-8a62a812dea8 tempest-TestStampPattern-1931026436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:50:43 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1731e56b-621e-48da-b646-8dd0765c91b6]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:50:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-d42a4563-81a3-4cfa-ab84-83f9c6bd3006 req-f6d758f0-8bb6-43da-af0b-8a62a812dea8 tempest-TestStampPattern-1931026436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:50:43 devstack sudo[113205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487 Jun 23 16:50:43 devstack sudo[113205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:50:43 devstack sudo[113205]: pam_unix(sudo:session): session closed for user root Jun 23 16:50:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-d42a4563-81a3-4cfa-ab84-83f9c6bd3006 req-f6d758f0-8bb6-43da-af0b-8a62a812dea8 tempest-TestStampPattern-1931026436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487" returned: 0 in 0.755s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:50:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-d42a4563-81a3-4cfa-ab84-83f9c6bd3006 req-f6d758f0-8bb6-43da-af0b-8a62a812dea8 tempest-TestStampPattern-1931026436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.771s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:50:43 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-d42a4563-81a3-4cfa-ab84-83f9c6bd3006 req-f6d758f0-8bb6-43da-af0b-8a62a812dea8 tempest-TestStampPattern-1931026436 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e', 'name': 'volume-28baf5e0-9750-4602-a973-54bb3f78a487', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c5c493d5-f526-4716-8d4b-2f39371055c8', 'enforce_multipath': True} {{(pid=93788) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 16:50:43 devstack cinder-volume[93788]: INFO cinder.volume.manager [req-d42a4563-81a3-4cfa-ab84-83f9c6bd3006 req-f6d758f0-8bb6-43da-af0b-8a62a812dea8 tempest-TestStampPattern-1931026436 None] attachment_update completed successfully. Jun 23 16:50:52 devstack cinder-volume[93788]: INFO cinder.volume.manager [req-0b5dec68-7c52-465a-94db-5d61e3b8a423 req-23782d36-bf12-4083-ae85-71a9578599f4 tempest-TestStampPattern-1931026436 None] Terminate volume connection completed successfully. Jun 23 16:50:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-0b5dec68-7c52-465a-94db-5d61e3b8a423 req-23782d36-bf12-4083-ae85-71a9578599f4 tempest-TestStampPattern-1931026436 None] Deleting attachment c5c493d5-f526-4716-8d4b-2f39371055c8. {{(pid=93788) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 16:50:53 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:SELECT=7 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:50:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a6ba4122-d35f-4c80-92ea-8ed4dee85094 tempest-TestStampPattern-1931026436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:50:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a6ba4122-d35f-4c80-92ea-8ed4dee85094 tempest-TestStampPattern-1931026436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:50:54 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-a6ba4122-d35f-4c80-92ea-8ed4dee85094 tempest-TestStampPattern-1931026436 None] Creating offline snapshot a9dffe2e-6295-4cad-8f39-9fe7e40037d1 of volume 28baf5e0-9750-4602-a973-54bb3f78a487 {{(pid=93788) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:50:54 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[146b14c1-2efc-476c-af49-5c89edef0628]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:50:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a6ba4122-d35f-4c80-92ea-8ed4dee85094 tempest-TestStampPattern-1931026436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:50:54 devstack sudo[113658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487 Jun 23 16:50:54 devstack sudo[113658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:50:54 devstack sudo[113658]: pam_unix(sudo:session): session closed for user root Jun 23 16:50:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a6ba4122-d35f-4c80-92ea-8ed4dee85094 tempest-TestStampPattern-1931026436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487" returned: 0 in 0.728s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:50:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a6ba4122-d35f-4c80-92ea-8ed4dee85094 tempest-TestStampPattern-1931026436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487.a9dffe2e-6295-4cad-8f39-9fe7e40037d1 1G {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:50:54 devstack sudo[113663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487.a9dffe2e-6295-4cad-8f39-9fe7e40037d1 1G Jun 23 16:50:54 devstack sudo[113663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:50:55 devstack sudo[113663]: pam_unix(sudo:session): session closed for user root Jun 23 16:50:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a6ba4122-d35f-4c80-92ea-8ed4dee85094 tempest-TestStampPattern-1931026436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487.a9dffe2e-6295-4cad-8f39-9fe7e40037d1 1G" returned: 0 in 0.776s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:50:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a6ba4122-d35f-4c80-92ea-8ed4dee85094 tempest-TestStampPattern-1931026436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28baf5e0-9750-4602-a973-54bb3f78a487 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487.a9dffe2e-6295-4cad-8f39-9fe7e40037d1 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:50:55 devstack sudo[113669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28baf5e0-9750-4602-a973-54bb3f78a487 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487.a9dffe2e-6295-4cad-8f39-9fe7e40037d1 Jun 23 16:50:55 devstack sudo[113669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:50:56 devstack sudo[113669]: pam_unix(sudo:session): session closed for user root Jun 23 16:50:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a6ba4122-d35f-4c80-92ea-8ed4dee85094 tempest-TestStampPattern-1931026436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28baf5e0-9750-4602-a973-54bb3f78a487 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487.a9dffe2e-6295-4cad-8f39-9fe7e40037d1" returned: 0 in 0.669s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:50:56 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-a6ba4122-d35f-4c80-92ea-8ed4dee85094 tempest-TestStampPattern-1931026436 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487.a9dffe2e-6295-4cad-8f39-9fe7e40037d1 is being set with open permissions: ugo+rw Jun 23 16:50:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a6ba4122-d35f-4c80-92ea-8ed4dee85094 tempest-TestStampPattern-1931026436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487.a9dffe2e-6295-4cad-8f39-9fe7e40037d1 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:50:56 devstack sudo[113674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487.a9dffe2e-6295-4cad-8f39-9fe7e40037d1 Jun 23 16:50:56 devstack sudo[113674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:50:56 devstack sudo[113674]: pam_unix(sudo:session): session closed for user root Jun 23 16:50:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a6ba4122-d35f-4c80-92ea-8ed4dee85094 tempest-TestStampPattern-1931026436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487.a9dffe2e-6295-4cad-8f39-9fe7e40037d1" returned: 0 in 0.632s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:50:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a6ba4122-d35f-4c80-92ea-8ed4dee85094 tempest-TestStampPattern-1931026436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:50:56 devstack sudo[113677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487.info Jun 23 16:50:56 devstack sudo[113677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:50:57 devstack sudo[113677]: pam_unix(sudo:session): session closed for user root Jun 23 16:50:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a6ba4122-d35f-4c80-92ea-8ed4dee85094 tempest-TestStampPattern-1931026436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487.info" returned: 0 in 0.627s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:50:57 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-a6ba4122-d35f-4c80-92ea-8ed4dee85094 tempest-TestStampPattern-1931026436 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487.info is being set with open permissions: ugo+rw Jun 23 16:50:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a6ba4122-d35f-4c80-92ea-8ed4dee85094 tempest-TestStampPattern-1931026436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:50:57 devstack sudo[113680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487.info Jun 23 16:50:57 devstack sudo[113680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:50:58 devstack sudo[113680]: pam_unix(sudo:session): session closed for user root Jun 23 16:50:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a6ba4122-d35f-4c80-92ea-8ed4dee85094 tempest-TestStampPattern-1931026436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487.info" returned: 0 in 0.670s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:50:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a6ba4122-d35f-4c80-92ea-8ed4dee85094 tempest-TestStampPattern-1931026436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.184s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:50:58 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-a6ba4122-d35f-4c80-92ea-8ed4dee85094 tempest-TestStampPattern-1931026436 None] Create snapshot completed successfully Jun 23 16:51:01 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:51:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:51:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:51:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:51:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:51:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:51:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:51:01 devstack sudo[113684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:51:01 devstack sudo[113684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:51:02 devstack sudo[113684]: pam_unix(sudo:session): session closed for user root Jun 23 16:51:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.641s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:51:02 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:51:02 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager._thread_info {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:51:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread count: 28 {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 16:51:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread info: [<_MainThread(MainThread, started 126303828988032)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 16:51:08 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:SELECT=9,cinder:UPDATE=4 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:51:08 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:51:09 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:51:09 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] Flow 'volume_create_manager' (c1887983-fda5-4813-88cb-dd91005c660e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:51:09 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (284b5f63-42ec-4447-97cc-e83a93e2907c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:51:09 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (284b5f63-42ec-4447-97cc-e83a93e2907c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1466190375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18283114-5d2c-431c-9346-96e30a197110,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e18cbc8735f044079cd07c79ead01e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a9dffe2e-6295-4cad-8f39-9fe7e40037d1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:51:09Z,use_quota=True,user_id='da393a18594d4602a61d30a37441bff0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:51:09 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bef6b2c-1a61-4669-95eb-2d95d04a4098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:51:09 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bef6b2c-1a61-4669-95eb-2d95d04a4098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:51:09 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8992925c-c0d3-4ccc-b8b1-29b1764b95ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:51:09 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8992925c-c0d3-4ccc-b8b1-29b1764b95ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '18283114-5d2c-431c-9346-96e30a197110', 'volume_name': 'volume-18283114-5d2c-431c-9346-96e30a197110', 'volume_size': 1, 'snapshot_id': 'a9dffe2e-6295-4cad-8f39-9fe7e40037d1'}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:51:09 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f783e31-0009-45bb-a72a-d12d84cc55db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:51:09 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f783e31-0009-45bb-a72a-d12d84cc55db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:51:09 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9034a87b-bdec-40d7-a9bc-5f337b588f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:51:09 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] Volume 18283114-5d2c-431c-9346-96e30a197110: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-18283114-5d2c-431c-9346-96e30a197110', 'volume_size': 1, 'snapshot_id': 'a9dffe2e-6295-4cad-8f39-9fe7e40037d1'} Jun 23 16:51:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:51:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:51:09 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] Acquiring lock "cinder-quobyte-a9dffe2e-6295-4cad-8f39-9fe7e40037d1-18283114-5d2c-431c-9346-96e30a197110" by "_create_volume_from_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:51:09 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] Lock "cinder-quobyte-a9dffe2e-6295-4cad-8f39-9fe7e40037d1-18283114-5d2c-431c-9346-96e30a197110" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:51:09 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] Creating volume 18283114-5d2c-431c-9346-96e30a197110 from snapshot a9dffe2e-6295-4cad-8f39-9fe7e40037d1 {{(pid=93788) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 16:51:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:51:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:51:09 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:51:09 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:51:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:51:09 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:51:09 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] Acquiring lock "cinder-quobyte-18283114-5d2c-431c-9346-96e30a197110" by "_copy_volume_from_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:51:09 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] Lock "cinder-quobyte-18283114-5d2c-431c-9346-96e30a197110" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:51:09 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] snapshot: a9dffe2e-6295-4cad-8f39-9fe7e40037d1, volume: 18283114-5d2c-431c-9346-96e30a197110, {{(pid=93788) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 16:51:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:51:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:51:09 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:51:09 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:51:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:51:09 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc16a468-5b25-4fb4-a065-91601193f3cb]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:51:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487.a9dffe2e-6295-4cad-8f39-9fe7e40037d1 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:51:09 devstack sudo[113726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487.a9dffe2e-6295-4cad-8f39-9fe7e40037d1 Jun 23 16:51:09 devstack sudo[113726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:51:10 devstack sudo[113726]: pam_unix(sudo:session): session closed for user root Jun 23 16:51:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487.a9dffe2e-6295-4cad-8f39-9fe7e40037d1" returned: 0 in 0.775s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:51:10 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28baf5e0-9750-4602-a973-54bb3f78a487(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:51:10 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487 {{(pid=93788) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 16:51:10 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] Creating direct copy from snapshot {{(pid=93788) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 16:51:10 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9cfac6-50f9-4488-b1c3-9851880da80d]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:51:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:51:10 devstack sudo[113734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487 Jun 23 16:51:10 devstack sudo[113734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:51:10 devstack sudo[113734]: pam_unix(sudo:session): session closed for user root Jun 23 16:51:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487" returned: 0 in 0.766s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:51:10 devstack cinder-volume[93788]: DEBUG cinder.utils [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] Path /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-18283114-5d2c-431c-9346-96e30a197110 not found in is_blk_device check {{(pid=93788) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 16:51:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-18283114-5d2c-431c-9346-96e30a197110 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:51:10 devstack sudo[113739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-18283114-5d2c-431c-9346-96e30a197110 Jun 23 16:51:10 devstack sudo[113739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:51:15 devstack sudo[113739]: pam_unix(sudo:session): session closed for user root Jun 23 16:51:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-18283114-5d2c-431c-9346-96e30a197110" returned: 0 in 5.024s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:51:15 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[90fa0fb8-9f7a-4263-8d42-50d53827069b]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:51:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:51:15 devstack sudo[113756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487 Jun 23 16:51:15 devstack sudo[113756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:51:16 devstack sudo[113756]: pam_unix(sudo:session): session closed for user root Jun 23 16:51:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487" returned: 0 in 1.129s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:51:16 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] Image conversion details: src /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487, size 1024.00 MB, duration 5.02 sec, destination /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-18283114-5d2c-431c-9346-96e30a197110 {{(pid=93788) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 16:51:16 devstack cinder-volume[93788]: INFO cinder.image.image_utils [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] Converted 1024.00 MB image at 203.79 MB/s Jun 23 16:51:16 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-18283114-5d2c-431c-9346-96e30a197110 is being set with open permissions: ugo+rw Jun 23 16:51:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-18283114-5d2c-431c-9346-96e30a197110 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:51:17 devstack sudo[113761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-18283114-5d2c-431c-9346-96e30a197110 Jun 23 16:51:17 devstack sudo[113761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:51:17 devstack sudo[113761]: pam_unix(sudo:session): session closed for user root Jun 23 16:51:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-18283114-5d2c-431c-9346-96e30a197110" returned: 0 in 0.806s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:51:17 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] Lock "cinder-quobyte-18283114-5d2c-431c-9346-96e30a197110" released by "_copy_volume_from_snapshot" :: held 8.601s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:51:17 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] Lock "cinder-quobyte-a9dffe2e-6295-4cad-8f39-9fe7e40037d1-18283114-5d2c-431c-9346-96e30a197110" released by "_create_volume_from_snapshot" :: held 8.633s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:51:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.647s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:51:17 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9034a87b-bdec-40d7-a9bc-5f337b588f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18283114-5d2c-431c-9346-96e30a197110', 'volume_size': 1, 'snapshot_id': 'a9dffe2e-6295-4cad-8f39-9fe7e40037d1'}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:51:17 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a44cd2c1-e4fc-443c-8a50-52705119aaac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:51:17 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] Volume volume-18283114-5d2c-431c-9346-96e30a197110 (18283114-5d2c-431c-9346-96e30a197110): created successfully Jun 23 16:51:17 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a44cd2c1-e4fc-443c-8a50-52705119aaac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:51:17 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] Flow 'volume_create_manager' (c1887983-fda5-4813-88cb-dd91005c660e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:51:17 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-89f2bc3d-6fd2-4f0f-ad67-fa16f2cf1539 tempest-TestStampPattern-1931026436 None] Created volume successfully. Jun 23 16:51:27 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:51:27 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:DELETE=1 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:52:01 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:52:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:52:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:52:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:52:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:52:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:52:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:52:01 devstack sudo[113924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:52:01 devstack sudo[113924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:52:02 devstack sudo[113924]: pam_unix(sudo:session): session closed for user root Jun 23 16:52:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.629s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:52:02 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:52:02 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager._thread_info {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:52:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread count: 28 {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 16:52:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread info: [<_MainThread(MainThread, started 126303828988032)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 16:52:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-d776451b-7c21-4efe-9c98-7da0b4215431 req-e10e445d-98d6-4708-9ef7-994d57ec5f25 tempest-TestStampPattern-1931026436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:52:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-d776451b-7c21-4efe-9c98-7da0b4215431 req-e10e445d-98d6-4708-9ef7-994d57ec5f25 tempest-TestStampPattern-1931026436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:52:06 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a66361-5ccf-4b45-9822-8cf427410abd]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:52:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-d776451b-7c21-4efe-9c98-7da0b4215431 req-e10e445d-98d6-4708-9ef7-994d57ec5f25 tempest-TestStampPattern-1931026436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-18283114-5d2c-431c-9346-96e30a197110 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:52:06 devstack sudo[113942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-18283114-5d2c-431c-9346-96e30a197110 Jun 23 16:52:06 devstack sudo[113942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:52:06 devstack sudo[113942]: pam_unix(sudo:session): session closed for user root Jun 23 16:52:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [req-d776451b-7c21-4efe-9c98-7da0b4215431 req-e10e445d-98d6-4708-9ef7-994d57ec5f25 tempest-TestStampPattern-1931026436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-18283114-5d2c-431c-9346-96e30a197110" returned: 0 in 0.741s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:52:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [req-d776451b-7c21-4efe-9c98-7da0b4215431 req-e10e445d-98d6-4708-9ef7-994d57ec5f25 tempest-TestStampPattern-1931026436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.759s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:52:06 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-d776451b-7c21-4efe-9c98-7da0b4215431 req-e10e445d-98d6-4708-9ef7-994d57ec5f25 tempest-TestStampPattern-1931026436 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e', 'name': 'volume-18283114-5d2c-431c-9346-96e30a197110', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '25ef0272-1ac4-454a-aa41-f21091718ca2', 'enforce_multipath': True} {{(pid=93788) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 16:52:06 devstack cinder-volume[93788]: INFO cinder.volume.manager [req-d776451b-7c21-4efe-9c98-7da0b4215431 req-e10e445d-98d6-4708-9ef7-994d57ec5f25 tempest-TestStampPattern-1931026436 None] attachment_update completed successfully. Jun 23 16:52:13 devstack cinder-volume[93788]: INFO cinder.volume.manager [req-11a94ea6-851a-4823-b4dc-9f99a37fc09d req-3eb07a55-76cb-412a-b5d6-37218f30ab80 tempest-TestStampPattern-1931026436 None] Terminate volume connection completed successfully. Jun 23 16:52:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [req-11a94ea6-851a-4823-b4dc-9f99a37fc09d req-3eb07a55-76cb-412a-b5d6-37218f30ab80 tempest-TestStampPattern-1931026436 None] Deleting attachment 25ef0272-1ac4-454a-aa41-f21091718ca2. {{(pid=93788) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 16:52:16 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:52:22 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-8cb3286c-2033-4532-b8f5-060d38537395 tempest-TestStampPattern-1931026436 None] Acquiring lock "cinder-18283114-5d2c-431c-9346-96e30a197110-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:52:22 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-8cb3286c-2033-4532-b8f5-060d38537395 tempest-TestStampPattern-1931026436 None] Lock "cinder-18283114-5d2c-431c-9346-96e30a197110-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:52:22 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-8cb3286c-2033-4532-b8f5-060d38537395 tempest-TestStampPattern-1931026436 None] Acquiring lock "cinder-quobyte-18283114-5d2c-431c-9346-96e30a197110" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:52:22 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-8cb3286c-2033-4532-b8f5-060d38537395 tempest-TestStampPattern-1931026436 None] Lock "cinder-quobyte-18283114-5d2c-431c-9346-96e30a197110" acquired by "delete_volume" :: waited 0.013s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:52:22 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f7d0ea-9ecc-4bed-9941-617cd967501f]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:52:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8cb3286c-2033-4532-b8f5-060d38537395 tempest-TestStampPattern-1931026436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-18283114-5d2c-431c-9346-96e30a197110 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:52:23 devstack sudo[114452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-18283114-5d2c-431c-9346-96e30a197110 Jun 23 16:52:23 devstack sudo[114452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:52:23 devstack sudo[114452]: pam_unix(sudo:session): session closed for user root Jun 23 16:52:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8cb3286c-2033-4532-b8f5-060d38537395 tempest-TestStampPattern-1931026436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-18283114-5d2c-431c-9346-96e30a197110" returned: 0 in 0.747s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:52:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8cb3286c-2033-4532-b8f5-060d38537395 tempest-TestStampPattern-1931026436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-18283114-5d2c-431c-9346-96e30a197110 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:52:23 devstack sudo[114457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-18283114-5d2c-431c-9346-96e30a197110 Jun 23 16:52:23 devstack sudo[114457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:52:24 devstack sudo[114457]: pam_unix(sudo:session): session closed for user root Jun 23 16:52:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8cb3286c-2033-4532-b8f5-060d38537395 tempest-TestStampPattern-1931026436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-18283114-5d2c-431c-9346-96e30a197110" returned: 0 in 0.609s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:52:24 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-8cb3286c-2033-4532-b8f5-060d38537395 tempest-TestStampPattern-1931026436 None] Lock "cinder-quobyte-18283114-5d2c-431c-9346-96e30a197110" released by "delete_volume" :: held 1.396s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:52:24 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-8cb3286c-2033-4532-b8f5-060d38537395 tempest-TestStampPattern-1931026436 None] Created reservations ['1b1c6b3d-03d7-4bdd-a2dd-e6b171940416', '322fa25c-0474-44b2-ade1-b2035b0b9799', '94e51913-a419-41d2-b123-78624c5d7956', '4a2b056f-2f51-47eb-81e9-0c2ef66db2a4'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:52:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8cb3286c-2033-4532-b8f5-060d38537395 tempest-TestStampPattern-1931026436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:52:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8cb3286c-2033-4532-b8f5-060d38537395 tempest-TestStampPattern-1931026436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:52:24 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-8cb3286c-2033-4532-b8f5-060d38537395 tempest-TestStampPattern-1931026436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:52:24 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-8cb3286c-2033-4532-b8f5-060d38537395 tempest-TestStampPattern-1931026436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:52:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8cb3286c-2033-4532-b8f5-060d38537395 tempest-TestStampPattern-1931026436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:52:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8cb3286c-2033-4532-b8f5-060d38537395 tempest-TestStampPattern-1931026436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:52:24 devstack sudo[114460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:52:24 devstack sudo[114460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:52:25 devstack sudo[114460]: pam_unix(sudo:session): session closed for user root Jun 23 16:52:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8cb3286c-2033-4532-b8f5-060d38537395 tempest-TestStampPattern-1931026436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.644s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:52:25 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-8cb3286c-2033-4532-b8f5-060d38537395 tempest-TestStampPattern-1931026436 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:52:25 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-8cb3286c-2033-4532-b8f5-060d38537395 tempest-TestStampPattern-1931026436 None] Deleted volume successfully. Jun 23 16:52:25 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-8cb3286c-2033-4532-b8f5-060d38537395 tempest-TestStampPattern-1931026436 None] Lock "cinder-18283114-5d2c-431c-9346-96e30a197110-delete_volume" released by "delete_volume" :: held 2.219s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:52:25 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-84e39d0c-633d-49bc-89a3-ef09e19f73df tempest-TestStampPattern-1931026436 None] Acquiring lock "cinder-a9dffe2e-6295-4cad-8f39-9fe7e40037d1-delete_snapshot" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:52:25 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-84e39d0c-633d-49bc-89a3-ef09e19f73df tempest-TestStampPattern-1931026436 None] Lock "cinder-a9dffe2e-6295-4cad-8f39-9fe7e40037d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:52:25 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-84e39d0c-633d-49bc-89a3-ef09e19f73df tempest-TestStampPattern-1931026436 None] Acquiring lock "cinder-quobyte-28baf5e0-9750-4602-a973-54bb3f78a487" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:52:25 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-84e39d0c-633d-49bc-89a3-ef09e19f73df tempest-TestStampPattern-1931026436 None] Lock "cinder-quobyte-28baf5e0-9750-4602-a973-54bb3f78a487" acquired by "delete_snapshot" :: waited 0.014s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:52:25 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-84e39d0c-633d-49bc-89a3-ef09e19f73df tempest-TestStampPattern-1931026436 None] Acquiring lock "cinder-quobyte-a9dffe2e-6295-4cad-8f39-9fe7e40037d1" by "_delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:52:25 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-84e39d0c-633d-49bc-89a3-ef09e19f73df tempest-TestStampPattern-1931026436 None] Lock "cinder-quobyte-a9dffe2e-6295-4cad-8f39-9fe7e40037d1" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:52:25 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-84e39d0c-633d-49bc-89a3-ef09e19f73df tempest-TestStampPattern-1931026436 None] Deleting offline snapshot a9dffe2e-6295-4cad-8f39-9fe7e40037d1 of volume 28baf5e0-9750-4602-a973-54bb3f78a487 {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:52:25 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-84e39d0c-633d-49bc-89a3-ef09e19f73df tempest-TestStampPattern-1931026436 None] snapshot_file for this snap is: volume-28baf5e0-9750-4602-a973-54bb3f78a487.a9dffe2e-6295-4cad-8f39-9fe7e40037d1 {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:52:25 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[774fdd98-8570-419f-918c-8e9c3215e0ab]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:52:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-84e39d0c-633d-49bc-89a3-ef09e19f73df tempest-TestStampPattern-1931026436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487.a9dffe2e-6295-4cad-8f39-9fe7e40037d1 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:52:25 devstack sudo[114463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487.a9dffe2e-6295-4cad-8f39-9fe7e40037d1 Jun 23 16:52:25 devstack sudo[114463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:52:26 devstack sudo[114463]: pam_unix(sudo:session): session closed for user root Jun 23 16:52:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-84e39d0c-633d-49bc-89a3-ef09e19f73df tempest-TestStampPattern-1931026436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487.a9dffe2e-6295-4cad-8f39-9fe7e40037d1" returned: 0 in 0.743s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:52:26 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-84e39d0c-633d-49bc-89a3-ef09e19f73df tempest-TestStampPattern-1931026436 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28baf5e0-9750-4602-a973-54bb3f78a487(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:52:26 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f73dc4d-37fc-4171-bdec-5bdef67a50ef]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:52:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-84e39d0c-633d-49bc-89a3-ef09e19f73df tempest-TestStampPattern-1931026436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:52:26 devstack sudo[114468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487 Jun 23 16:52:26 devstack sudo[114468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:52:26 devstack sudo[114468]: pam_unix(sudo:session): session closed for user root Jun 23 16:52:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-84e39d0c-633d-49bc-89a3-ef09e19f73df tempest-TestStampPattern-1931026436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487" returned: 0 in 0.724s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:52:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-84e39d0c-633d-49bc-89a3-ef09e19f73df tempest-TestStampPattern-1931026436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487.a9dffe2e-6295-4cad-8f39-9fe7e40037d1 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:52:26 devstack sudo[114473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487.a9dffe2e-6295-4cad-8f39-9fe7e40037d1 Jun 23 16:52:26 devstack sudo[114473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:52:27 devstack sudo[114473]: pam_unix(sudo:session): session closed for user root Jun 23 16:52:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-84e39d0c-633d-49bc-89a3-ef09e19f73df tempest-TestStampPattern-1931026436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487.a9dffe2e-6295-4cad-8f39-9fe7e40037d1" returned: 0 in 0.702s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:52:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-84e39d0c-633d-49bc-89a3-ef09e19f73df tempest-TestStampPattern-1931026436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487.a9dffe2e-6295-4cad-8f39-9fe7e40037d1 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:52:27 devstack sudo[114478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487.a9dffe2e-6295-4cad-8f39-9fe7e40037d1 Jun 23 16:52:27 devstack sudo[114478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:52:28 devstack sudo[114478]: pam_unix(sudo:session): session closed for user root Jun 23 16:52:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-84e39d0c-633d-49bc-89a3-ef09e19f73df tempest-TestStampPattern-1931026436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487.a9dffe2e-6295-4cad-8f39-9fe7e40037d1" returned: 0 in 0.603s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:52:28 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-84e39d0c-633d-49bc-89a3-ef09e19f73df tempest-TestStampPattern-1931026436 None] Lock "cinder-quobyte-a9dffe2e-6295-4cad-8f39-9fe7e40037d1" released by "_delete_snapshot" :: held 2.873s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:52:28 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-84e39d0c-633d-49bc-89a3-ef09e19f73df tempest-TestStampPattern-1931026436 None] Lock "cinder-quobyte-28baf5e0-9750-4602-a973-54bb3f78a487" released by "delete_snapshot" :: held 2.896s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:52:28 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-84e39d0c-633d-49bc-89a3-ef09e19f73df tempest-TestStampPattern-1931026436 None] Created reservations ['a95e684b-7b14-4f70-9eb9-b1b5e01c78b2', '18c1baef-1516-476b-ad26-2913bf34a02a', '783abb7a-b49f-4603-a45b-cf5b40054511', '48117a14-ef48-4a56-817a-1cf46ef78649'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:52:28 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-84e39d0c-633d-49bc-89a3-ef09e19f73df tempest-TestStampPattern-1931026436 None] Delete snapshot completed successfully. Jun 23 16:52:28 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-84e39d0c-633d-49bc-89a3-ef09e19f73df tempest-TestStampPattern-1931026436 None] Lock "cinder-a9dffe2e-6295-4cad-8f39-9fe7e40037d1-delete_snapshot" released by "delete_snapshot" :: held 3.018s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:52:35 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-40b2c066-8348-418e-aa50-ecff550acf4e tempest-TestStampPattern-1931026436 None] Acquiring lock "cinder-28baf5e0-9750-4602-a973-54bb3f78a487-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:52:35 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-40b2c066-8348-418e-aa50-ecff550acf4e tempest-TestStampPattern-1931026436 None] Lock "cinder-28baf5e0-9750-4602-a973-54bb3f78a487-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:52:35 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-40b2c066-8348-418e-aa50-ecff550acf4e tempest-TestStampPattern-1931026436 None] Acquiring lock "cinder-quobyte-28baf5e0-9750-4602-a973-54bb3f78a487" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:52:35 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-40b2c066-8348-418e-aa50-ecff550acf4e tempest-TestStampPattern-1931026436 None] Lock "cinder-quobyte-28baf5e0-9750-4602-a973-54bb3f78a487" acquired by "delete_volume" :: waited 0.014s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:52:35 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[7257f1db-801b-4fd0-bdb4-631edf8c5390]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:52:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-40b2c066-8348-418e-aa50-ecff550acf4e tempest-TestStampPattern-1931026436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:52:35 devstack sudo[114529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487 Jun 23 16:52:35 devstack sudo[114529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:52:36 devstack sudo[114529]: pam_unix(sudo:session): session closed for user root Jun 23 16:52:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-40b2c066-8348-418e-aa50-ecff550acf4e tempest-TestStampPattern-1931026436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487" returned: 0 in 0.754s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:52:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-40b2c066-8348-418e-aa50-ecff550acf4e tempest-TestStampPattern-1931026436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:52:36 devstack sudo[114534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487 Jun 23 16:52:36 devstack sudo[114534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:52:37 devstack sudo[114534]: pam_unix(sudo:session): session closed for user root Jun 23 16:52:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-40b2c066-8348-418e-aa50-ecff550acf4e tempest-TestStampPattern-1931026436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-28baf5e0-9750-4602-a973-54bb3f78a487" returned: 0 in 0.636s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:52:37 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-40b2c066-8348-418e-aa50-ecff550acf4e tempest-TestStampPattern-1931026436 None] Lock "cinder-quobyte-28baf5e0-9750-4602-a973-54bb3f78a487" released by "delete_volume" :: held 1.448s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:52:37 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-40b2c066-8348-418e-aa50-ecff550acf4e tempest-TestStampPattern-1931026436 None] Created reservations ['ebe6f963-4217-4a3e-883d-bba2d1ff573a', '44492b86-d7ae-43ec-a096-0deb54035b3c', 'e6bb7fc8-0323-4fcf-a9f3-2d549a4eab53', 'fcd6a5e4-5f54-4c12-8dcf-a589c01d07d7'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:52:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-40b2c066-8348-418e-aa50-ecff550acf4e tempest-TestStampPattern-1931026436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:52:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-40b2c066-8348-418e-aa50-ecff550acf4e tempest-TestStampPattern-1931026436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:52:37 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-40b2c066-8348-418e-aa50-ecff550acf4e tempest-TestStampPattern-1931026436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:52:37 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-40b2c066-8348-418e-aa50-ecff550acf4e tempest-TestStampPattern-1931026436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:52:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-40b2c066-8348-418e-aa50-ecff550acf4e tempest-TestStampPattern-1931026436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:52:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-40b2c066-8348-418e-aa50-ecff550acf4e tempest-TestStampPattern-1931026436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:52:37 devstack sudo[114537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:52:37 devstack sudo[114537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:52:37 devstack sudo[114537]: pam_unix(sudo:session): session closed for user root Jun 23 16:52:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-40b2c066-8348-418e-aa50-ecff550acf4e tempest-TestStampPattern-1931026436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.628s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:52:37 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-40b2c066-8348-418e-aa50-ecff550acf4e tempest-TestStampPattern-1931026436 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:52:37 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-40b2c066-8348-418e-aa50-ecff550acf4e tempest-TestStampPattern-1931026436 None] Deleted volume successfully. Jun 23 16:52:37 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-40b2c066-8348-418e-aa50-ecff550acf4e tempest-TestStampPattern-1931026436 None] Lock "cinder-28baf5e0-9750-4602-a973-54bb3f78a487-delete_volume" released by "delete_volume" :: held 2.262s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:52:47 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:SELECT=15,cinder:UPDATE=21,cinder:INSERT=8,cinder:DELETE=1 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:52:47 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:SELECT=24,cinder:UPDATE=25,cinder:INSERT=4,cinder:DELETE=1 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:52:57 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-cddd5dd4-02b0-4c84-bcb2-a4ff188771e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:52:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-cddd5dd4-02b0-4c84-bcb2-a4ff188771e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Flow 'volume_create_manager' (4c85480c-70da-41e1-b110-3396ea99ee52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:52:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-cddd5dd4-02b0-4c84-bcb2-a4ff188771e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af8a446b-08be-41ca-a40b-7e865c248e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:52:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-cddd5dd4-02b0-4c84-bcb2-a4ff188771e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af8a446b-08be-41ca-a40b-7e865c248e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2095523552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05e95e19-b81b-45ad-b224-af4de09f8bc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b528545668e4fa4ac97eb755ab9aed1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:52:58Z,use_quota=True,user_id='09a59c4979074af98de31da93f522cc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:52:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-cddd5dd4-02b0-4c84-bcb2-a4ff188771e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4eb4d93-0054-40e0-aaf5-3999ccc35a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:52:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-cddd5dd4-02b0-4c84-bcb2-a4ff188771e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4eb4d93-0054-40e0-aaf5-3999ccc35a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:52:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-cddd5dd4-02b0-4c84-bcb2-a4ff188771e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ba2d8f5-0d1c-4494-b489-94e2deba5b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:52:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-cddd5dd4-02b0-4c84-bcb2-a4ff188771e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ba2d8f5-0d1c-4494-b489-94e2deba5b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05e95e19-b81b-45ad-b224-af4de09f8bc8', 'volume_name': 'volume-05e95e19-b81b-45ad-b224-af4de09f8bc8', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:52:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-cddd5dd4-02b0-4c84-bcb2-a4ff188771e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2fecbb0-06ae-44b0-9119-67afda2920d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:52:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-cddd5dd4-02b0-4c84-bcb2-a4ff188771e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2fecbb0-06ae-44b0-9119-67afda2920d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:52:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-cddd5dd4-02b0-4c84-bcb2-a4ff188771e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c8e7a39-47e4-4847-95ad-99a427dd7257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:52:57 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-cddd5dd4-02b0-4c84-bcb2-a4ff188771e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Volume 05e95e19-b81b-45ad-b224-af4de09f8bc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05e95e19-b81b-45ad-b224-af4de09f8bc8', 'volume_size': 1} Jun 23 16:52:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-cddd5dd4-02b0-4c84-bcb2-a4ff188771e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:52:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-cddd5dd4-02b0-4c84-bcb2-a4ff188771e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:52:57 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-cddd5dd4-02b0-4c84-bcb2-a4ff188771e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2095523552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05e95e19-b81b-45ad-b224-af4de09f8bc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b528545668e4fa4ac97eb755ab9aed1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:52:58Z,use_quota=True,user_id='09a59c4979074af98de31da93f522cc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:52:57 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-cddd5dd4-02b0-4c84-bcb2-a4ff188771e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Creating volume 05e95e19-b81b-45ad-b224-af4de09f8bc8 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:52:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-cddd5dd4-02b0-4c84-bcb2-a4ff188771e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:52:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-cddd5dd4-02b0-4c84-bcb2-a4ff188771e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:52:57 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-cddd5dd4-02b0-4c84-bcb2-a4ff188771e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:52:57 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-cddd5dd4-02b0-4c84-bcb2-a4ff188771e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:52:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-cddd5dd4-02b0-4c84-bcb2-a4ff188771e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:52:57 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-cddd5dd4-02b0-4c84-bcb2-a4ff188771e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:52:57 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-cddd5dd4-02b0-4c84-bcb2-a4ff188771e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:52:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-cddd5dd4-02b0-4c84-bcb2-a4ff188771e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-05e95e19-b81b-45ad-b224-af4de09f8bc8 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:52:57 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-b90d927b-0b05-4e47-b45d-da760b737703 tempest-VolumeDependencyTests-488053045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:52:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b90d927b-0b05-4e47-b45d-da760b737703 tempest-VolumeDependencyTests-488053045 None] Flow 'volume_create_manager' (3a343a2e-7f80-46b1-ade2-27362520fff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:52:57 devstack sudo[114629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-05e95e19-b81b-45ad-b224-af4de09f8bc8 1073741824 Jun 23 16:52:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b90d927b-0b05-4e47-b45d-da760b737703 tempest-VolumeDependencyTests-488053045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (599b9dd1-bedf-443d-b394-3338708c586a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:52:57 devstack sudo[114629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:52:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b90d927b-0b05-4e47-b45d-da760b737703 tempest-VolumeDependencyTests-488053045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (599b9dd1-bedf-443d-b394-3338708c586a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-972505714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c19b71c-89d4-42e0-920d-b8cde74a3f0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='398d57d3c9074961b7a0ecc0be051f49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:52:58Z,use_quota=True,user_id='2afafd421cbf4ea198f822ffd8a59486',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:52:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b90d927b-0b05-4e47-b45d-da760b737703 tempest-VolumeDependencyTests-488053045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (033fd837-83a8-4786-a3fe-b96802aae576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:52:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b90d927b-0b05-4e47-b45d-da760b737703 tempest-VolumeDependencyTests-488053045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (033fd837-83a8-4786-a3fe-b96802aae576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:52:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b90d927b-0b05-4e47-b45d-da760b737703 tempest-VolumeDependencyTests-488053045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (983d2357-9c68-4b32-82d6-452875809bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:52:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b90d927b-0b05-4e47-b45d-da760b737703 tempest-VolumeDependencyTests-488053045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (983d2357-9c68-4b32-82d6-452875809bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c19b71c-89d4-42e0-920d-b8cde74a3f0c', 'volume_name': 'volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:52:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b90d927b-0b05-4e47-b45d-da760b737703 tempest-VolumeDependencyTests-488053045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6db0b45-85ff-4630-a061-ec79a99e3c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:52:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b90d927b-0b05-4e47-b45d-da760b737703 tempest-VolumeDependencyTests-488053045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6db0b45-85ff-4630-a061-ec79a99e3c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:52:57 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b90d927b-0b05-4e47-b45d-da760b737703 tempest-VolumeDependencyTests-488053045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a638c07-05ee-47a3-8524-f3e32c293460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:52:57 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-b90d927b-0b05-4e47-b45d-da760b737703 tempest-VolumeDependencyTests-488053045 None] Volume 9c19b71c-89d4-42e0-920d-b8cde74a3f0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c', 'volume_size': 1} Jun 23 16:52:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b90d927b-0b05-4e47-b45d-da760b737703 tempest-VolumeDependencyTests-488053045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:52:58 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfb54a00-044a-4d97-ba88-06751cb419f9 tempest-CreateVolumesFromImageTest-469033091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:52:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-dfb54a00-044a-4d97-ba88-06751cb419f9 tempest-CreateVolumesFromImageTest-469033091 None] Flow 'volume_create_manager' (5e7e582f-5537-4253-865e-ab51df386c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:52:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-dfb54a00-044a-4d97-ba88-06751cb419f9 tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71110299-2a0d-44d8-9ff7-98095b5b3770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:52:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-dfb54a00-044a-4d97-ba88-06751cb419f9 tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71110299-2a0d-44d8-9ff7-98095b5b3770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2054910276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4615d1ba-5988-4ef0-bbac-226abeda49f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='337c3b28322b4d4ab7d2775723768d11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:52:58Z,use_quota=True,user_id='ff35f18a0a784b22a8b093ce66c3c807',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:52:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-dfb54a00-044a-4d97-ba88-06751cb419f9 tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7e82ff2-8ece-4da8-88e0-83b2d78645ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:52:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-dfb54a00-044a-4d97-ba88-06751cb419f9 tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7e82ff2-8ece-4da8-88e0-83b2d78645ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:52:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-dfb54a00-044a-4d97-ba88-06751cb419f9 tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d17a10-b574-4942-be81-37b51d89dfd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:52:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-dfb54a00-044a-4d97-ba88-06751cb419f9 tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d17a10-b574-4942-be81-37b51d89dfd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4615d1ba-5988-4ef0-bbac-226abeda49f3', 'volume_name': 'volume-4615d1ba-5988-4ef0-bbac-226abeda49f3', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:52:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-dfb54a00-044a-4d97-ba88-06751cb419f9 tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39061dc9-293d-4119-831c-35adb1ad8273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:52:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-dfb54a00-044a-4d97-ba88-06751cb419f9 tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39061dc9-293d-4119-831c-35adb1ad8273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:52:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-dfb54a00-044a-4d97-ba88-06751cb419f9 tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a521f158-1080-4b3e-aa27-c612166355d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:52:58 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-dfb54a00-044a-4d97-ba88-06751cb419f9 tempest-CreateVolumesFromImageTest-469033091 None] Volume 4615d1ba-5988-4ef0-bbac-226abeda49f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4615d1ba-5988-4ef0-bbac-226abeda49f3', 'volume_size': 1} Jun 23 16:52:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-dfb54a00-044a-4d97-ba88-06751cb419f9 tempest-CreateVolumesFromImageTest-469033091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:52:58 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-f259cd68-b86a-4e43-82a4-9bd04d075d54 tempest-CreateVolumesFromImageTest-469033091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:52:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f259cd68-b86a-4e43-82a4-9bd04d075d54 tempest-CreateVolumesFromImageTest-469033091 None] Flow 'volume_create_manager' (7bb57285-178b-44eb-b9f0-212a0b35ba01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:52:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f259cd68-b86a-4e43-82a4-9bd04d075d54 tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db16f675-e714-4142-a472-9eb952bea9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:52:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f259cd68-b86a-4e43-82a4-9bd04d075d54 tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db16f675-e714-4142-a472-9eb952bea9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-945360245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b8198d8-7a57-4e77-9027-0978e6ab55da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='337c3b28322b4d4ab7d2775723768d11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:52:59Z,use_quota=True,user_id='ff35f18a0a784b22a8b093ce66c3c807',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:52:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f259cd68-b86a-4e43-82a4-9bd04d075d54 tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e4f261d-1fa7-4ded-95a8-eac9110b63b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:52:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f259cd68-b86a-4e43-82a4-9bd04d075d54 tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e4f261d-1fa7-4ded-95a8-eac9110b63b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:52:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f259cd68-b86a-4e43-82a4-9bd04d075d54 tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb3fc9c7-7880-4451-b551-71a9174af70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:52:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f259cd68-b86a-4e43-82a4-9bd04d075d54 tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb3fc9c7-7880-4451-b551-71a9174af70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b8198d8-7a57-4e77-9027-0978e6ab55da', 'volume_name': 'volume-5b8198d8-7a57-4e77-9027-0978e6ab55da', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:52:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f259cd68-b86a-4e43-82a4-9bd04d075d54 tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3224a6b9-0911-403d-98bc-ec1a256e7ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:52:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f259cd68-b86a-4e43-82a4-9bd04d075d54 tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3224a6b9-0911-403d-98bc-ec1a256e7ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:52:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f259cd68-b86a-4e43-82a4-9bd04d075d54 tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75af7365-08b6-440a-b827-48dd74d5d9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:52:58 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-f259cd68-b86a-4e43-82a4-9bd04d075d54 tempest-CreateVolumesFromImageTest-469033091 None] Volume 5b8198d8-7a57-4e77-9027-0978e6ab55da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b8198d8-7a57-4e77-9027-0978e6ab55da', 'volume_size': 1} Jun 23 16:52:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f259cd68-b86a-4e43-82a4-9bd04d075d54 tempest-CreateVolumesFromImageTest-469033091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:52:58 devstack sudo[114629]: pam_unix(sudo:session): session closed for user root Jun 23 16:52:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-cddd5dd4-02b0-4c84-bcb2-a4ff188771e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-05e95e19-b81b-45ad-b224-af4de09f8bc8 1073741824" returned: 0 in 1.207s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:52:58 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-70a35ef7-f5e0-45cc-915f-c4ff4fbb47b5 tempest-CreateVolumesFromImageTest-469033091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:52:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-70a35ef7-f5e0-45cc-915f-c4ff4fbb47b5 tempest-CreateVolumesFromImageTest-469033091 None] Flow 'volume_create_manager' (b2463004-449e-4094-9655-50aa0401cbc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:52:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-70a35ef7-f5e0-45cc-915f-c4ff4fbb47b5 tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc6156fb-3353-4a8e-8fc0-42be980e4ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:52:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-cddd5dd4-02b0-4c84-bcb2-a4ff188771e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-05e95e19-b81b-45ad-b224-af4de09f8bc8 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:52:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-70a35ef7-f5e0-45cc-915f-c4ff4fbb47b5 tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc6156fb-3353-4a8e-8fc0-42be980e4ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2066517098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e201ec3-3760-483e-bba8-8cb90bdcf68e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='337c3b28322b4d4ab7d2775723768d11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:52:59Z,use_quota=True,user_id='ff35f18a0a784b22a8b093ce66c3c807',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:52:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-70a35ef7-f5e0-45cc-915f-c4ff4fbb47b5 tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2df1c508-3e26-43c6-8fe0-5d684fe0b238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:52:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-70a35ef7-f5e0-45cc-915f-c4ff4fbb47b5 tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2df1c508-3e26-43c6-8fe0-5d684fe0b238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:52:59 devstack sudo[114635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-05e95e19-b81b-45ad-b224-af4de09f8bc8 Jun 23 16:52:59 devstack sudo[114635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:52:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-70a35ef7-f5e0-45cc-915f-c4ff4fbb47b5 tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d300bc32-a3c6-4e9f-9822-1f49045cbfce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:52:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-70a35ef7-f5e0-45cc-915f-c4ff4fbb47b5 tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d300bc32-a3c6-4e9f-9822-1f49045cbfce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e201ec3-3760-483e-bba8-8cb90bdcf68e', 'volume_name': 'volume-6e201ec3-3760-483e-bba8-8cb90bdcf68e', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:52:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-70a35ef7-f5e0-45cc-915f-c4ff4fbb47b5 tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b889907a-8352-4033-afa0-42b1ebe16fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:52:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-70a35ef7-f5e0-45cc-915f-c4ff4fbb47b5 tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b889907a-8352-4033-afa0-42b1ebe16fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:52:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-70a35ef7-f5e0-45cc-915f-c4ff4fbb47b5 tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51f9e8e3-1223-4f41-9f06-29a9c971c909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:52:59 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-70a35ef7-f5e0-45cc-915f-c4ff4fbb47b5 tempest-CreateVolumesFromImageTest-469033091 None] Volume 6e201ec3-3760-483e-bba8-8cb90bdcf68e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e201ec3-3760-483e-bba8-8cb90bdcf68e', 'volume_size': 1} Jun 23 16:52:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-70a35ef7-f5e0-45cc-915f-c4ff4fbb47b5 tempest-CreateVolumesFromImageTest-469033091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:52:59 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b40a7ba-2ea7-439e-8c87-93227c47ae97 tempest-CreateVolumesFromImageTest-469033091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:52:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-3b40a7ba-2ea7-439e-8c87-93227c47ae97 tempest-CreateVolumesFromImageTest-469033091 None] Flow 'volume_create_manager' (47d79f72-e87e-4603-8a5a-cb70a585cc2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:52:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-3b40a7ba-2ea7-439e-8c87-93227c47ae97 tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fc9f3ba-ceaf-4048-8df7-0db44c48b0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:52:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-3b40a7ba-2ea7-439e-8c87-93227c47ae97 tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fc9f3ba-ceaf-4048-8df7-0db44c48b0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2138203396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62fba585-64c1-4d4f-ad3f-005ea8592d19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='337c3b28322b4d4ab7d2775723768d11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:52:59Z,use_quota=True,user_id='ff35f18a0a784b22a8b093ce66c3c807',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:52:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-3b40a7ba-2ea7-439e-8c87-93227c47ae97 tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (118b4b8d-5169-4aa4-95a6-09b0e4b96636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:52:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-3b40a7ba-2ea7-439e-8c87-93227c47ae97 tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (118b4b8d-5169-4aa4-95a6-09b0e4b96636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:52:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-3b40a7ba-2ea7-439e-8c87-93227c47ae97 tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (049dc81d-a17a-4498-9adc-c9488017f457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:52:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-3b40a7ba-2ea7-439e-8c87-93227c47ae97 tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (049dc81d-a17a-4498-9adc-c9488017f457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62fba585-64c1-4d4f-ad3f-005ea8592d19', 'volume_name': 'volume-62fba585-64c1-4d4f-ad3f-005ea8592d19', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:52:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-3b40a7ba-2ea7-439e-8c87-93227c47ae97 tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b5f2782-dc03-406c-8e46-5a26edb4242f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:52:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-3b40a7ba-2ea7-439e-8c87-93227c47ae97 tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b5f2782-dc03-406c-8e46-5a26edb4242f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:52:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-3b40a7ba-2ea7-439e-8c87-93227c47ae97 tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a67f8ed4-5fe4-479e-a255-32b83f94664a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:52:59 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-3b40a7ba-2ea7-439e-8c87-93227c47ae97 tempest-CreateVolumesFromImageTest-469033091 None] Volume 62fba585-64c1-4d4f-ad3f-005ea8592d19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62fba585-64c1-4d4f-ad3f-005ea8592d19', 'volume_size': 1} Jun 23 16:52:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-3b40a7ba-2ea7-439e-8c87-93227c47ae97 tempest-CreateVolumesFromImageTest-469033091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:52:59 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-63173cea-138c-4b7c-a3e8-c4a89fd9c08b tempest-CreateVolumesFromImageTest-469033091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:52:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-63173cea-138c-4b7c-a3e8-c4a89fd9c08b tempest-CreateVolumesFromImageTest-469033091 None] Flow 'volume_create_manager' (0cf64b87-0349-4f97-9f55-0909db2b3f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:52:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-63173cea-138c-4b7c-a3e8-c4a89fd9c08b tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aff7058-9fc3-4008-8852-951cfc015d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:52:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-63173cea-138c-4b7c-a3e8-c4a89fd9c08b tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aff7058-9fc3-4008-8852-951cfc015d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1215119856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c979d347-7761-438e-9908-ed5e73424122,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='337c3b28322b4d4ab7d2775723768d11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:53:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:53:00Z,use_quota=True,user_id='ff35f18a0a784b22a8b093ce66c3c807',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:52:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-63173cea-138c-4b7c-a3e8-c4a89fd9c08b tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (797fc999-a69d-42e5-b3ee-f04f076f5f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:52:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-63173cea-138c-4b7c-a3e8-c4a89fd9c08b tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (797fc999-a69d-42e5-b3ee-f04f076f5f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:52:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-63173cea-138c-4b7c-a3e8-c4a89fd9c08b tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (442a4155-da99-4010-a5e2-f9b66332c2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:52:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-63173cea-138c-4b7c-a3e8-c4a89fd9c08b tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (442a4155-da99-4010-a5e2-f9b66332c2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c979d347-7761-438e-9908-ed5e73424122', 'volume_name': 'volume-c979d347-7761-438e-9908-ed5e73424122', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:52:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-63173cea-138c-4b7c-a3e8-c4a89fd9c08b tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f826a4f-7798-4a28-b14e-0347ed8e1cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:52:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-63173cea-138c-4b7c-a3e8-c4a89fd9c08b tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f826a4f-7798-4a28-b14e-0347ed8e1cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:52:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-63173cea-138c-4b7c-a3e8-c4a89fd9c08b tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45cdadd6-af0d-4ea6-8f14-f81a8747ed7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:52:59 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-63173cea-138c-4b7c-a3e8-c4a89fd9c08b tempest-CreateVolumesFromImageTest-469033091 None] Volume c979d347-7761-438e-9908-ed5e73424122: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c979d347-7761-438e-9908-ed5e73424122', 'volume_size': 1} Jun 23 16:52:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-63173cea-138c-4b7c-a3e8-c4a89fd9c08b tempest-CreateVolumesFromImageTest-469033091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:52:59 devstack sudo[114635]: pam_unix(sudo:session): session closed for user root Jun 23 16:52:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-cddd5dd4-02b0-4c84-bcb2-a4ff188771e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-05e95e19-b81b-45ad-b224-af4de09f8bc8" returned: 0 in 0.882s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:52:59 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-cddd5dd4-02b0-4c84-bcb2-a4ff188771e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] <== create_volume: return (2181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:52:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-cddd5dd4-02b0-4c84-bcb2-a4ff188771e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.183s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:52:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b90d927b-0b05-4e47-b45d-da760b737703 tempest-VolumeDependencyTests-488053045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.067s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:52:59 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b90d927b-0b05-4e47-b45d-da760b737703 tempest-VolumeDependencyTests-488053045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-972505714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c19b71c-89d4-42e0-920d-b8cde74a3f0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='398d57d3c9074961b7a0ecc0be051f49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:52:58Z,use_quota=True,user_id='2afafd421cbf4ea198f822ffd8a59486',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:52:59 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-b90d927b-0b05-4e47-b45d-da760b737703 tempest-VolumeDependencyTests-488053045 None] Creating volume 9c19b71c-89d4-42e0-920d-b8cde74a3f0c {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:52:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b90d927b-0b05-4e47-b45d-da760b737703 tempest-VolumeDependencyTests-488053045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:52:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b90d927b-0b05-4e47-b45d-da760b737703 tempest-VolumeDependencyTests-488053045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:52:59 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b90d927b-0b05-4e47-b45d-da760b737703 tempest-VolumeDependencyTests-488053045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:52:59 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b90d927b-0b05-4e47-b45d-da760b737703 tempest-VolumeDependencyTests-488053045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:52:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b90d927b-0b05-4e47-b45d-da760b737703 tempest-VolumeDependencyTests-488053045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:52:59 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b90d927b-0b05-4e47-b45d-da760b737703 tempest-VolumeDependencyTests-488053045 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:52:59 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-b90d927b-0b05-4e47-b45d-da760b737703 tempest-VolumeDependencyTests-488053045 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:52:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b90d927b-0b05-4e47-b45d-da760b737703 tempest-VolumeDependencyTests-488053045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:52:59 devstack sudo[114639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c 1073741824 Jun 23 16:52:59 devstack sudo[114639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:52:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-cddd5dd4-02b0-4c84-bcb2-a4ff188771e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c8e7a39-47e4-4847-95ad-99a427dd7257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05e95e19-b81b-45ad-b224-af4de09f8bc8', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:52:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-cddd5dd4-02b0-4c84-bcb2-a4ff188771e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96366d95-e6b6-461b-bdb3-df526ec054f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:52:59 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-cddd5dd4-02b0-4c84-bcb2-a4ff188771e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Volume volume-05e95e19-b81b-45ad-b224-af4de09f8bc8 (05e95e19-b81b-45ad-b224-af4de09f8bc8): created successfully Jun 23 16:52:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-cddd5dd4-02b0-4c84-bcb2-a4ff188771e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96366d95-e6b6-461b-bdb3-df526ec054f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:52:59 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-cddd5dd4-02b0-4c84-bcb2-a4ff188771e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Flow 'volume_create_manager' (4c85480c-70da-41e1-b110-3396ea99ee52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:53:00 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-cddd5dd4-02b0-4c84-bcb2-a4ff188771e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Created volume successfully. Jun 23 16:53:00 devstack sudo[114639]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b90d927b-0b05-4e47-b45d-da760b737703 tempest-VolumeDependencyTests-488053045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c 1073741824" returned: 0 in 0.955s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b90d927b-0b05-4e47-b45d-da760b737703 tempest-VolumeDependencyTests-488053045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:00 devstack sudo[114645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c Jun 23 16:53:00 devstack sudo[114645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:01 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb9fdfa0-f684-4d2a-9887-982890885ec0 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:53:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bb9fdfa0-f684-4d2a-9887-982890885ec0 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Flow 'volume_create_manager' (947beba8-3e65-4dc6-b889-8401ae9852cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:53:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bb9fdfa0-f684-4d2a-9887-982890885ec0 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76775b43-eabf-4d35-bc29-f1e925075c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bb9fdfa0-f684-4d2a-9887-982890885ec0 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76775b43-eabf-4d35-bc29-f1e925075c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:53:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-713143592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f73a7a9a-91c5-471e-b47e-73e08da6f71f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b528545668e4fa4ac97eb755ab9aed1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:53:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:53:01Z,use_quota=True,user_id='09a59c4979074af98de31da93f522cc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bb9fdfa0-f684-4d2a-9887-982890885ec0 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb5f6a52-554a-42a8-ad5a-7f5db7c28b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bb9fdfa0-f684-4d2a-9887-982890885ec0 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb5f6a52-554a-42a8-ad5a-7f5db7c28b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bb9fdfa0-f684-4d2a-9887-982890885ec0 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a504bcb-d67c-467c-80bb-bb670a1101fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bb9fdfa0-f684-4d2a-9887-982890885ec0 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a504bcb-d67c-467c-80bb-bb670a1101fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f73a7a9a-91c5-471e-b47e-73e08da6f71f', 'volume_name': 'volume-f73a7a9a-91c5-471e-b47e-73e08da6f71f', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bb9fdfa0-f684-4d2a-9887-982890885ec0 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b202983-be00-4615-8e26-36615525dfc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bb9fdfa0-f684-4d2a-9887-982890885ec0 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b202983-be00-4615-8e26-36615525dfc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bb9fdfa0-f684-4d2a-9887-982890885ec0 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dc2f37c-4049-447f-8efb-ba80f432e6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:01 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-bb9fdfa0-f684-4d2a-9887-982890885ec0 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Volume f73a7a9a-91c5-471e-b47e-73e08da6f71f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f73a7a9a-91c5-471e-b47e-73e08da6f71f', 'volume_size': 1} Jun 23 16:53:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-bb9fdfa0-f684-4d2a-9887-982890885ec0 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:53:01 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:53:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:53:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:53:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:53:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:01 devstack sudo[114647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:53:01 devstack sudo[114647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:01 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc864993-1343-4c30-ab99-188758168806 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:53:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-fc864993-1343-4c30-ab99-188758168806 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Flow 'volume_create_manager' (2041094a-302d-48c1-96d5-bbe39125d487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:53:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-fc864993-1343-4c30-ab99-188758168806 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a0ef963-63ef-4b74-aab6-4f12cb959db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-fc864993-1343-4c30-ab99-188758168806 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a0ef963-63ef-4b74-aab6-4f12cb959db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:53:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-737909145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ebac3ba-0f59-4777-8ab0-a402e6b19a6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b528545668e4fa4ac97eb755ab9aed1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:53:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:53:02Z,use_quota=True,user_id='09a59c4979074af98de31da93f522cc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-fc864993-1343-4c30-ab99-188758168806 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e819cc27-24eb-4a26-9944-0b87599fa68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-fc864993-1343-4c30-ab99-188758168806 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e819cc27-24eb-4a26-9944-0b87599fa68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-fc864993-1343-4c30-ab99-188758168806 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f981b772-9cbd-4b4d-a095-c7d6df13018a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-fc864993-1343-4c30-ab99-188758168806 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f981b772-9cbd-4b4d-a095-c7d6df13018a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ebac3ba-0f59-4777-8ab0-a402e6b19a6b', 'volume_name': 'volume-8ebac3ba-0f59-4777-8ab0-a402e6b19a6b', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-fc864993-1343-4c30-ab99-188758168806 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c8fa9a2-7fe9-4fba-b2d1-d054187fa4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-fc864993-1343-4c30-ab99-188758168806 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c8fa9a2-7fe9-4fba-b2d1-d054187fa4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:01 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-fc864993-1343-4c30-ab99-188758168806 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c1870da-7c62-46d4-8c54-857bbbabbb9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:01 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-fc864993-1343-4c30-ab99-188758168806 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Volume 8ebac3ba-0f59-4777-8ab0-a402e6b19a6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ebac3ba-0f59-4777-8ab0-a402e6b19a6b', 'volume_size': 1} Jun 23 16:53:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-fc864993-1343-4c30-ab99-188758168806 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:53:02 devstack sudo[114645]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b90d927b-0b05-4e47-b45d-da760b737703 tempest-VolumeDependencyTests-488053045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c" returned: 0 in 1.118s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:02 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b90d927b-0b05-4e47-b45d-da760b737703 tempest-VolumeDependencyTests-488053045 None] <== create_volume: return (2129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:53:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b90d927b-0b05-4e47-b45d-da760b737703 tempest-VolumeDependencyTests-488053045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.132s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-dfb54a00-044a-4d97-ba88-06751cb419f9 tempest-CreateVolumesFromImageTest-469033091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.832s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:02 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-dfb54a00-044a-4d97-ba88-06751cb419f9 tempest-CreateVolumesFromImageTest-469033091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2054910276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4615d1ba-5988-4ef0-bbac-226abeda49f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='337c3b28322b4d4ab7d2775723768d11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:52:58Z,use_quota=True,user_id='ff35f18a0a784b22a8b093ce66c3c807',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:53:02 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-dfb54a00-044a-4d97-ba88-06751cb419f9 tempest-CreateVolumesFromImageTest-469033091 None] Creating volume 4615d1ba-5988-4ef0-bbac-226abeda49f3 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:53:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-dfb54a00-044a-4d97-ba88-06751cb419f9 tempest-CreateVolumesFromImageTest-469033091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:53:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-dfb54a00-044a-4d97-ba88-06751cb419f9 tempest-CreateVolumesFromImageTest-469033091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:02 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-dfb54a00-044a-4d97-ba88-06751cb419f9 tempest-CreateVolumesFromImageTest-469033091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:53:02 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-dfb54a00-044a-4d97-ba88-06751cb419f9 tempest-CreateVolumesFromImageTest-469033091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:53:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-dfb54a00-044a-4d97-ba88-06751cb419f9 tempest-CreateVolumesFromImageTest-469033091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:02 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-dfb54a00-044a-4d97-ba88-06751cb419f9 tempest-CreateVolumesFromImageTest-469033091 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:53:02 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-dfb54a00-044a-4d97-ba88-06751cb419f9 tempest-CreateVolumesFromImageTest-469033091 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:53:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-dfb54a00-044a-4d97-ba88-06751cb419f9 tempest-CreateVolumesFromImageTest-469033091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4615d1ba-5988-4ef0-bbac-226abeda49f3 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b90d927b-0b05-4e47-b45d-da760b737703 tempest-VolumeDependencyTests-488053045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a638c07-05ee-47a3-8524-f3e32c293460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b90d927b-0b05-4e47-b45d-da760b737703 tempest-VolumeDependencyTests-488053045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7457d16b-faac-4cc1-b8a9-e5fa582a17d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:02 devstack sudo[114650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4615d1ba-5988-4ef0-bbac-226abeda49f3 1073741824 Jun 23 16:53:02 devstack sudo[114650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:02 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-b90d927b-0b05-4e47-b45d-da760b737703 tempest-VolumeDependencyTests-488053045 None] Volume volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c (9c19b71c-89d4-42e0-920d-b8cde74a3f0c): created successfully Jun 23 16:53:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b90d927b-0b05-4e47-b45d-da760b737703 tempest-VolumeDependencyTests-488053045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7457d16b-faac-4cc1-b8a9-e5fa582a17d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-b90d927b-0b05-4e47-b45d-da760b737703 tempest-VolumeDependencyTests-488053045 None] Flow 'volume_create_manager' (3a343a2e-7f80-46b1-ade2-27362520fff0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:53:02 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-b90d927b-0b05-4e47-b45d-da760b737703 tempest-VolumeDependencyTests-488053045 None] Created volume successfully. Jun 23 16:53:02 devstack sudo[114647]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.953s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:02 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:53:02 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager._thread_info {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:53:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread count: 28 {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 16:53:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread info: [<_MainThread(MainThread, started 126303828988032)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 16:53:02 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-79c8973b-3ba9-4c4e-83be-6722b9002372 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:53:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-79c8973b-3ba9-4c4e-83be-6722b9002372 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Flow 'volume_create_manager' (2f7aa323-a0af-46c1-bf4e-abd972c85048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:53:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-79c8973b-3ba9-4c4e-83be-6722b9002372 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58c9ebe9-8c0a-4afe-9f09-40105184ba86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-79c8973b-3ba9-4c4e-83be-6722b9002372 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58c9ebe9-8c0a-4afe-9f09-40105184ba86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1732045601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=228fcf96-a907-4d64-9092-6a7f19c8912d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b528545668e4fa4ac97eb755ab9aed1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:53:03Z,use_quota=True,user_id='09a59c4979074af98de31da93f522cc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-79c8973b-3ba9-4c4e-83be-6722b9002372 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b89abd0-87b2-4178-bd01-92bbfb8a04ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-79c8973b-3ba9-4c4e-83be-6722b9002372 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b89abd0-87b2-4178-bd01-92bbfb8a04ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-79c8973b-3ba9-4c4e-83be-6722b9002372 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd3aef29-686f-4ce7-a480-c557c00b2ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-79c8973b-3ba9-4c4e-83be-6722b9002372 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd3aef29-686f-4ce7-a480-c557c00b2ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '228fcf96-a907-4d64-9092-6a7f19c8912d', 'volume_name': 'volume-228fcf96-a907-4d64-9092-6a7f19c8912d', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-79c8973b-3ba9-4c4e-83be-6722b9002372 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8164f44d-65e4-4dfa-85b4-0bb30e16c3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-79c8973b-3ba9-4c4e-83be-6722b9002372 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8164f44d-65e4-4dfa-85b4-0bb30e16c3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-79c8973b-3ba9-4c4e-83be-6722b9002372 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2bab46f-7bcd-40cc-bd5a-639bcae63455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:02 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-79c8973b-3ba9-4c4e-83be-6722b9002372 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Volume 228fcf96-a907-4d64-9092-6a7f19c8912d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-228fcf96-a907-4d64-9092-6a7f19c8912d', 'volume_size': 1} Jun 23 16:53:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-79c8973b-3ba9-4c4e-83be-6722b9002372 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:53:02 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:53:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Flow 'volume_create_manager' (58caff1e-9431-433d-a8ef-ea0827655cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:53:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (054c4bc5-bfca-444c-a57c-6b9a1d55e2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (054c4bc5-bfca-444c-a57c-6b9a1d55e2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=271d1624-320c-4ce7-b383-2f7a655d76a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7e5b99e6ea744d0b40434da9789d53b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:53:03Z,use_quota=True,user_id='d4845fafb2714f9b9a4c3e9b796addea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f96cdbd6-1b98-4bea-bcb9-2da3e3247823),volume_type_id=f96cdbd6-1b98-4bea-bcb9-2da3e3247823)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3473e807-9b28-4f53-9c08-6fa67ef15026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3473e807-9b28-4f53-9c08-6fa67ef15026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1ff2362-7bb0-45b3-9c9f-e9db5ec89ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:03 devstack cinder-volume[93788]: DEBUG cinder.image.glance [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Creating Keystone auth plugin from conf {{(pid=93788) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 16:53:03 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dfdf329-d1c7-4b43-b99d-ecd297a34831 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:53:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-3dfdf329-d1c7-4b43-b99d-ecd297a34831 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Flow 'volume_create_manager' (2d07f03a-b8af-4b43-b703-46215c2b0a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:53:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-3dfdf329-d1c7-4b43-b99d-ecd297a34831 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2613c2d2-5532-4dc8-963a-91f64852cb4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:03 devstack sudo[114650]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-3dfdf329-d1c7-4b43-b99d-ecd297a34831 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2613c2d2-5532-4dc8-963a-91f64852cb4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1855487664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3180b269-33c6-43e4-af34-83cd9dce1ad4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b528545668e4fa4ac97eb755ab9aed1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:53:03Z,use_quota=True,user_id='09a59c4979074af98de31da93f522cc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-3dfdf329-d1c7-4b43-b99d-ecd297a34831 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e30bc701-38cc-4656-ab2e-d541665363c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-3dfdf329-d1c7-4b43-b99d-ecd297a34831 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e30bc701-38cc-4656-ab2e-d541665363c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-3dfdf329-d1c7-4b43-b99d-ecd297a34831 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70ae46f8-7b28-4f97-97b2-115a05c39d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-3dfdf329-d1c7-4b43-b99d-ecd297a34831 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70ae46f8-7b28-4f97-97b2-115a05c39d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3180b269-33c6-43e4-af34-83cd9dce1ad4', 'volume_name': 'volume-3180b269-33c6-43e4-af34-83cd9dce1ad4', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-3dfdf329-d1c7-4b43-b99d-ecd297a34831 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e36f379-5b2c-47e7-8198-0285ad7af452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-3dfdf329-d1c7-4b43-b99d-ecd297a34831 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e36f379-5b2c-47e7-8198-0285ad7af452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-3dfdf329-d1c7-4b43-b99d-ecd297a34831 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01873673-791f-4203-a4f7-e9e24a5ff2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:03 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-3dfdf329-d1c7-4b43-b99d-ecd297a34831 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Volume 3180b269-33c6-43e4-af34-83cd9dce1ad4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3180b269-33c6-43e4-af34-83cd9dce1ad4', 'volume_size': 1} Jun 23 16:53:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-3dfdf329-d1c7-4b43-b99d-ecd297a34831 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:53:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-dfb54a00-044a-4d97-ba88-06751cb419f9 tempest-CreateVolumesFromImageTest-469033091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4615d1ba-5988-4ef0-bbac-226abeda49f3 1073741824" returned: 0 in 1.207s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:03 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cf9f9bd-43d3-424c-943e-261708b09433 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:53:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-9cf9f9bd-43d3-424c-943e-261708b09433 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Flow 'volume_create_manager' (cefef64f-3667-412b-924f-e825eddee706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:53:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-9cf9f9bd-43d3-424c-943e-261708b09433 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5863d884-7a34-4e65-bd83-72ffedddddc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-9cf9f9bd-43d3-424c-943e-261708b09433 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5863d884-7a34-4e65-bd83-72ffedddddc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1410516497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3827a83-d0c8-4c56-9aca-5ccd0abe3f25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b528545668e4fa4ac97eb755ab9aed1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:53:03Z,use_quota=True,user_id='09a59c4979074af98de31da93f522cc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-9cf9f9bd-43d3-424c-943e-261708b09433 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c02fc12-a30d-4212-9eb6-5fc903c8dcca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-9cf9f9bd-43d3-424c-943e-261708b09433 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c02fc12-a30d-4212-9eb6-5fc903c8dcca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-9cf9f9bd-43d3-424c-943e-261708b09433 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8d6869c-f6e4-4a6c-b947-213623a71bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-9cf9f9bd-43d3-424c-943e-261708b09433 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8d6869c-f6e4-4a6c-b947-213623a71bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3827a83-d0c8-4c56-9aca-5ccd0abe3f25', 'volume_name': 'volume-e3827a83-d0c8-4c56-9aca-5ccd0abe3f25', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-9cf9f9bd-43d3-424c-943e-261708b09433 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19c6a70a-c7e5-4bc5-8e04-62b65e14ca39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-9cf9f9bd-43d3-424c-943e-261708b09433 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19c6a70a-c7e5-4bc5-8e04-62b65e14ca39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-9cf9f9bd-43d3-424c-943e-261708b09433 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9451f8aa-159e-407e-ab4d-81fd192aa8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:03 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-9cf9f9bd-43d3-424c-943e-261708b09433 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Volume e3827a83-d0c8-4c56-9aca-5ccd0abe3f25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3827a83-d0c8-4c56-9aca-5ccd0abe3f25', 'volume_size': 1} Jun 23 16:53:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-9cf9f9bd-43d3-424c-943e-261708b09433 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:53:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-dfb54a00-044a-4d97-ba88-06751cb419f9 tempest-CreateVolumesFromImageTest-469033091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4615d1ba-5988-4ef0-bbac-226abeda49f3 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:03 devstack sudo[114657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4615d1ba-5988-4ef0-bbac-226abeda49f3 Jun 23 16:53:03 devstack sudo[114657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b18ebf1b-9c8d-49a7-9ed1-101afbc8b7f8 tempest-VolumeDependencyTests-488053045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:53:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1ff2362-7bb0-45b3-9c9f-e9db5ec89ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '271d1624-320c-4ce7-b383-2f7a655d76a2', 'volume_name': 'volume-271d1624-320c-4ce7-b383-2f7a655d76a2', 'volume_size': 1, 'image_id': '4ffea667-a82b-4464-8864-6a6edf822b0e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ffea667-a82b-4464-8864-6a6edf822b0e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dc397a555389a80183011104bf2f89bb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c7e5b99e6ea744d0b40434da9789d53b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'affe39a68fc360e3fc4eaa7b888bdad4349cf2f9ea732b939ffc6b4e1199cf3961d2e3cf21a25323d6dacdc72457b02c0e0763b6b78d3ed3064764347f1018da', 'id': '4ffea667-a82b-4464-8864-6a6edf822b0e', 'created_at': datetime.datetime(2026, 6, 23, 14, 52, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 14, 53, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ffea667-a82b-4464-8864-6a6edf822b0e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36a7c354-e216-4e7a-8a1f-d4145842ce47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36a7c354-e216-4e7a-8a1f-d4145842ce47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:03 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f56f0759-c95f-4be9-a0de-a7c863b0d088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:03 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Volume 271d1624-320c-4ce7-b383-2f7a655d76a2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-271d1624-320c-4ce7-b383-2f7a655d76a2', 'volume_size': 1, 'image_id': '4ffea667-a82b-4464-8864-6a6edf822b0e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ffea667-a82b-4464-8864-6a6edf822b0e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dc397a555389a80183011104bf2f89bb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c7e5b99e6ea744d0b40434da9789d53b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'affe39a68fc360e3fc4eaa7b888bdad4349cf2f9ea732b939ffc6b4e1199cf3961d2e3cf21a25323d6dacdc72457b02c0e0763b6b78d3ed3064764347f1018da', 'id': '4ffea667-a82b-4464-8864-6a6edf822b0e', 'created_at': datetime.datetime(2026, 6, 23, 14, 52, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 14, 53, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ffea667-a82b-4464-8864-6a6edf822b0e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 23 16:53:03 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Trying to clone 271d1624-320c-4ce7-b383-2f7a655d76a2 from image 4ffea667-a82b-4464-8864-6a6edf822b0e at location (None, [{'url': 'file:///opt/stack/data/glance/images/4ffea667-a82b-4464-8864-6a6edf822b0e', 'metadata': {}}]). {{(pid=93788) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 16:53:03 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4ffea667-a82b-4464-8864-6a6edf822b0e_vrastx4hdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93788) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 16:53:03 devstack cinder-volume[93788]: INFO cinder.image.image_utils [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Image download 0.00 MB at 0.00 MB/s Jun 23 16:53:03 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e56c275-ab71-417c-b7a8-53727883fd2d]: (4, 'raw') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:53:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4ffea667-a82b-4464-8864-6a6edf822b0e_vrastx4hdevstack@QuobyteHD {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:03 devstack sudo[114659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4ffea667-a82b-4464-8864-6a6edf822b0e_vrastx4hdevstack@QuobyteHD Jun 23 16:53:03 devstack sudo[114659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:04 devstack sudo[114657]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-dfb54a00-044a-4d97-ba88-06751cb419f9 tempest-CreateVolumesFromImageTest-469033091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4615d1ba-5988-4ef0-bbac-226abeda49f3" returned: 0 in 0.723s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:04 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-dfb54a00-044a-4d97-ba88-06751cb419f9 tempest-CreateVolumesFromImageTest-469033091 None] <== create_volume: return (2088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:53:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-dfb54a00-044a-4d97-ba88-06751cb419f9 tempest-CreateVolumesFromImageTest-469033091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.093s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f259cd68-b86a-4e43-82a4-9bd04d075d54 tempest-CreateVolumesFromImageTest-469033091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.400s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:04 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-f259cd68-b86a-4e43-82a4-9bd04d075d54 tempest-CreateVolumesFromImageTest-469033091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-945360245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b8198d8-7a57-4e77-9027-0978e6ab55da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='337c3b28322b4d4ab7d2775723768d11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:52:59Z,use_quota=True,user_id='ff35f18a0a784b22a8b093ce66c3c807',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:53:04 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-f259cd68-b86a-4e43-82a4-9bd04d075d54 tempest-CreateVolumesFromImageTest-469033091 None] Creating volume 5b8198d8-7a57-4e77-9027-0978e6ab55da {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:53:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f259cd68-b86a-4e43-82a4-9bd04d075d54 tempest-CreateVolumesFromImageTest-469033091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:53:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f259cd68-b86a-4e43-82a4-9bd04d075d54 tempest-CreateVolumesFromImageTest-469033091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:04 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-f259cd68-b86a-4e43-82a4-9bd04d075d54 tempest-CreateVolumesFromImageTest-469033091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:53:04 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-f259cd68-b86a-4e43-82a4-9bd04d075d54 tempest-CreateVolumesFromImageTest-469033091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:53:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f259cd68-b86a-4e43-82a4-9bd04d075d54 tempest-CreateVolumesFromImageTest-469033091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:04 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-f259cd68-b86a-4e43-82a4-9bd04d075d54 tempest-CreateVolumesFromImageTest-469033091 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:53:04 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-f259cd68-b86a-4e43-82a4-9bd04d075d54 tempest-CreateVolumesFromImageTest-469033091 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:53:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f259cd68-b86a-4e43-82a4-9bd04d075d54 tempest-CreateVolumesFromImageTest-469033091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5b8198d8-7a57-4e77-9027-0978e6ab55da 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:04 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-dfb54a00-044a-4d97-ba88-06751cb419f9 tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a521f158-1080-4b3e-aa27-c612166355d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4615d1ba-5988-4ef0-bbac-226abeda49f3', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:04 devstack sudo[114662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5b8198d8-7a57-4e77-9027-0978e6ab55da 1073741824 Jun 23 16:53:04 devstack sudo[114662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:04 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-dfb54a00-044a-4d97-ba88-06751cb419f9 tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (856bb96e-849d-49d2-9566-611fae3b9909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:04 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-dfb54a00-044a-4d97-ba88-06751cb419f9 tempest-CreateVolumesFromImageTest-469033091 None] Volume volume-4615d1ba-5988-4ef0-bbac-226abeda49f3 (4615d1ba-5988-4ef0-bbac-226abeda49f3): created successfully Jun 23 16:53:04 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-dfb54a00-044a-4d97-ba88-06751cb419f9 tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (856bb96e-849d-49d2-9566-611fae3b9909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:04 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-dfb54a00-044a-4d97-ba88-06751cb419f9 tempest-CreateVolumesFromImageTest-469033091 None] Flow 'volume_create_manager' (5e7e582f-5537-4253-865e-ab51df386c29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:53:04 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-dfb54a00-044a-4d97-ba88-06751cb419f9 tempest-CreateVolumesFromImageTest-469033091 None] Created volume successfully. Jun 23 16:53:04 devstack sudo[114659]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4ffea667-a82b-4464-8864-6a6edf822b0e_vrastx4hdevstack@QuobyteHD" returned: 0 in 0.720s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ffea667-a82b-4464-8864-6a6edf822b0e_vrastx4hdevstack@QuobyteHD {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:04 devstack sudo[114666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ffea667-a82b-4464-8864-6a6edf822b0e_vrastx4hdevstack@QuobyteHD Jun 23 16:53:04 devstack sudo[114666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:05 devstack sudo[114662]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f259cd68-b86a-4e43-82a4-9bd04d075d54 tempest-CreateVolumesFromImageTest-469033091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5b8198d8-7a57-4e77-9027-0978e6ab55da 1073741824" returned: 0 in 0.911s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f259cd68-b86a-4e43-82a4-9bd04d075d54 tempest-CreateVolumesFromImageTest-469033091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5b8198d8-7a57-4e77-9027-0978e6ab55da {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:05 devstack sudo[114674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5b8198d8-7a57-4e77-9027-0978e6ab55da Jun 23 16:53:05 devstack sudo[114674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:05 devstack sudo[114666]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ffea667-a82b-4464-8864-6a6edf822b0e_vrastx4hdevstack@QuobyteHD" returned: 1 in 0.821s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ffea667-a82b-4464-8864-6a6edf822b0e_vrastx4hdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:53:05 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Temporary image 4ffea667-a82b-4464-8864-6a6edf822b0e is fetched for user d4845fafb2714f9b9a4c3e9b796addea. {{(pid=93788) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 16:53:05 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[81204350-cae9-4b50-898a-ba69426b921e]: (4, 'raw') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:53:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4ffea667-a82b-4464-8864-6a6edf822b0e_vrastx4hdevstack@QuobyteHD {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:05 devstack sudo[114676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4ffea667-a82b-4464-8864-6a6edf822b0e_vrastx4hdevstack@QuobyteHD Jun 23 16:53:05 devstack sudo[114676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:05 devstack sudo[114674]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f259cd68-b86a-4e43-82a4-9bd04d075d54 tempest-CreateVolumesFromImageTest-469033091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5b8198d8-7a57-4e77-9027-0978e6ab55da" returned: 0 in 0.778s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:05 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-f259cd68-b86a-4e43-82a4-9bd04d075d54 tempest-CreateVolumesFromImageTest-469033091 None] <== create_volume: return (1751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:53:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f259cd68-b86a-4e43-82a4-9bd04d075d54 tempest-CreateVolumesFromImageTest-469033091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.756s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-70a35ef7-f5e0-45cc-915f-c4ff4fbb47b5 tempest-CreateVolumesFromImageTest-469033091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.823s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:05 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-70a35ef7-f5e0-45cc-915f-c4ff4fbb47b5 tempest-CreateVolumesFromImageTest-469033091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2066517098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e201ec3-3760-483e-bba8-8cb90bdcf68e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='337c3b28322b4d4ab7d2775723768d11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:52:59Z,use_quota=True,user_id='ff35f18a0a784b22a8b093ce66c3c807',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:53:05 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-70a35ef7-f5e0-45cc-915f-c4ff4fbb47b5 tempest-CreateVolumesFromImageTest-469033091 None] Creating volume 6e201ec3-3760-483e-bba8-8cb90bdcf68e {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:53:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-70a35ef7-f5e0-45cc-915f-c4ff4fbb47b5 tempest-CreateVolumesFromImageTest-469033091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:53:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-70a35ef7-f5e0-45cc-915f-c4ff4fbb47b5 tempest-CreateVolumesFromImageTest-469033091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:05 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-70a35ef7-f5e0-45cc-915f-c4ff4fbb47b5 tempest-CreateVolumesFromImageTest-469033091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:53:05 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-70a35ef7-f5e0-45cc-915f-c4ff4fbb47b5 tempest-CreateVolumesFromImageTest-469033091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:53:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-70a35ef7-f5e0-45cc-915f-c4ff4fbb47b5 tempest-CreateVolumesFromImageTest-469033091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:05 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-70a35ef7-f5e0-45cc-915f-c4ff4fbb47b5 tempest-CreateVolumesFromImageTest-469033091 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:53:05 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-70a35ef7-f5e0-45cc-915f-c4ff4fbb47b5 tempest-CreateVolumesFromImageTest-469033091 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:53:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-70a35ef7-f5e0-45cc-915f-c4ff4fbb47b5 tempest-CreateVolumesFromImageTest-469033091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6e201ec3-3760-483e-bba8-8cb90bdcf68e 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:05 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f259cd68-b86a-4e43-82a4-9bd04d075d54 tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75af7365-08b6-440a-b827-48dd74d5d9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b8198d8-7a57-4e77-9027-0978e6ab55da', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:05 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f259cd68-b86a-4e43-82a4-9bd04d075d54 tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (244a2dc7-0db0-487d-98c7-dbeed99ae05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:05 devstack sudo[114679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6e201ec3-3760-483e-bba8-8cb90bdcf68e 1073741824 Jun 23 16:53:05 devstack sudo[114679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:05 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-f259cd68-b86a-4e43-82a4-9bd04d075d54 tempest-CreateVolumesFromImageTest-469033091 None] Volume volume-5b8198d8-7a57-4e77-9027-0978e6ab55da (5b8198d8-7a57-4e77-9027-0978e6ab55da): created successfully Jun 23 16:53:05 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f259cd68-b86a-4e43-82a4-9bd04d075d54 tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (244a2dc7-0db0-487d-98c7-dbeed99ae05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:06 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f259cd68-b86a-4e43-82a4-9bd04d075d54 tempest-CreateVolumesFromImageTest-469033091 None] Flow 'volume_create_manager' (7bb57285-178b-44eb-b9f0-212a0b35ba01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:53:06 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-f259cd68-b86a-4e43-82a4-9bd04d075d54 tempest-CreateVolumesFromImageTest-469033091 None] Created volume successfully. Jun 23 16:53:06 devstack sudo[114676]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4ffea667-a82b-4464-8864-6a6edf822b0e_vrastx4hdevstack@QuobyteHD" returned: 0 in 0.785s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ffea667-a82b-4464-8864-6a6edf822b0e_vrastx4hdevstack@QuobyteHD {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:06 devstack sudo[114683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ffea667-a82b-4464-8864-6a6edf822b0e_vrastx4hdevstack@QuobyteHD Jun 23 16:53:06 devstack sudo[114683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:06 devstack sudo[114679]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-70a35ef7-f5e0-45cc-915f-c4ff4fbb47b5 tempest-CreateVolumesFromImageTest-469033091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6e201ec3-3760-483e-bba8-8cb90bdcf68e 1073741824" returned: 0 in 0.893s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-70a35ef7-f5e0-45cc-915f-c4ff4fbb47b5 tempest-CreateVolumesFromImageTest-469033091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6e201ec3-3760-483e-bba8-8cb90bdcf68e {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:06 devstack sudo[114692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6e201ec3-3760-483e-bba8-8cb90bdcf68e Jun 23 16:53:06 devstack sudo[114692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:06 devstack sudo[114683]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ffea667-a82b-4464-8864-6a6edf822b0e_vrastx4hdevstack@QuobyteHD" returned: 1 in 0.791s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ffea667-a82b-4464-8864-6a6edf822b0e_vrastx4hdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:53:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:53:07 devstack sudo[114692]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-70a35ef7-f5e0-45cc-915f-c4ff4fbb47b5 tempest-CreateVolumesFromImageTest-469033091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6e201ec3-3760-483e-bba8-8cb90bdcf68e" returned: 0 in 0.670s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:07 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-70a35ef7-f5e0-45cc-915f-c4ff4fbb47b5 tempest-CreateVolumesFromImageTest-469033091 None] <== create_volume: return (1612ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:53:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-70a35ef7-f5e0-45cc-915f-c4ff4fbb47b5 tempest-CreateVolumesFromImageTest-469033091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.616s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-3b40a7ba-2ea7-439e-8c87-93227c47ae97 tempest-CreateVolumesFromImageTest-469033091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.986s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:07 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-3b40a7ba-2ea7-439e-8c87-93227c47ae97 tempest-CreateVolumesFromImageTest-469033091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2138203396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62fba585-64c1-4d4f-ad3f-005ea8592d19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='337c3b28322b4d4ab7d2775723768d11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:52:59Z,use_quota=True,user_id='ff35f18a0a784b22a8b093ce66c3c807',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:53:07 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-3b40a7ba-2ea7-439e-8c87-93227c47ae97 tempest-CreateVolumesFromImageTest-469033091 None] Creating volume 62fba585-64c1-4d4f-ad3f-005ea8592d19 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:53:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-3b40a7ba-2ea7-439e-8c87-93227c47ae97 tempest-CreateVolumesFromImageTest-469033091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:53:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-3b40a7ba-2ea7-439e-8c87-93227c47ae97 tempest-CreateVolumesFromImageTest-469033091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:07 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-3b40a7ba-2ea7-439e-8c87-93227c47ae97 tempest-CreateVolumesFromImageTest-469033091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:53:07 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-3b40a7ba-2ea7-439e-8c87-93227c47ae97 tempest-CreateVolumesFromImageTest-469033091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:53:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-3b40a7ba-2ea7-439e-8c87-93227c47ae97 tempest-CreateVolumesFromImageTest-469033091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:07 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-3b40a7ba-2ea7-439e-8c87-93227c47ae97 tempest-CreateVolumesFromImageTest-469033091 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:53:07 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-3b40a7ba-2ea7-439e-8c87-93227c47ae97 tempest-CreateVolumesFromImageTest-469033091 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:53:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-3b40a7ba-2ea7-439e-8c87-93227c47ae97 tempest-CreateVolumesFromImageTest-469033091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-62fba585-64c1-4d4f-ad3f-005ea8592d19 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:07 devstack sudo[114695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-62fba585-64c1-4d4f-ad3f-005ea8592d19 1073741824 Jun 23 16:53:07 devstack sudo[114695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:07 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-70a35ef7-f5e0-45cc-915f-c4ff4fbb47b5 tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51f9e8e3-1223-4f41-9f06-29a9c971c909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e201ec3-3760-483e-bba8-8cb90bdcf68e', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:07 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-70a35ef7-f5e0-45cc-915f-c4ff4fbb47b5 tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e36595f-6398-434a-b46a-e32cc971bb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:07 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-70a35ef7-f5e0-45cc-915f-c4ff4fbb47b5 tempest-CreateVolumesFromImageTest-469033091 None] Volume volume-6e201ec3-3760-483e-bba8-8cb90bdcf68e (6e201ec3-3760-483e-bba8-8cb90bdcf68e): created successfully Jun 23 16:53:07 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-70a35ef7-f5e0-45cc-915f-c4ff4fbb47b5 tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e36595f-6398-434a-b46a-e32cc971bb9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:07 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-70a35ef7-f5e0-45cc-915f-c4ff4fbb47b5 tempest-CreateVolumesFromImageTest-469033091 None] Flow 'volume_create_manager' (b2463004-449e-4094-9655-50aa0401cbc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:53:07 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-70a35ef7-f5e0-45cc-915f-c4ff4fbb47b5 tempest-CreateVolumesFromImageTest-469033091 None] Created volume successfully. Jun 23 16:53:08 devstack sudo[114695]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-3b40a7ba-2ea7-439e-8c87-93227c47ae97 tempest-CreateVolumesFromImageTest-469033091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-62fba585-64c1-4d4f-ad3f-005ea8592d19 1073741824" returned: 0 in 0.808s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-3b40a7ba-2ea7-439e-8c87-93227c47ae97 tempest-CreateVolumesFromImageTest-469033091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-62fba585-64c1-4d4f-ad3f-005ea8592d19 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:08 devstack sudo[114701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-62fba585-64c1-4d4f-ad3f-005ea8592d19 Jun 23 16:53:08 devstack sudo[114701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:09 devstack sudo[114701]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-3b40a7ba-2ea7-439e-8c87-93227c47ae97 tempest-CreateVolumesFromImageTest-469033091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-62fba585-64c1-4d4f-ad3f-005ea8592d19" returned: 0 in 0.632s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:09 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-3b40a7ba-2ea7-439e-8c87-93227c47ae97 tempest-CreateVolumesFromImageTest-469033091 None] <== create_volume: return (1475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:53:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-3b40a7ba-2ea7-439e-8c87-93227c47ae97 tempest-CreateVolumesFromImageTest-469033091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-63173cea-138c-4b7c-a3e8-c4a89fd9c08b tempest-CreateVolumesFromImageTest-469033091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.115s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:09 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-63173cea-138c-4b7c-a3e8-c4a89fd9c08b tempest-CreateVolumesFromImageTest-469033091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1215119856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c979d347-7761-438e-9908-ed5e73424122,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='337c3b28322b4d4ab7d2775723768d11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:53:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:53:00Z,use_quota=True,user_id='ff35f18a0a784b22a8b093ce66c3c807',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:53:09 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-63173cea-138c-4b7c-a3e8-c4a89fd9c08b tempest-CreateVolumesFromImageTest-469033091 None] Creating volume c979d347-7761-438e-9908-ed5e73424122 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:53:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-63173cea-138c-4b7c-a3e8-c4a89fd9c08b tempest-CreateVolumesFromImageTest-469033091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:53:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-63173cea-138c-4b7c-a3e8-c4a89fd9c08b tempest-CreateVolumesFromImageTest-469033091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:09 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-63173cea-138c-4b7c-a3e8-c4a89fd9c08b tempest-CreateVolumesFromImageTest-469033091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:53:09 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-63173cea-138c-4b7c-a3e8-c4a89fd9c08b tempest-CreateVolumesFromImageTest-469033091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:53:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-63173cea-138c-4b7c-a3e8-c4a89fd9c08b tempest-CreateVolumesFromImageTest-469033091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:09 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-63173cea-138c-4b7c-a3e8-c4a89fd9c08b tempest-CreateVolumesFromImageTest-469033091 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:53:09 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-63173cea-138c-4b7c-a3e8-c4a89fd9c08b tempest-CreateVolumesFromImageTest-469033091 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:53:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-63173cea-138c-4b7c-a3e8-c4a89fd9c08b tempest-CreateVolumesFromImageTest-469033091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c979d347-7761-438e-9908-ed5e73424122 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:09 devstack sudo[114704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c979d347-7761-438e-9908-ed5e73424122 1073741824 Jun 23 16:53:09 devstack sudo[114704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:09 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-3b40a7ba-2ea7-439e-8c87-93227c47ae97 tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a67f8ed4-5fe4-479e-a255-32b83f94664a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62fba585-64c1-4d4f-ad3f-005ea8592d19', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:09 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-3b40a7ba-2ea7-439e-8c87-93227c47ae97 tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d92f210-befb-49fa-8a0c-046808d999ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:09 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-3b40a7ba-2ea7-439e-8c87-93227c47ae97 tempest-CreateVolumesFromImageTest-469033091 None] Volume volume-62fba585-64c1-4d4f-ad3f-005ea8592d19 (62fba585-64c1-4d4f-ad3f-005ea8592d19): created successfully Jun 23 16:53:09 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-3b40a7ba-2ea7-439e-8c87-93227c47ae97 tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d92f210-befb-49fa-8a0c-046808d999ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:09 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-3b40a7ba-2ea7-439e-8c87-93227c47ae97 tempest-CreateVolumesFromImageTest-469033091 None] Flow 'volume_create_manager' (47d79f72-e87e-4603-8a5a-cb70a585cc2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:53:09 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-3b40a7ba-2ea7-439e-8c87-93227c47ae97 tempest-CreateVolumesFromImageTest-469033091 None] Created volume successfully. Jun 23 16:53:09 devstack sudo[114704]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-63173cea-138c-4b7c-a3e8-c4a89fd9c08b tempest-CreateVolumesFromImageTest-469033091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c979d347-7761-438e-9908-ed5e73424122 1073741824" returned: 0 in 0.856s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-63173cea-138c-4b7c-a3e8-c4a89fd9c08b tempest-CreateVolumesFromImageTest-469033091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c979d347-7761-438e-9908-ed5e73424122 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:09 devstack sudo[114711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c979d347-7761-438e-9908-ed5e73424122 Jun 23 16:53:09 devstack sudo[114711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:10 devstack sudo[114711]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-63173cea-138c-4b7c-a3e8-c4a89fd9c08b tempest-CreateVolumesFromImageTest-469033091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c979d347-7761-438e-9908-ed5e73424122" returned: 0 in 0.627s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:10 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-63173cea-138c-4b7c-a3e8-c4a89fd9c08b tempest-CreateVolumesFromImageTest-469033091 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:53:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-63173cea-138c-4b7c-a3e8-c4a89fd9c08b tempest-CreateVolumesFromImageTest-469033091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-bb9fdfa0-f684-4d2a-9887-982890885ec0 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.153s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:10 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-bb9fdfa0-f684-4d2a-9887-982890885ec0 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:53:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-713143592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f73a7a9a-91c5-471e-b47e-73e08da6f71f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b528545668e4fa4ac97eb755ab9aed1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:53:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:53:01Z,use_quota=True,user_id='09a59c4979074af98de31da93f522cc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:53:10 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-bb9fdfa0-f684-4d2a-9887-982890885ec0 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Creating volume f73a7a9a-91c5-471e-b47e-73e08da6f71f {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:53:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-bb9fdfa0-f684-4d2a-9887-982890885ec0 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:53:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-bb9fdfa0-f684-4d2a-9887-982890885ec0 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:10 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-bb9fdfa0-f684-4d2a-9887-982890885ec0 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:53:10 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-bb9fdfa0-f684-4d2a-9887-982890885ec0 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:53:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-bb9fdfa0-f684-4d2a-9887-982890885ec0 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:10 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-bb9fdfa0-f684-4d2a-9887-982890885ec0 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:53:10 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-bb9fdfa0-f684-4d2a-9887-982890885ec0 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:53:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-bb9fdfa0-f684-4d2a-9887-982890885ec0 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f73a7a9a-91c5-471e-b47e-73e08da6f71f 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:10 devstack sudo[114714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f73a7a9a-91c5-471e-b47e-73e08da6f71f 1073741824 Jun 23 16:53:10 devstack sudo[114714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-63173cea-138c-4b7c-a3e8-c4a89fd9c08b tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45cdadd6-af0d-4ea6-8f14-f81a8747ed7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c979d347-7761-438e-9908-ed5e73424122', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-63173cea-138c-4b7c-a3e8-c4a89fd9c08b tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd4e136b-d992-4ed3-b0cb-90588d698ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:10 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-63173cea-138c-4b7c-a3e8-c4a89fd9c08b tempest-CreateVolumesFromImageTest-469033091 None] Volume volume-c979d347-7761-438e-9908-ed5e73424122 (c979d347-7761-438e-9908-ed5e73424122): created successfully Jun 23 16:53:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-63173cea-138c-4b7c-a3e8-c4a89fd9c08b tempest-CreateVolumesFromImageTest-469033091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd4e136b-d992-4ed3-b0cb-90588d698ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-63173cea-138c-4b7c-a3e8-c4a89fd9c08b tempest-CreateVolumesFromImageTest-469033091 None] Flow 'volume_create_manager' (0cf64b87-0349-4f97-9f55-0909db2b3f14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:53:10 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-63173cea-138c-4b7c-a3e8-c4a89fd9c08b tempest-CreateVolumesFromImageTest-469033091 None] Created volume successfully. Jun 23 16:53:10 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e9382afe-d435-4095-953d-a1d92a19c0f1 tempest-CreateVolumesFromImageTest-469033091 None] Acquiring lock "cinder-c979d347-7761-438e-9908-ed5e73424122-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:53:10 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e9382afe-d435-4095-953d-a1d92a19c0f1 tempest-CreateVolumesFromImageTest-469033091 None] Lock "cinder-c979d347-7761-438e-9908-ed5e73424122-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:53:11 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e9382afe-d435-4095-953d-a1d92a19c0f1 tempest-CreateVolumesFromImageTest-469033091 None] Acquiring lock "cinder-quobyte-c979d347-7761-438e-9908-ed5e73424122" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:53:11 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e9382afe-d435-4095-953d-a1d92a19c0f1 tempest-CreateVolumesFromImageTest-469033091 None] Lock "cinder-quobyte-c979d347-7761-438e-9908-ed5e73424122" acquired by "delete_volume" :: waited 0.020s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:53:11 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba4fa7e-3339-445a-b3a2-106e39a2c5bb]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:53:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e9382afe-d435-4095-953d-a1d92a19c0f1 tempest-CreateVolumesFromImageTest-469033091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c979d347-7761-438e-9908-ed5e73424122 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:11 devstack sudo[114716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c979d347-7761-438e-9908-ed5e73424122 Jun 23 16:53:11 devstack sudo[114716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:11 devstack sudo[114714]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-bb9fdfa0-f684-4d2a-9887-982890885ec0 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f73a7a9a-91c5-471e-b47e-73e08da6f71f 1073741824" returned: 0 in 0.883s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-bb9fdfa0-f684-4d2a-9887-982890885ec0 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f73a7a9a-91c5-471e-b47e-73e08da6f71f {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:11 devstack sudo[114721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f73a7a9a-91c5-471e-b47e-73e08da6f71f Jun 23 16:53:11 devstack sudo[114721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:11 devstack sudo[114716]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e9382afe-d435-4095-953d-a1d92a19c0f1 tempest-CreateVolumesFromImageTest-469033091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c979d347-7761-438e-9908-ed5e73424122" returned: 0 in 0.792s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e9382afe-d435-4095-953d-a1d92a19c0f1 tempest-CreateVolumesFromImageTest-469033091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c979d347-7761-438e-9908-ed5e73424122 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:11 devstack sudo[114726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c979d347-7761-438e-9908-ed5e73424122 Jun 23 16:53:11 devstack sudo[114726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:12 devstack sudo[114721]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-bb9fdfa0-f684-4d2a-9887-982890885ec0 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f73a7a9a-91c5-471e-b47e-73e08da6f71f" returned: 0 in 0.655s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:12 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-bb9fdfa0-f684-4d2a-9887-982890885ec0 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] <== create_volume: return (1578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:53:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-bb9fdfa0-f684-4d2a-9887-982890885ec0 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-fc864993-1343-4c30-ab99-188758168806 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.327s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:12 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-fc864993-1343-4c30-ab99-188758168806 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:53:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-737909145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ebac3ba-0f59-4777-8ab0-a402e6b19a6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b528545668e4fa4ac97eb755ab9aed1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:53:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:53:02Z,use_quota=True,user_id='09a59c4979074af98de31da93f522cc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:53:12 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-fc864993-1343-4c30-ab99-188758168806 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Creating volume 8ebac3ba-0f59-4777-8ab0-a402e6b19a6b {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:53:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-fc864993-1343-4c30-ab99-188758168806 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:53:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-fc864993-1343-4c30-ab99-188758168806 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:12 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-fc864993-1343-4c30-ab99-188758168806 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:53:12 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-fc864993-1343-4c30-ab99-188758168806 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:53:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-fc864993-1343-4c30-ab99-188758168806 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:12 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-fc864993-1343-4c30-ab99-188758168806 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:53:12 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-fc864993-1343-4c30-ab99-188758168806 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:53:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-fc864993-1343-4c30-ab99-188758168806 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-8ebac3ba-0f59-4777-8ab0-a402e6b19a6b 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:12 devstack sudo[114730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-8ebac3ba-0f59-4777-8ab0-a402e6b19a6b 1073741824 Jun 23 16:53:12 devstack sudo[114730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:12 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bb9fdfa0-f684-4d2a-9887-982890885ec0 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dc2f37c-4049-447f-8efb-ba80f432e6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f73a7a9a-91c5-471e-b47e-73e08da6f71f', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:12 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bb9fdfa0-f684-4d2a-9887-982890885ec0 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1fcb990-f3a4-4dbe-aed7-139f03929277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:12 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-bb9fdfa0-f684-4d2a-9887-982890885ec0 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Volume volume-f73a7a9a-91c5-471e-b47e-73e08da6f71f (f73a7a9a-91c5-471e-b47e-73e08da6f71f): created successfully Jun 23 16:53:12 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bb9fdfa0-f684-4d2a-9887-982890885ec0 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1fcb990-f3a4-4dbe-aed7-139f03929277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:12 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-bb9fdfa0-f684-4d2a-9887-982890885ec0 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Flow 'volume_create_manager' (947beba8-3e65-4dc6-b889-8401ae9852cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:53:12 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-bb9fdfa0-f684-4d2a-9887-982890885ec0 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Created volume successfully. Jun 23 16:53:12 devstack sudo[114726]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e9382afe-d435-4095-953d-a1d92a19c0f1 tempest-CreateVolumesFromImageTest-469033091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-c979d347-7761-438e-9908-ed5e73424122" returned: 0 in 0.682s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:12 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e9382afe-d435-4095-953d-a1d92a19c0f1 tempest-CreateVolumesFromImageTest-469033091 None] Lock "cinder-quobyte-c979d347-7761-438e-9908-ed5e73424122" released by "delete_volume" :: held 1.521s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:53:12 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-e9382afe-d435-4095-953d-a1d92a19c0f1 tempest-CreateVolumesFromImageTest-469033091 None] Created reservations ['5b914ac1-7990-4cb1-903a-b12a0f6b9522', 'a2354f3b-b635-4b0b-95e0-1a8e32fcd2ca', '232d4990-f309-44ad-9daa-aa19978334f6', '517b718e-5b38-4574-9a85-f1654ea921f3'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:53:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e9382afe-d435-4095-953d-a1d92a19c0f1 tempest-CreateVolumesFromImageTest-469033091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:53:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e9382afe-d435-4095-953d-a1d92a19c0f1 tempest-CreateVolumesFromImageTest-469033091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:12 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e9382afe-d435-4095-953d-a1d92a19c0f1 tempest-CreateVolumesFromImageTest-469033091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:53:12 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e9382afe-d435-4095-953d-a1d92a19c0f1 tempest-CreateVolumesFromImageTest-469033091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:53:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e9382afe-d435-4095-953d-a1d92a19c0f1 tempest-CreateVolumesFromImageTest-469033091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e9382afe-d435-4095-953d-a1d92a19c0f1 tempest-CreateVolumesFromImageTest-469033091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:12 devstack sudo[114733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:53:12 devstack sudo[114733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:13 devstack sudo[114730]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-fc864993-1343-4c30-ab99-188758168806 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-8ebac3ba-0f59-4777-8ab0-a402e6b19a6b 1073741824" returned: 0 in 0.884s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-fc864993-1343-4c30-ab99-188758168806 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-8ebac3ba-0f59-4777-8ab0-a402e6b19a6b {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:13 devstack sudo[114738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-8ebac3ba-0f59-4777-8ab0-a402e6b19a6b Jun 23 16:53:13 devstack sudo[114738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:13 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-be951ae1-38c2-4d0b-82a1-709eee8ad053 tempest-CreateVolumesFromImageTest-469033091 None] Acquiring lock "cinder-62fba585-64c1-4d4f-ad3f-005ea8592d19-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:53:13 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-be951ae1-38c2-4d0b-82a1-709eee8ad053 tempest-CreateVolumesFromImageTest-469033091 None] Lock "cinder-62fba585-64c1-4d4f-ad3f-005ea8592d19-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:53:13 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-be951ae1-38c2-4d0b-82a1-709eee8ad053 tempest-CreateVolumesFromImageTest-469033091 None] Acquiring lock "cinder-quobyte-62fba585-64c1-4d4f-ad3f-005ea8592d19" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:53:13 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-be951ae1-38c2-4d0b-82a1-709eee8ad053 tempest-CreateVolumesFromImageTest-469033091 None] Lock "cinder-quobyte-62fba585-64c1-4d4f-ad3f-005ea8592d19" acquired by "delete_volume" :: waited 0.024s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:53:13 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd402b4-f4e5-4120-bf3d-d07fdad13429]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:53:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-be951ae1-38c2-4d0b-82a1-709eee8ad053 tempest-CreateVolumesFromImageTest-469033091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-62fba585-64c1-4d4f-ad3f-005ea8592d19 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:13 devstack sudo[114733]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e9382afe-d435-4095-953d-a1d92a19c0f1 tempest-CreateVolumesFromImageTest-469033091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.681s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:13 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-e9382afe-d435-4095-953d-a1d92a19c0f1 tempest-CreateVolumesFromImageTest-469033091 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:53:13 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-e9382afe-d435-4095-953d-a1d92a19c0f1 tempest-CreateVolumesFromImageTest-469033091 None] Deleted volume successfully. Jun 23 16:53:13 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e9382afe-d435-4095-953d-a1d92a19c0f1 tempest-CreateVolumesFromImageTest-469033091 None] Lock "cinder-c979d347-7761-438e-9908-ed5e73424122-delete_volume" released by "delete_volume" :: held 2.425s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:53:13 devstack sudo[114741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-62fba585-64c1-4d4f-ad3f-005ea8592d19 Jun 23 16:53:13 devstack sudo[114741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:13 devstack sudo[114738]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-fc864993-1343-4c30-ab99-188758168806 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-8ebac3ba-0f59-4777-8ab0-a402e6b19a6b" returned: 0 in 0.728s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:13 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-fc864993-1343-4c30-ab99-188758168806 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] <== create_volume: return (1656ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:53:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-fc864993-1343-4c30-ab99-188758168806 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.659s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-79c8973b-3ba9-4c4e-83be-6722b9002372 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.838s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:13 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-79c8973b-3ba9-4c4e-83be-6722b9002372 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1732045601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=228fcf96-a907-4d64-9092-6a7f19c8912d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b528545668e4fa4ac97eb755ab9aed1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:53:03Z,use_quota=True,user_id='09a59c4979074af98de31da93f522cc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:53:13 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-79c8973b-3ba9-4c4e-83be-6722b9002372 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Creating volume 228fcf96-a907-4d64-9092-6a7f19c8912d {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:53:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-79c8973b-3ba9-4c4e-83be-6722b9002372 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:53:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-79c8973b-3ba9-4c4e-83be-6722b9002372 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:13 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-79c8973b-3ba9-4c4e-83be-6722b9002372 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:53:13 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-79c8973b-3ba9-4c4e-83be-6722b9002372 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:53:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-79c8973b-3ba9-4c4e-83be-6722b9002372 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:13 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-79c8973b-3ba9-4c4e-83be-6722b9002372 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:53:13 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-79c8973b-3ba9-4c4e-83be-6722b9002372 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:53:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-79c8973b-3ba9-4c4e-83be-6722b9002372 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-228fcf96-a907-4d64-9092-6a7f19c8912d 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:13 devstack sudo[114744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-228fcf96-a907-4d64-9092-6a7f19c8912d 1073741824 Jun 23 16:53:13 devstack sudo[114744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-fc864993-1343-4c30-ab99-188758168806 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c1870da-7c62-46d4-8c54-857bbbabbb9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ebac3ba-0f59-4777-8ab0-a402e6b19a6b', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-fc864993-1343-4c30-ab99-188758168806 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68d37658-bf4c-496b-b4f2-b3ce6edf3c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:13 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-fc864993-1343-4c30-ab99-188758168806 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Volume volume-8ebac3ba-0f59-4777-8ab0-a402e6b19a6b (8ebac3ba-0f59-4777-8ab0-a402e6b19a6b): created successfully Jun 23 16:53:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-fc864993-1343-4c30-ab99-188758168806 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68d37658-bf4c-496b-b4f2-b3ce6edf3c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:13 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-fc864993-1343-4c30-ab99-188758168806 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Flow 'volume_create_manager' (2041094a-302d-48c1-96d5-bbe39125d487) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:53:13 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-fc864993-1343-4c30-ab99-188758168806 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Created volume successfully. Jun 23 16:53:14 devstack sudo[114741]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-be951ae1-38c2-4d0b-82a1-709eee8ad053 tempest-CreateVolumesFromImageTest-469033091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-62fba585-64c1-4d4f-ad3f-005ea8592d19" returned: 0 in 0.781s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-be951ae1-38c2-4d0b-82a1-709eee8ad053 tempest-CreateVolumesFromImageTest-469033091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-62fba585-64c1-4d4f-ad3f-005ea8592d19 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:14 devstack sudo[114749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-62fba585-64c1-4d4f-ad3f-005ea8592d19 Jun 23 16:53:14 devstack sudo[114749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:14 devstack sudo[114744]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-79c8973b-3ba9-4c4e-83be-6722b9002372 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-228fcf96-a907-4d64-9092-6a7f19c8912d 1073741824" returned: 0 in 0.830s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-79c8973b-3ba9-4c4e-83be-6722b9002372 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-228fcf96-a907-4d64-9092-6a7f19c8912d {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:14 devstack sudo[114757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-228fcf96-a907-4d64-9092-6a7f19c8912d Jun 23 16:53:14 devstack sudo[114757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:14 devstack sudo[114749]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-be951ae1-38c2-4d0b-82a1-709eee8ad053 tempest-CreateVolumesFromImageTest-469033091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-62fba585-64c1-4d4f-ad3f-005ea8592d19" returned: 0 in 0.663s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:14 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-be951ae1-38c2-4d0b-82a1-709eee8ad053 tempest-CreateVolumesFromImageTest-469033091 None] Lock "cinder-quobyte-62fba585-64c1-4d4f-ad3f-005ea8592d19" released by "delete_volume" :: held 1.502s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:53:14 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-be951ae1-38c2-4d0b-82a1-709eee8ad053 tempest-CreateVolumesFromImageTest-469033091 None] Created reservations ['2943f7b2-05dd-4270-b68d-f01e787f1484', 'f8193b8d-9c16-42b4-b882-8530af85611e', '35394e8c-7e9f-4ba0-81a8-b2d22bcd44b9', '2c09aee0-9a44-4887-b15d-ccc1b0f10737'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:53:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-be951ae1-38c2-4d0b-82a1-709eee8ad053 tempest-CreateVolumesFromImageTest-469033091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:53:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-be951ae1-38c2-4d0b-82a1-709eee8ad053 tempest-CreateVolumesFromImageTest-469033091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:14 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-be951ae1-38c2-4d0b-82a1-709eee8ad053 tempest-CreateVolumesFromImageTest-469033091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:53:14 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-be951ae1-38c2-4d0b-82a1-709eee8ad053 tempest-CreateVolumesFromImageTest-469033091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:53:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-be951ae1-38c2-4d0b-82a1-709eee8ad053 tempest-CreateVolumesFromImageTest-469033091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-be951ae1-38c2-4d0b-82a1-709eee8ad053 tempest-CreateVolumesFromImageTest-469033091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:14 devstack sudo[114759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:53:14 devstack sudo[114759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:15 devstack sudo[114757]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-79c8973b-3ba9-4c4e-83be-6722b9002372 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-228fcf96-a907-4d64-9092-6a7f19c8912d" returned: 0 in 0.670s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:15 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-79c8973b-3ba9-4c4e-83be-6722b9002372 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:53:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-79c8973b-3ba9-4c4e-83be-6722b9002372 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.551s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-3dfdf329-d1c7-4b43-b99d-ecd297a34831 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.074s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:15 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-3dfdf329-d1c7-4b43-b99d-ecd297a34831 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1855487664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3180b269-33c6-43e4-af34-83cd9dce1ad4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b528545668e4fa4ac97eb755ab9aed1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:53:03Z,use_quota=True,user_id='09a59c4979074af98de31da93f522cc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:53:15 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-3dfdf329-d1c7-4b43-b99d-ecd297a34831 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Creating volume 3180b269-33c6-43e4-af34-83cd9dce1ad4 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:53:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-3dfdf329-d1c7-4b43-b99d-ecd297a34831 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:53:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-3dfdf329-d1c7-4b43-b99d-ecd297a34831 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:15 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-3dfdf329-d1c7-4b43-b99d-ecd297a34831 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:53:15 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-3dfdf329-d1c7-4b43-b99d-ecd297a34831 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:53:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-3dfdf329-d1c7-4b43-b99d-ecd297a34831 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:15 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-3dfdf329-d1c7-4b43-b99d-ecd297a34831 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:53:15 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-3dfdf329-d1c7-4b43-b99d-ecd297a34831 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:53:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-3dfdf329-d1c7-4b43-b99d-ecd297a34831 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3180b269-33c6-43e4-af34-83cd9dce1ad4 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:15 devstack sudo[114762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3180b269-33c6-43e4-af34-83cd9dce1ad4 1073741824 Jun 23 16:53:15 devstack sudo[114762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:15 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-79c8973b-3ba9-4c4e-83be-6722b9002372 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2bab46f-7bcd-40cc-bd5a-639bcae63455) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-228fcf96-a907-4d64-9092-6a7f19c8912d', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:15 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-79c8973b-3ba9-4c4e-83be-6722b9002372 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a2514d6-c8f0-442f-ae36-01a77fa3a377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:15 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-79c8973b-3ba9-4c4e-83be-6722b9002372 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Volume volume-228fcf96-a907-4d64-9092-6a7f19c8912d (228fcf96-a907-4d64-9092-6a7f19c8912d): created successfully Jun 23 16:53:15 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-79c8973b-3ba9-4c4e-83be-6722b9002372 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a2514d6-c8f0-442f-ae36-01a77fa3a377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:15 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-79c8973b-3ba9-4c4e-83be-6722b9002372 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Flow 'volume_create_manager' (2f7aa323-a0af-46c1-bf4e-abd972c85048) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:53:15 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-59a9dd42-4ebe-4b14-bb3a-5ef1ae17960d tempest-CreateVolumesFromImageTest-469033091 None] Acquiring lock "cinder-6e201ec3-3760-483e-bba8-8cb90bdcf68e-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:53:15 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-79c8973b-3ba9-4c4e-83be-6722b9002372 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Created volume successfully. Jun 23 16:53:15 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-59a9dd42-4ebe-4b14-bb3a-5ef1ae17960d tempest-CreateVolumesFromImageTest-469033091 None] Lock "cinder-6e201ec3-3760-483e-bba8-8cb90bdcf68e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:53:15 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-59a9dd42-4ebe-4b14-bb3a-5ef1ae17960d tempest-CreateVolumesFromImageTest-469033091 None] Acquiring lock "cinder-quobyte-6e201ec3-3760-483e-bba8-8cb90bdcf68e" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:53:15 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-59a9dd42-4ebe-4b14-bb3a-5ef1ae17960d tempest-CreateVolumesFromImageTest-469033091 None] Lock "cinder-quobyte-6e201ec3-3760-483e-bba8-8cb90bdcf68e" acquired by "delete_volume" :: waited 0.017s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:53:15 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ead4ed5-d838-4ac8-8730-1cb2bf929fc2]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:53:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-59a9dd42-4ebe-4b14-bb3a-5ef1ae17960d tempest-CreateVolumesFromImageTest-469033091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6e201ec3-3760-483e-bba8-8cb90bdcf68e {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:15 devstack sudo[114759]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-be951ae1-38c2-4d0b-82a1-709eee8ad053 tempest-CreateVolumesFromImageTest-469033091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.753s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:15 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-be951ae1-38c2-4d0b-82a1-709eee8ad053 tempest-CreateVolumesFromImageTest-469033091 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:53:15 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-be951ae1-38c2-4d0b-82a1-709eee8ad053 tempest-CreateVolumesFromImageTest-469033091 None] Deleted volume successfully. Jun 23 16:53:15 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-be951ae1-38c2-4d0b-82a1-709eee8ad053 tempest-CreateVolumesFromImageTest-469033091 None] Lock "cinder-62fba585-64c1-4d4f-ad3f-005ea8592d19-delete_volume" released by "delete_volume" :: held 2.521s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:53:15 devstack sudo[114765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6e201ec3-3760-483e-bba8-8cb90bdcf68e Jun 23 16:53:15 devstack sudo[114765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:16 devstack sudo[114762]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-3dfdf329-d1c7-4b43-b99d-ecd297a34831 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3180b269-33c6-43e4-af34-83cd9dce1ad4 1073741824" returned: 0 in 0.941s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-3dfdf329-d1c7-4b43-b99d-ecd297a34831 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3180b269-33c6-43e4-af34-83cd9dce1ad4 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:16 devstack sudo[114774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3180b269-33c6-43e4-af34-83cd9dce1ad4 Jun 23 16:53:16 devstack sudo[114774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:16 devstack sudo[114765]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-59a9dd42-4ebe-4b14-bb3a-5ef1ae17960d tempest-CreateVolumesFromImageTest-469033091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6e201ec3-3760-483e-bba8-8cb90bdcf68e" returned: 0 in 0.857s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-59a9dd42-4ebe-4b14-bb3a-5ef1ae17960d tempest-CreateVolumesFromImageTest-469033091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6e201ec3-3760-483e-bba8-8cb90bdcf68e {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:16 devstack sudo[114776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6e201ec3-3760-483e-bba8-8cb90bdcf68e Jun 23 16:53:16 devstack sudo[114776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:17 devstack sudo[114774]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-3dfdf329-d1c7-4b43-b99d-ecd297a34831 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3180b269-33c6-43e4-af34-83cd9dce1ad4" returned: 0 in 0.654s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:17 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-3dfdf329-d1c7-4b43-b99d-ecd297a34831 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:53:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-3dfdf329-d1c7-4b43-b99d-ecd297a34831 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.651s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-9cf9f9bd-43d3-424c-943e-261708b09433 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.591s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:17 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-9cf9f9bd-43d3-424c-943e-261708b09433 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1410516497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3827a83-d0c8-4c56-9aca-5ccd0abe3f25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b528545668e4fa4ac97eb755ab9aed1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:53:03Z,use_quota=True,user_id='09a59c4979074af98de31da93f522cc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:53:17 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-9cf9f9bd-43d3-424c-943e-261708b09433 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Creating volume e3827a83-d0c8-4c56-9aca-5ccd0abe3f25 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:53:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-9cf9f9bd-43d3-424c-943e-261708b09433 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:53:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-9cf9f9bd-43d3-424c-943e-261708b09433 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:17 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-9cf9f9bd-43d3-424c-943e-261708b09433 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:53:17 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-9cf9f9bd-43d3-424c-943e-261708b09433 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:53:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-9cf9f9bd-43d3-424c-943e-261708b09433 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:17 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-9cf9f9bd-43d3-424c-943e-261708b09433 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:53:17 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-9cf9f9bd-43d3-424c-943e-261708b09433 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:53:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-9cf9f9bd-43d3-424c-943e-261708b09433 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3827a83-d0c8-4c56-9aca-5ccd0abe3f25 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:17 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-3dfdf329-d1c7-4b43-b99d-ecd297a34831 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01873673-791f-4203-a4f7-e9e24a5ff2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3180b269-33c6-43e4-af34-83cd9dce1ad4', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:17 devstack sudo[114780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3827a83-d0c8-4c56-9aca-5ccd0abe3f25 1073741824 Jun 23 16:53:17 devstack sudo[114780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:17 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-3dfdf329-d1c7-4b43-b99d-ecd297a34831 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ab961c6-2203-4349-8697-052fb3b60c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:17 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-3dfdf329-d1c7-4b43-b99d-ecd297a34831 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Volume volume-3180b269-33c6-43e4-af34-83cd9dce1ad4 (3180b269-33c6-43e4-af34-83cd9dce1ad4): created successfully Jun 23 16:53:17 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-3dfdf329-d1c7-4b43-b99d-ecd297a34831 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ab961c6-2203-4349-8697-052fb3b60c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:17 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-3dfdf329-d1c7-4b43-b99d-ecd297a34831 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Flow 'volume_create_manager' (2d07f03a-b8af-4b43-b703-46215c2b0a66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:53:17 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-3dfdf329-d1c7-4b43-b99d-ecd297a34831 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Created volume successfully. Jun 23 16:53:17 devstack sudo[114776]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-59a9dd42-4ebe-4b14-bb3a-5ef1ae17960d tempest-CreateVolumesFromImageTest-469033091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-6e201ec3-3760-483e-bba8-8cb90bdcf68e" returned: 0 in 0.676s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:17 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-59a9dd42-4ebe-4b14-bb3a-5ef1ae17960d tempest-CreateVolumesFromImageTest-469033091 None] Lock "cinder-quobyte-6e201ec3-3760-483e-bba8-8cb90bdcf68e" released by "delete_volume" :: held 1.594s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:53:17 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-59a9dd42-4ebe-4b14-bb3a-5ef1ae17960d tempest-CreateVolumesFromImageTest-469033091 None] Created reservations ['e1c61f0b-d396-4819-9fc3-20e9b8707959', 'd3d14390-829a-4abc-bb2f-c54a54da18ae', 'f20051af-b7e8-4826-a7d8-08d3a5413499', 'e5e9f052-ce2e-4741-8083-c287440689a5'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:53:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-59a9dd42-4ebe-4b14-bb3a-5ef1ae17960d tempest-CreateVolumesFromImageTest-469033091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:53:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-59a9dd42-4ebe-4b14-bb3a-5ef1ae17960d tempest-CreateVolumesFromImageTest-469033091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:17 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-59a9dd42-4ebe-4b14-bb3a-5ef1ae17960d tempest-CreateVolumesFromImageTest-469033091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:53:17 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-59a9dd42-4ebe-4b14-bb3a-5ef1ae17960d tempest-CreateVolumesFromImageTest-469033091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:53:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-59a9dd42-4ebe-4b14-bb3a-5ef1ae17960d tempest-CreateVolumesFromImageTest-469033091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-59a9dd42-4ebe-4b14-bb3a-5ef1ae17960d tempest-CreateVolumesFromImageTest-469033091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:17 devstack sudo[114782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:53:17 devstack sudo[114782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:17 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e271ce67-d0fe-4f54-a3cd-20b77ad4e2bf tempest-CreateVolumesFromImageTest-469033091 None] Acquiring lock "cinder-5b8198d8-7a57-4e77-9027-0978e6ab55da-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:53:17 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e271ce67-d0fe-4f54-a3cd-20b77ad4e2bf tempest-CreateVolumesFromImageTest-469033091 None] Lock "cinder-5b8198d8-7a57-4e77-9027-0978e6ab55da-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:53:17 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e271ce67-d0fe-4f54-a3cd-20b77ad4e2bf tempest-CreateVolumesFromImageTest-469033091 None] Acquiring lock "cinder-quobyte-5b8198d8-7a57-4e77-9027-0978e6ab55da" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:53:17 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e271ce67-d0fe-4f54-a3cd-20b77ad4e2bf tempest-CreateVolumesFromImageTest-469033091 None] Lock "cinder-quobyte-5b8198d8-7a57-4e77-9027-0978e6ab55da" acquired by "delete_volume" :: waited 0.021s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:53:17 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba29dbf6-dd49-4b8f-8e59-0d5d969d638c]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:53:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e271ce67-d0fe-4f54-a3cd-20b77ad4e2bf tempest-CreateVolumesFromImageTest-469033091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5b8198d8-7a57-4e77-9027-0978e6ab55da {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:17 devstack sudo[114788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5b8198d8-7a57-4e77-9027-0978e6ab55da Jun 23 16:53:17 devstack sudo[114788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:18 devstack sudo[114780]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:18 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-9cf9f9bd-43d3-424c-943e-261708b09433 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3827a83-d0c8-4c56-9aca-5ccd0abe3f25 1073741824" returned: 0 in 0.995s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:18 devstack sudo[114782]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:18 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-59a9dd42-4ebe-4b14-bb3a-5ef1ae17960d tempest-CreateVolumesFromImageTest-469033091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.721s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:18 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-59a9dd42-4ebe-4b14-bb3a-5ef1ae17960d tempest-CreateVolumesFromImageTest-469033091 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:53:18 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-59a9dd42-4ebe-4b14-bb3a-5ef1ae17960d tempest-CreateVolumesFromImageTest-469033091 None] Deleted volume successfully. Jun 23 16:53:18 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-9cf9f9bd-43d3-424c-943e-261708b09433 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3827a83-d0c8-4c56-9aca-5ccd0abe3f25 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:18 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-59a9dd42-4ebe-4b14-bb3a-5ef1ae17960d tempest-CreateVolumesFromImageTest-469033091 None] Lock "cinder-6e201ec3-3760-483e-bba8-8cb90bdcf68e-delete_volume" released by "delete_volume" :: held 2.573s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:53:18 devstack sudo[114791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3827a83-d0c8-4c56-9aca-5ccd0abe3f25 Jun 23 16:53:18 devstack sudo[114791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:18 devstack sudo[114788]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:18 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e271ce67-d0fe-4f54-a3cd-20b77ad4e2bf tempest-CreateVolumesFromImageTest-469033091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5b8198d8-7a57-4e77-9027-0978e6ab55da" returned: 0 in 0.836s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:18 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e271ce67-d0fe-4f54-a3cd-20b77ad4e2bf tempest-CreateVolumesFromImageTest-469033091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5b8198d8-7a57-4e77-9027-0978e6ab55da {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:18 devstack sudo[114791]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:18 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-9cf9f9bd-43d3-424c-943e-261708b09433 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3827a83-d0c8-4c56-9aca-5ccd0abe3f25" returned: 0 in 0.630s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:18 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-9cf9f9bd-43d3-424c-943e-261708b09433 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] <== create_volume: return (1678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:53:18 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-9cf9f9bd-43d3-424c-943e-261708b09433 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.681s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:18 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b18ebf1b-9c8d-49a7-9ed1-101afbc8b7f8 tempest-VolumeDependencyTests-488053045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 15.236s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:18 devstack sudo[114797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5b8198d8-7a57-4e77-9027-0978e6ab55da Jun 23 16:53:18 devstack sudo[114797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:18 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-9cf9f9bd-43d3-424c-943e-261708b09433 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9451f8aa-159e-407e-ab4d-81fd192aa8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3827a83-d0c8-4c56-9aca-5ccd0abe3f25', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:18 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-9cf9f9bd-43d3-424c-943e-261708b09433 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43c0c5eb-c119-45e4-8de3-8ea757ce5b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:18 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-b18ebf1b-9c8d-49a7-9ed1-101afbc8b7f8 tempest-VolumeDependencyTests-488053045 None] Creating offline snapshot eff209fa-ebe8-4460-aea3-2dd3517931f3 of volume 9c19b71c-89d4-42e0-920d-b8cde74a3f0c {{(pid=93788) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:53:18 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bd27e9-34b2-433e-a125-811386c4a228]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:53:18 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b18ebf1b-9c8d-49a7-9ed1-101afbc8b7f8 tempest-VolumeDependencyTests-488053045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:18 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-9cf9f9bd-43d3-424c-943e-261708b09433 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Volume volume-e3827a83-d0c8-4c56-9aca-5ccd0abe3f25 (e3827a83-d0c8-4c56-9aca-5ccd0abe3f25): created successfully Jun 23 16:53:18 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-9cf9f9bd-43d3-424c-943e-261708b09433 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43c0c5eb-c119-45e4-8de3-8ea757ce5b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:18 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-9cf9f9bd-43d3-424c-943e-261708b09433 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Flow 'volume_create_manager' (cefef64f-3667-412b-924f-e825eddee706) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:53:18 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-9cf9f9bd-43d3-424c-943e-261708b09433 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Created volume successfully. Jun 23 16:53:18 devstack sudo[114799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c Jun 23 16:53:18 devstack sudo[114799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:19 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d6f2755f-739b-4348-a297-ddb192bff255 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Acquiring lock "cinder-e3827a83-d0c8-4c56-9aca-5ccd0abe3f25-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:53:19 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d6f2755f-739b-4348-a297-ddb192bff255 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "cinder-e3827a83-d0c8-4c56-9aca-5ccd0abe3f25-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:53:19 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d6f2755f-739b-4348-a297-ddb192bff255 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Acquiring lock "cinder-quobyte-e3827a83-d0c8-4c56-9aca-5ccd0abe3f25" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:53:19 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d6f2755f-739b-4348-a297-ddb192bff255 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "cinder-quobyte-e3827a83-d0c8-4c56-9aca-5ccd0abe3f25" acquired by "delete_volume" :: waited 0.023s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:53:19 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f0a4e2-8a97-4e83-856e-67c4c345b411]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:53:19 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d6f2755f-739b-4348-a297-ddb192bff255 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3827a83-d0c8-4c56-9aca-5ccd0abe3f25 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:19 devstack sudo[114797]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:19 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e271ce67-d0fe-4f54-a3cd-20b77ad4e2bf tempest-CreateVolumesFromImageTest-469033091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5b8198d8-7a57-4e77-9027-0978e6ab55da" returned: 0 in 0.712s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:19 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e271ce67-d0fe-4f54-a3cd-20b77ad4e2bf tempest-CreateVolumesFromImageTest-469033091 None] Lock "cinder-quobyte-5b8198d8-7a57-4e77-9027-0978e6ab55da" released by "delete_volume" :: held 1.597s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:53:19 devstack sudo[114803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3827a83-d0c8-4c56-9aca-5ccd0abe3f25 Jun 23 16:53:19 devstack sudo[114803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:19 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-e271ce67-d0fe-4f54-a3cd-20b77ad4e2bf tempest-CreateVolumesFromImageTest-469033091 None] Created reservations ['c5fe8e0b-ee3a-4d21-b4e8-cd2fc16d4809', '1bcc5edc-7b1f-4884-9dc0-dde1ab29a58e', '6cb9fd08-4eb7-4add-af7f-2aa440257b7b', '87708627-d9e2-4298-a952-04d06c86f927'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:53:19 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e271ce67-d0fe-4f54-a3cd-20b77ad4e2bf tempest-CreateVolumesFromImageTest-469033091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:53:19 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e271ce67-d0fe-4f54-a3cd-20b77ad4e2bf tempest-CreateVolumesFromImageTest-469033091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:19 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e271ce67-d0fe-4f54-a3cd-20b77ad4e2bf tempest-CreateVolumesFromImageTest-469033091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:53:19 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e271ce67-d0fe-4f54-a3cd-20b77ad4e2bf tempest-CreateVolumesFromImageTest-469033091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:53:19 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e271ce67-d0fe-4f54-a3cd-20b77ad4e2bf tempest-CreateVolumesFromImageTest-469033091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:19 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e271ce67-d0fe-4f54-a3cd-20b77ad4e2bf tempest-CreateVolumesFromImageTest-469033091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:19 devstack sudo[114809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:53:19 devstack sudo[114809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:19 devstack sudo[114799]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:19 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b18ebf1b-9c8d-49a7-9ed1-101afbc8b7f8 tempest-VolumeDependencyTests-488053045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c" returned: 0 in 0.865s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:19 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b18ebf1b-9c8d-49a7-9ed1-101afbc8b7f8 tempest-VolumeDependencyTests-488053045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c.eff209fa-ebe8-4460-aea3-2dd3517931f3 1G {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:19 devstack sudo[114811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c.eff209fa-ebe8-4460-aea3-2dd3517931f3 1G Jun 23 16:53:19 devstack sudo[114811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:19 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5b11ac0e-d6f6-40e3-a8b4-56158dc728b2 tempest-CreateVolumesFromImageTest-469033091 None] Acquiring lock "cinder-4615d1ba-5988-4ef0-bbac-226abeda49f3-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:53:20 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5b11ac0e-d6f6-40e3-a8b4-56158dc728b2 tempest-CreateVolumesFromImageTest-469033091 None] Lock "cinder-4615d1ba-5988-4ef0-bbac-226abeda49f3-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:53:20 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5b11ac0e-d6f6-40e3-a8b4-56158dc728b2 tempest-CreateVolumesFromImageTest-469033091 None] Acquiring lock "cinder-quobyte-4615d1ba-5988-4ef0-bbac-226abeda49f3" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:53:20 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5b11ac0e-d6f6-40e3-a8b4-56158dc728b2 tempest-CreateVolumesFromImageTest-469033091 None] Lock "cinder-quobyte-4615d1ba-5988-4ef0-bbac-226abeda49f3" acquired by "delete_volume" :: waited 0.019s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:53:20 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[882e0604-ded9-4473-80b9-5859ffc5a75e]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:53:20 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5b11ac0e-d6f6-40e3-a8b4-56158dc728b2 tempest-CreateVolumesFromImageTest-469033091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4615d1ba-5988-4ef0-bbac-226abeda49f3 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:20 devstack sudo[114816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4615d1ba-5988-4ef0-bbac-226abeda49f3 Jun 23 16:53:20 devstack sudo[114816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:20 devstack sudo[114809]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:20 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e271ce67-d0fe-4f54-a3cd-20b77ad4e2bf tempest-CreateVolumesFromImageTest-469033091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.725s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:20 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-e271ce67-d0fe-4f54-a3cd-20b77ad4e2bf tempest-CreateVolumesFromImageTest-469033091 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:53:20 devstack sudo[114803]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:20 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-e271ce67-d0fe-4f54-a3cd-20b77ad4e2bf tempest-CreateVolumesFromImageTest-469033091 None] Deleted volume successfully. Jun 23 16:53:20 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d6f2755f-739b-4348-a297-ddb192bff255 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3827a83-d0c8-4c56-9aca-5ccd0abe3f25" returned: 0 in 0.983s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:20 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d6f2755f-739b-4348-a297-ddb192bff255 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3827a83-d0c8-4c56-9aca-5ccd0abe3f25 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:20 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e271ce67-d0fe-4f54-a3cd-20b77ad4e2bf tempest-CreateVolumesFromImageTest-469033091 None] Lock "cinder-5b8198d8-7a57-4e77-9027-0978e6ab55da-delete_volume" released by "delete_volume" :: held 2.580s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:53:20 devstack sudo[114822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3827a83-d0c8-4c56-9aca-5ccd0abe3f25 Jun 23 16:53:20 devstack sudo[114822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:20 devstack sudo[114811]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:20 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b18ebf1b-9c8d-49a7-9ed1-101afbc8b7f8 tempest-VolumeDependencyTests-488053045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c.eff209fa-ebe8-4460-aea3-2dd3517931f3 1G" returned: 0 in 0.953s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:20 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b18ebf1b-9c8d-49a7-9ed1-101afbc8b7f8 tempest-VolumeDependencyTests-488053045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c.eff209fa-ebe8-4460-aea3-2dd3517931f3 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:20 devstack sudo[114825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c.eff209fa-ebe8-4460-aea3-2dd3517931f3 Jun 23 16:53:20 devstack sudo[114825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:21 devstack sudo[114822]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d6f2755f-739b-4348-a297-ddb192bff255 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e3827a83-d0c8-4c56-9aca-5ccd0abe3f25" returned: 0 in 0.760s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:21 devstack sudo[114816]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5b11ac0e-d6f6-40e3-a8b4-56158dc728b2 tempest-CreateVolumesFromImageTest-469033091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4615d1ba-5988-4ef0-bbac-226abeda49f3" returned: 0 in 0.960s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5b11ac0e-d6f6-40e3-a8b4-56158dc728b2 tempest-CreateVolumesFromImageTest-469033091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4615d1ba-5988-4ef0-bbac-226abeda49f3 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:21 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d6f2755f-739b-4348-a297-ddb192bff255 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "cinder-quobyte-e3827a83-d0c8-4c56-9aca-5ccd0abe3f25" released by "delete_volume" :: held 1.827s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:53:21 devstack sudo[114831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4615d1ba-5988-4ef0-bbac-226abeda49f3 Jun 23 16:53:21 devstack sudo[114831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:21 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-d6f2755f-739b-4348-a297-ddb192bff255 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Created reservations ['243b3716-ce7d-4626-952f-08874506ec00', 'be284e5c-e389-40b8-b090-3903ce91a638', 'b00ee3fb-a4c4-4a5b-b655-9302ec087bf9', '8ca77fda-4036-4283-97e0-e0451db4d99d'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:53:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d6f2755f-739b-4348-a297-ddb192bff255 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:53:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d6f2755f-739b-4348-a297-ddb192bff255 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:21 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-d6f2755f-739b-4348-a297-ddb192bff255 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:53:21 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-d6f2755f-739b-4348-a297-ddb192bff255 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:53:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d6f2755f-739b-4348-a297-ddb192bff255 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d6f2755f-739b-4348-a297-ddb192bff255 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:21 devstack sudo[114836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:53:21 devstack sudo[114836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:21 devstack sudo[114825]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b18ebf1b-9c8d-49a7-9ed1-101afbc8b7f8 tempest-VolumeDependencyTests-488053045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c.eff209fa-ebe8-4460-aea3-2dd3517931f3" returned: 0 in 0.738s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:21 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-b18ebf1b-9c8d-49a7-9ed1-101afbc8b7f8 tempest-VolumeDependencyTests-488053045 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c.eff209fa-ebe8-4460-aea3-2dd3517931f3 is being set with open permissions: ugo+rw Jun 23 16:53:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b18ebf1b-9c8d-49a7-9ed1-101afbc8b7f8 tempest-VolumeDependencyTests-488053045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c.eff209fa-ebe8-4460-aea3-2dd3517931f3 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:21 devstack sudo[114838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c.eff209fa-ebe8-4460-aea3-2dd3517931f3 Jun 23 16:53:21 devstack sudo[114838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:21 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-7fa5cdf7-c6fa-47c9-8072-4bc6fba381a8 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Acquiring lock "cinder-3180b269-33c6-43e4-af34-83cd9dce1ad4-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:53:21 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-7fa5cdf7-c6fa-47c9-8072-4bc6fba381a8 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "cinder-3180b269-33c6-43e4-af34-83cd9dce1ad4-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:53:21 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-7fa5cdf7-c6fa-47c9-8072-4bc6fba381a8 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Acquiring lock "cinder-quobyte-3180b269-33c6-43e4-af34-83cd9dce1ad4" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:53:21 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-7fa5cdf7-c6fa-47c9-8072-4bc6fba381a8 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "cinder-quobyte-3180b269-33c6-43e4-af34-83cd9dce1ad4" acquired by "delete_volume" :: waited 0.021s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:53:21 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d83681-e37a-4f2c-a464-3a674a912aac]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:53:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-7fa5cdf7-c6fa-47c9-8072-4bc6fba381a8 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3180b269-33c6-43e4-af34-83cd9dce1ad4 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:21 devstack sudo[114840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3180b269-33c6-43e4-af34-83cd9dce1ad4 Jun 23 16:53:21 devstack sudo[114840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:21 devstack sudo[114831]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5b11ac0e-d6f6-40e3-a8b4-56158dc728b2 tempest-CreateVolumesFromImageTest-469033091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4615d1ba-5988-4ef0-bbac-226abeda49f3" returned: 0 in 0.818s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:21 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5b11ac0e-d6f6-40e3-a8b4-56158dc728b2 tempest-CreateVolumesFromImageTest-469033091 None] Lock "cinder-quobyte-4615d1ba-5988-4ef0-bbac-226abeda49f3" released by "delete_volume" :: held 1.836s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:53:21 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-5b11ac0e-d6f6-40e3-a8b4-56158dc728b2 tempest-CreateVolumesFromImageTest-469033091 None] Created reservations ['d58dcd82-e817-4045-92a5-88dc5e6284f3', '5a99d490-bd3e-4235-bbe0-dcb1e8071732', '7d38e1d2-8108-4f7d-a8c7-9325d1005ac2', '12f03c7e-f090-4ccd-ac78-369e916acc06'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:53:21 devstack sudo[114836]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:21 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d6f2755f-739b-4348-a297-ddb192bff255 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.741s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:21 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-d6f2755f-739b-4348-a297-ddb192bff255 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:53:22 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-d6f2755f-739b-4348-a297-ddb192bff255 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Deleted volume successfully. Jun 23 16:53:22 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d6f2755f-739b-4348-a297-ddb192bff255 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "cinder-e3827a83-d0c8-4c56-9aca-5ccd0abe3f25-delete_volume" released by "delete_volume" :: held 2.866s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:53:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5b11ac0e-d6f6-40e3-a8b4-56158dc728b2 tempest-CreateVolumesFromImageTest-469033091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:53:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5b11ac0e-d6f6-40e3-a8b4-56158dc728b2 tempest-CreateVolumesFromImageTest-469033091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:22 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-5b11ac0e-d6f6-40e3-a8b4-56158dc728b2 tempest-CreateVolumesFromImageTest-469033091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:53:22 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-5b11ac0e-d6f6-40e3-a8b4-56158dc728b2 tempest-CreateVolumesFromImageTest-469033091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:53:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5b11ac0e-d6f6-40e3-a8b4-56158dc728b2 tempest-CreateVolumesFromImageTest-469033091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5b11ac0e-d6f6-40e3-a8b4-56158dc728b2 tempest-CreateVolumesFromImageTest-469033091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:22 devstack sudo[114845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:53:22 devstack sudo[114845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:22 devstack sudo[114838]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b18ebf1b-9c8d-49a7-9ed1-101afbc8b7f8 tempest-VolumeDependencyTests-488053045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c.eff209fa-ebe8-4460-aea3-2dd3517931f3" returned: 0 in 0.861s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b18ebf1b-9c8d-49a7-9ed1-101afbc8b7f8 tempest-VolumeDependencyTests-488053045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:22 devstack sudo[114847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c.info Jun 23 16:53:22 devstack sudo[114847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:22 devstack sudo[114840]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-7fa5cdf7-c6fa-47c9-8072-4bc6fba381a8 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3180b269-33c6-43e4-af34-83cd9dce1ad4" returned: 0 in 0.929s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-7fa5cdf7-c6fa-47c9-8072-4bc6fba381a8 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3180b269-33c6-43e4-af34-83cd9dce1ad4 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:22 devstack sudo[114853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3180b269-33c6-43e4-af34-83cd9dce1ad4 Jun 23 16:53:22 devstack sudo[114853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:22 devstack sudo[114845]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:22 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5b11ac0e-d6f6-40e3-a8b4-56158dc728b2 tempest-CreateVolumesFromImageTest-469033091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.768s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:22 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-5b11ac0e-d6f6-40e3-a8b4-56158dc728b2 tempest-CreateVolumesFromImageTest-469033091 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:53:22 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-5b11ac0e-d6f6-40e3-a8b4-56158dc728b2 tempest-CreateVolumesFromImageTest-469033091 None] Deleted volume successfully. Jun 23 16:53:22 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-5b11ac0e-d6f6-40e3-a8b4-56158dc728b2 tempest-CreateVolumesFromImageTest-469033091 None] Lock "cinder-4615d1ba-5988-4ef0-bbac-226abeda49f3-delete_volume" released by "delete_volume" :: held 2.915s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:53:23 devstack sudo[114847]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b18ebf1b-9c8d-49a7-9ed1-101afbc8b7f8 tempest-VolumeDependencyTests-488053045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c.info" returned: 0 in 0.807s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:23 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-b18ebf1b-9c8d-49a7-9ed1-101afbc8b7f8 tempest-VolumeDependencyTests-488053045 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c.info is being set with open permissions: ugo+rw Jun 23 16:53:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b18ebf1b-9c8d-49a7-9ed1-101afbc8b7f8 tempest-VolumeDependencyTests-488053045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:23 devstack sudo[114857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c.info Jun 23 16:53:23 devstack sudo[114857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:23 devstack sudo[114853]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-7fa5cdf7-c6fa-47c9-8072-4bc6fba381a8 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-3180b269-33c6-43e4-af34-83cd9dce1ad4" returned: 0 in 0.866s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:23 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-7fa5cdf7-c6fa-47c9-8072-4bc6fba381a8 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "cinder-quobyte-3180b269-33c6-43e4-af34-83cd9dce1ad4" released by "delete_volume" :: held 1.862s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:53:23 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-7fa5cdf7-c6fa-47c9-8072-4bc6fba381a8 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Created reservations ['d7e1f961-d26d-44e6-bea9-bb5da69cfd88', 'f662e73a-8640-475d-b957-d95a4bc622e2', '8e5498aa-c205-488c-931a-a4f4561e91fd', '585c419d-3411-4d27-8fb0-1d0965118649'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:53:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-7fa5cdf7-c6fa-47c9-8072-4bc6fba381a8 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:53:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-7fa5cdf7-c6fa-47c9-8072-4bc6fba381a8 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:23 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-7fa5cdf7-c6fa-47c9-8072-4bc6fba381a8 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:53:23 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-7fa5cdf7-c6fa-47c9-8072-4bc6fba381a8 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:53:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-7fa5cdf7-c6fa-47c9-8072-4bc6fba381a8 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-7fa5cdf7-c6fa-47c9-8072-4bc6fba381a8 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:23 devstack sudo[114862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:53:23 devstack sudo[114862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:23 devstack sudo[114857]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b18ebf1b-9c8d-49a7-9ed1-101afbc8b7f8 tempest-VolumeDependencyTests-488053045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c.info" returned: 0 in 0.784s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b18ebf1b-9c8d-49a7-9ed1-101afbc8b7f8 tempest-VolumeDependencyTests-488053045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.145s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.939s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:23 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=271d1624-320c-4ce7-b383-2f7a655d76a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7e5b99e6ea744d0b40434da9789d53b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:53:03Z,use_quota=True,user_id='d4845fafb2714f9b9a4c3e9b796addea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f96cdbd6-1b98-4bea-bcb9-2da3e3247823),volume_type_id=f96cdbd6-1b98-4bea-bcb9-2da3e3247823)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:53:23 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Creating volume 271d1624-320c-4ce7-b383-2f7a655d76a2 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:53:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:53:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:23 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:53:23 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:53:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:23 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:53:23 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:53:23 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-271d1624-320c-4ce7-b383-2f7a655d76a2 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:23 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-8c15d1ec-bfef-4c76-9bde-470ca5516b84 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Acquiring lock "cinder-228fcf96-a907-4d64-9092-6a7f19c8912d-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:53:23 devstack sudo[114864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-271d1624-320c-4ce7-b383-2f7a655d76a2 1073741824 Jun 23 16:53:23 devstack sudo[114864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:23 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-8c15d1ec-bfef-4c76-9bde-470ca5516b84 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "cinder-228fcf96-a907-4d64-9092-6a7f19c8912d-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:53:23 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-b18ebf1b-9c8d-49a7-9ed1-101afbc8b7f8 tempest-VolumeDependencyTests-488053045 None] Create snapshot completed successfully Jun 23 16:53:24 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-8c15d1ec-bfef-4c76-9bde-470ca5516b84 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Acquiring lock "cinder-quobyte-228fcf96-a907-4d64-9092-6a7f19c8912d" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:53:24 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-8c15d1ec-bfef-4c76-9bde-470ca5516b84 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "cinder-quobyte-228fcf96-a907-4d64-9092-6a7f19c8912d" acquired by "delete_volume" :: waited 0.021s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:53:24 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0436986f-3e5a-4a8a-b8b0-bfeb21ebbb97]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:53:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8c15d1ec-bfef-4c76-9bde-470ca5516b84 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-228fcf96-a907-4d64-9092-6a7f19c8912d {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:24 devstack sudo[114866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-228fcf96-a907-4d64-9092-6a7f19c8912d Jun 23 16:53:24 devstack sudo[114866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:24 devstack sudo[114862]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-7fa5cdf7-c6fa-47c9-8072-4bc6fba381a8 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.895s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:24 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-7fa5cdf7-c6fa-47c9-8072-4bc6fba381a8 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:53:24 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-7fa5cdf7-c6fa-47c9-8072-4bc6fba381a8 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Deleted volume successfully. Jun 23 16:53:24 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-7fa5cdf7-c6fa-47c9-8072-4bc6fba381a8 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "cinder-3180b269-33c6-43e4-af34-83cd9dce1ad4-delete_volume" released by "delete_volume" :: held 3.065s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:53:25 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:53:25 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] Flow 'volume_create_manager' (6671ea0c-2e3c-468e-af7f-1e999242ae15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:53:25 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (494b3d96-e10b-452d-83ce-ab35e7ecd9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:25 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (494b3d96-e10b-452d-83ce-ab35e7ecd9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2002847922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41d3cf62-0bea-4f97-86a3-6836a503e721,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='398d57d3c9074961b7a0ecc0be051f49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=eff209fa-ebe8-4460-aea3-2dd3517931f3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:53:25Z,use_quota=True,user_id='2afafd421cbf4ea198f822ffd8a59486',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:25 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (114aab72-e1ac-4671-8174-0fb55ce5e4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:25 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (114aab72-e1ac-4671-8174-0fb55ce5e4a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:25 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2326493-fa47-4749-9165-ea816fe87a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:25 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2326493-fa47-4749-9165-ea816fe87a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '41d3cf62-0bea-4f97-86a3-6836a503e721', 'volume_name': 'volume-41d3cf62-0bea-4f97-86a3-6836a503e721', 'volume_size': 1, 'snapshot_id': 'eff209fa-ebe8-4460-aea3-2dd3517931f3'}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:25 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05224e1d-4f71-42c2-8a2e-03de92049632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:25 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05224e1d-4f71-42c2-8a2e-03de92049632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:25 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c6942ec-30aa-467b-95d9-ed04217c2797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:25 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] Volume 41d3cf62-0bea-4f97-86a3-6836a503e721: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-41d3cf62-0bea-4f97-86a3-6836a503e721', 'volume_size': 1, 'snapshot_id': 'eff209fa-ebe8-4460-aea3-2dd3517931f3'} Jun 23 16:53:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:53:25 devstack sudo[114866]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8c15d1ec-bfef-4c76-9bde-470ca5516b84 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-228fcf96-a907-4d64-9092-6a7f19c8912d" returned: 0 in 1.214s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8c15d1ec-bfef-4c76-9bde-470ca5516b84 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-228fcf96-a907-4d64-9092-6a7f19c8912d {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:25 devstack sudo[114864]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-271d1624-320c-4ce7-b383-2f7a655d76a2 1073741824" returned: 0 in 1.428s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:25 devstack sudo[114876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-228fcf96-a907-4d64-9092-6a7f19c8912d Jun 23 16:53:25 devstack sudo[114876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-271d1624-320c-4ce7-b383-2f7a655d76a2 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:25 devstack sudo[114878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-271d1624-320c-4ce7-b383-2f7a655d76a2 Jun 23 16:53:25 devstack sudo[114878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:26 devstack sudo[114878]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-271d1624-320c-4ce7-b383-2f7a655d76a2" returned: 0 in 0.689s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:26 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] <== create_volume: return (2190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:53:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.198s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.788s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:26 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] Acquiring lock "cinder-quobyte-eff209fa-ebe8-4460-aea3-2dd3517931f3-41d3cf62-0bea-4f97-86a3-6836a503e721" by "_create_volume_from_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:53:26 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] Lock "cinder-quobyte-eff209fa-ebe8-4460-aea3-2dd3517931f3-41d3cf62-0bea-4f97-86a3-6836a503e721" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:53:26 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] Creating volume 41d3cf62-0bea-4f97-86a3-6836a503e721 from snapshot eff209fa-ebe8-4460-aea3-2dd3517931f3 {{(pid=93788) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 16:53:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:53:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:26 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:53:26 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:53:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:26 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:53:26 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] Acquiring lock "cinder-quobyte-41d3cf62-0bea-4f97-86a3-6836a503e721" by "_copy_volume_from_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:53:26 devstack sudo[114876]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:26 devstack cinder-volume[93788]: DEBUG cinder.volume.volume_utils [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Attempting download of 4ffea667-a82b-4464-8864-6a6edf822b0e ((None, [{'url': 'file:///opt/stack/data/glance/images/4ffea667-a82b-4464-8864-6a6edf822b0e', 'metadata': {}}])) to volume 271d1624-320c-4ce7-b383-2f7a655d76a2. {{(pid=93788) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 16:53:26 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] Lock "cinder-quobyte-41d3cf62-0bea-4f97-86a3-6836a503e721" acquired by "_copy_volume_from_snapshot" :: waited 0.051s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:53:26 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] snapshot: eff209fa-ebe8-4460-aea3-2dd3517931f3, volume: 41d3cf62-0bea-4f97-86a3-6836a503e721, {{(pid=93788) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 16:53:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8c15d1ec-bfef-4c76-9bde-470ca5516b84 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-228fcf96-a907-4d64-9092-6a7f19c8912d" returned: 0 in 0.861s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:53:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:26 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:53:26 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:53:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:26 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-8c15d1ec-bfef-4c76-9bde-470ca5516b84 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "cinder-quobyte-228fcf96-a907-4d64-9092-6a7f19c8912d" released by "delete_volume" :: held 2.185s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:53:26 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[55001470-ec09-4cf5-9aa3-876c1e90e6d1]: (4, 'raw') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:53:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ffea667-a82b-4464-8864-6a6edf822b0e_vwjvr42n {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:26 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a056db6-0e07-4f31-aa2d-4fcb15321f07]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:53:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c.eff209fa-ebe8-4460-aea3-2dd3517931f3 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:26 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-a40e2c44-b673-42d7-98f8-27a270991896 tempest-CreateVolumesFromSnapshotTest-525468326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:53:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a40e2c44-b673-42d7-98f8-27a270991896 tempest-CreateVolumesFromSnapshotTest-525468326 None] Flow 'volume_create_manager' (e7ed568d-4285-4915-9e1f-110bbbad7713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:53:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a40e2c44-b673-42d7-98f8-27a270991896 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd448217-f09c-45cf-8705-5920c14dd1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a40e2c44-b673-42d7-98f8-27a270991896 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd448217-f09c-45cf-8705-5920c14dd1b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:53:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2047733280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c95eecc-9b71-4237-b60e-74ad55aeff9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de57e463bed04ea0b216353fdb854d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:53:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:53:26Z,use_quota=True,user_id='3c0432866a214888b7355cf22f0fc64d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a40e2c44-b673-42d7-98f8-27a270991896 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f767f9b5-c8dc-484b-b0d4-c71ef168b223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a40e2c44-b673-42d7-98f8-27a270991896 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f767f9b5-c8dc-484b-b0d4-c71ef168b223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a40e2c44-b673-42d7-98f8-27a270991896 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cac45f6c-cbed-4502-b66e-14d5e101995e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a40e2c44-b673-42d7-98f8-27a270991896 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cac45f6c-cbed-4502-b66e-14d5e101995e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c95eecc-9b71-4237-b60e-74ad55aeff9b', 'volume_name': 'volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a40e2c44-b673-42d7-98f8-27a270991896 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abdda3ed-f68a-4ec1-b1c2-83440f1894f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a40e2c44-b673-42d7-98f8-27a270991896 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abdda3ed-f68a-4ec1-b1c2-83440f1894f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a40e2c44-b673-42d7-98f8-27a270991896 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f02b50d-e5ac-4081-9639-4c5713389b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:26 devstack sudo[114882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ffea667-a82b-4464-8864-6a6edf822b0e_vwjvr42n Jun 23 16:53:26 devstack sudo[114882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:26 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-a40e2c44-b673-42d7-98f8-27a270991896 tempest-CreateVolumesFromSnapshotTest-525468326 None] Volume 5c95eecc-9b71-4237-b60e-74ad55aeff9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b', 'volume_size': 1} Jun 23 16:53:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a40e2c44-b673-42d7-98f8-27a270991896 tempest-CreateVolumesFromSnapshotTest-525468326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:53:26 devstack sudo[114883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c.eff209fa-ebe8-4460-aea3-2dd3517931f3 Jun 23 16:53:26 devstack sudo[114883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:26 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-8c15d1ec-bfef-4c76-9bde-470ca5516b84 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Created reservations ['ad156584-af81-480a-8a4b-3921a7c51de5', '8cad8619-6745-42c8-b0ea-63d6376a0e69', '6b88e5ce-009c-4599-9250-a071ec510ea6', 'e7ef3b16-c208-4d55-b378-9603fabb0829'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:53:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8c15d1ec-bfef-4c76-9bde-470ca5516b84 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:53:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8c15d1ec-bfef-4c76-9bde-470ca5516b84 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:26 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-8c15d1ec-bfef-4c76-9bde-470ca5516b84 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:53:26 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-8c15d1ec-bfef-4c76-9bde-470ca5516b84 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:53:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-8c15d1ec-bfef-4c76-9bde-470ca5516b84 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8c15d1ec-bfef-4c76-9bde-470ca5516b84 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:26 devstack sudo[114886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:53:26 devstack sudo[114886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:27 devstack sudo[114882]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ffea667-a82b-4464-8864-6a6edf822b0e_vwjvr42n" returned: 0 in 0.796s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ffea667-a82b-4464-8864-6a6edf822b0e_vwjvr42n {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:27 devstack sudo[114883]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c.eff209fa-ebe8-4460-aea3-2dd3517931f3" returned: 0 in 0.857s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:27 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:53:27 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c {{(pid=93788) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 16:53:27 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] Creating direct copy from snapshot {{(pid=93788) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 16:53:27 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e598dd-5af2-403e-9d0a-3a16fadd0697]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:53:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:27 devstack sudo[114886]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:27 devstack sudo[114894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ffea667-a82b-4464-8864-6a6edf822b0e_vwjvr42n Jun 23 16:53:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-8c15d1ec-bfef-4c76-9bde-470ca5516b84 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.702s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:27 devstack sudo[114894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:27 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-8c15d1ec-bfef-4c76-9bde-470ca5516b84 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:53:27 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-8c15d1ec-bfef-4c76-9bde-470ca5516b84 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Deleted volume successfully. Jun 23 16:53:27 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-8c15d1ec-bfef-4c76-9bde-470ca5516b84 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "cinder-228fcf96-a907-4d64-9092-6a7f19c8912d-delete_volume" released by "delete_volume" :: held 3.234s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:53:27 devstack sudo[114895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c Jun 23 16:53:27 devstack sudo[114895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:27 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ce8404de-0fd6-4744-aaf1-90f51616f3e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Acquiring lock "cinder-8ebac3ba-0f59-4777-8ab0-a402e6b19a6b-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:53:27 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ce8404de-0fd6-4744-aaf1-90f51616f3e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "cinder-8ebac3ba-0f59-4777-8ab0-a402e6b19a6b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:53:27 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ce8404de-0fd6-4744-aaf1-90f51616f3e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Acquiring lock "cinder-quobyte-8ebac3ba-0f59-4777-8ab0-a402e6b19a6b" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:53:27 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ce8404de-0fd6-4744-aaf1-90f51616f3e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "cinder-quobyte-8ebac3ba-0f59-4777-8ab0-a402e6b19a6b" acquired by "delete_volume" :: waited 0.024s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:53:27 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[375726ba-24c4-4a1a-937c-fd2b7c62bb3b]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:53:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ce8404de-0fd6-4744-aaf1-90f51616f3e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-8ebac3ba-0f59-4777-8ab0-a402e6b19a6b {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:27 devstack sudo[114898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-8ebac3ba-0f59-4777-8ab0-a402e6b19a6b Jun 23 16:53:27 devstack sudo[114898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:27 devstack sudo[114894]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ffea667-a82b-4464-8864-6a6edf822b0e_vwjvr42n" returned: 1 in 0.862s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ffea667-a82b-4464-8864-6a6edf822b0e_vwjvr42n' failed. Not Retrying. {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:53:27 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5139a8-6ece-4aad-9860-77c771a9de7b]: (4, 'raw') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:53:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4ffea667-a82b-4464-8864-6a6edf822b0e_vrastx4hdevstack@QuobyteHD {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:27 devstack sudo[114895]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c" returned: 0 in 0.863s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:28 devstack cinder-volume[93788]: DEBUG cinder.utils [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] Path /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-41d3cf62-0bea-4f97-86a3-6836a503e721 not found in is_blk_device check {{(pid=93788) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 16:53:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-41d3cf62-0bea-4f97-86a3-6836a503e721 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:28 devstack sudo[114905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4ffea667-a82b-4464-8864-6a6edf822b0e_vrastx4hdevstack@QuobyteHD Jun 23 16:53:28 devstack sudo[114905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:28 devstack sudo[114906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-41d3cf62-0bea-4f97-86a3-6836a503e721 Jun 23 16:53:28 devstack sudo[114906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:28 devstack sudo[114898]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ce8404de-0fd6-4744-aaf1-90f51616f3e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-8ebac3ba-0f59-4777-8ab0-a402e6b19a6b" returned: 0 in 0.843s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ce8404de-0fd6-4744-aaf1-90f51616f3e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-8ebac3ba-0f59-4777-8ab0-a402e6b19a6b {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:28 devstack sudo[114912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-8ebac3ba-0f59-4777-8ab0-a402e6b19a6b Jun 23 16:53:28 devstack sudo[114912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:28 devstack sudo[114905]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4ffea667-a82b-4464-8864-6a6edf822b0e_vrastx4hdevstack@QuobyteHD" returned: 0 in 0.814s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ffea667-a82b-4464-8864-6a6edf822b0e_vrastx4hdevstack@QuobyteHD {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:28 devstack sudo[114919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ffea667-a82b-4464-8864-6a6edf822b0e_vrastx4hdevstack@QuobyteHD Jun 23 16:53:28 devstack sudo[114919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:28 devstack sudo[114912]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ce8404de-0fd6-4744-aaf1-90f51616f3e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-8ebac3ba-0f59-4777-8ab0-a402e6b19a6b" returned: 0 in 0.731s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:29 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ce8404de-0fd6-4744-aaf1-90f51616f3e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "cinder-quobyte-8ebac3ba-0f59-4777-8ab0-a402e6b19a6b" released by "delete_volume" :: held 1.649s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:53:29 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-ce8404de-0fd6-4744-aaf1-90f51616f3e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Created reservations ['24b2aa5d-6f75-4cf5-a3b4-4f1563eb53b1', '6a816836-18ca-4e0a-aca9-6fd8f485c50a', '7665e63d-feb7-4e8f-9568-0e36c97f2ad1', 'a92b36fc-5bdc-4abd-869f-661ac1b64c3d'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:53:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ce8404de-0fd6-4744-aaf1-90f51616f3e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:53:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ce8404de-0fd6-4744-aaf1-90f51616f3e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:29 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-ce8404de-0fd6-4744-aaf1-90f51616f3e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:53:29 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-ce8404de-0fd6-4744-aaf1-90f51616f3e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:53:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ce8404de-0fd6-4744-aaf1-90f51616f3e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ce8404de-0fd6-4744-aaf1-90f51616f3e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:29 devstack sudo[114930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:53:29 devstack sudo[114930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:29 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-00ae9941-ba66-441b-b10a-0ff977878715 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Acquiring lock "cinder-f73a7a9a-91c5-471e-b47e-73e08da6f71f-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:53:29 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-00ae9941-ba66-441b-b10a-0ff977878715 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "cinder-f73a7a9a-91c5-471e-b47e-73e08da6f71f-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:53:30 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-00ae9941-ba66-441b-b10a-0ff977878715 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Acquiring lock "cinder-quobyte-f73a7a9a-91c5-471e-b47e-73e08da6f71f" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:53:30 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-00ae9941-ba66-441b-b10a-0ff977878715 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "cinder-quobyte-f73a7a9a-91c5-471e-b47e-73e08da6f71f" acquired by "delete_volume" :: waited 0.049s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:53:30 devstack sudo[114919]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ffea667-a82b-4464-8864-6a6edf822b0e_vrastx4hdevstack@QuobyteHD" returned: 1 in 1.452s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ffea667-a82b-4464-8864-6a6edf822b0e_vrastx4hdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:53:30 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[31959840-e692-4529-8232-243b99eb3453]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:53:30 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] 4ffea667-a82b-4464-8864-6a6edf822b0e was raw, converting to raw {{(pid=93788) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 16:53:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_4ffea667-a82b-4464-8864-6a6edf822b0e_vrastx4hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-271d1624-320c-4ce7-b383-2f7a655d76a2 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-00ae9941-ba66-441b-b10a-0ff977878715 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f73a7a9a-91c5-471e-b47e-73e08da6f71f {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:30 devstack sudo[114935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_4ffea667-a82b-4464-8864-6a6edf822b0e_vrastx4hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-271d1624-320c-4ce7-b383-2f7a655d76a2 Jun 23 16:53:30 devstack sudo[114935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:30 devstack sudo[114936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f73a7a9a-91c5-471e-b47e-73e08da6f71f Jun 23 16:53:30 devstack sudo[114936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:31 devstack sudo[114930]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:31 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ce8404de-0fd6-4744-aaf1-90f51616f3e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.752s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:31 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-ce8404de-0fd6-4744-aaf1-90f51616f3e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:53:31 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-ce8404de-0fd6-4744-aaf1-90f51616f3e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Deleted volume successfully. Jun 23 16:53:31 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ce8404de-0fd6-4744-aaf1-90f51616f3e5 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "cinder-8ebac3ba-0f59-4777-8ab0-a402e6b19a6b-delete_volume" released by "delete_volume" :: held 3.947s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:53:32 devstack sudo[114936]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-00ae9941-ba66-441b-b10a-0ff977878715 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f73a7a9a-91c5-471e-b47e-73e08da6f71f" returned: 0 in 2.110s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-00ae9941-ba66-441b-b10a-0ff977878715 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f73a7a9a-91c5-471e-b47e-73e08da6f71f {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:32 devstack sudo[114935]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:32 devstack sudo[114947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f73a7a9a-91c5-471e-b47e-73e08da6f71f Jun 23 16:53:32 devstack sudo[114947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_4ffea667-a82b-4464-8864-6a6edf822b0e_vrastx4hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-271d1624-320c-4ce7-b383-2f7a655d76a2" returned: 0 in 2.255s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:32 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4ffea667-a82b-4464-8864-6a6edf822b0e_vrastx4hdevstack@QuobyteHD, size 0.00 MB, duration 2.26 sec, destination /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-271d1624-320c-4ce7-b383-2f7a655d76a2 {{(pid=93788) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 16:53:32 devstack cinder-volume[93788]: INFO cinder.image.image_utils [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Converted 0.00 MB image at 0.00 MB/s Jun 23 16:53:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-271d1624-320c-4ce7-b383-2f7a655d76a2 1G {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:32 devstack sudo[114949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-271d1624-320c-4ce7-b383-2f7a655d76a2 1G Jun 23 16:53:32 devstack sudo[114949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:33 devstack sudo[114947]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:33 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-00ae9941-ba66-441b-b10a-0ff977878715 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-f73a7a9a-91c5-471e-b47e-73e08da6f71f" returned: 0 in 1.480s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:33 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-00ae9941-ba66-441b-b10a-0ff977878715 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "cinder-quobyte-f73a7a9a-91c5-471e-b47e-73e08da6f71f" released by "delete_volume" :: held 3.791s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:53:34 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-00ae9941-ba66-441b-b10a-0ff977878715 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Created reservations ['6b55fa91-19af-45f4-ac66-a2a4876b46f7', '751fed03-785e-46fe-a9b6-6a39e2122e27', 'fc2941de-9c73-4a72-85cb-054b460d4e03', '788adcdd-502a-44fb-ad39-04bb2c93d7a9'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:53:34 devstack sudo[114949]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-271d1624-320c-4ce7-b383-2f7a655d76a2 1G" returned: 0 in 1.755s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:34 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[14249599-175c-4ce3-80da-e3ad45d8bd1d]: (4, 'raw') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:53:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-271d1624-320c-4ce7-b383-2f7a655d76a2 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-00ae9941-ba66-441b-b10a-0ff977878715 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:53:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-00ae9941-ba66-441b-b10a-0ff977878715 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:34 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-00ae9941-ba66-441b-b10a-0ff977878715 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:53:34 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-00ae9941-ba66-441b-b10a-0ff977878715 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:53:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-00ae9941-ba66-441b-b10a-0ff977878715 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-00ae9941-ba66-441b-b10a-0ff977878715 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:34 devstack sudo[114956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:53:34 devstack sudo[114956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:34 devstack sudo[114955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-271d1624-320c-4ce7-b383-2f7a655d76a2 Jun 23 16:53:34 devstack sudo[114955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:34 devstack sudo[114906]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-41d3cf62-0bea-4f97-86a3-6836a503e721" returned: 0 in 6.506s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:34 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c807f2b-a5be-414e-9b1e-840958c47813]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:53:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:34 devstack sudo[114959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c Jun 23 16:53:34 devstack sudo[114959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:34 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-f46ee3fd-7a66-43d0-a712-7fa1041b7201 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Acquiring lock "cinder-05e95e19-b81b-45ad-b224-af4de09f8bc8-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:53:34 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-f46ee3fd-7a66-43d0-a712-7fa1041b7201 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "cinder-05e95e19-b81b-45ad-b224-af4de09f8bc8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:53:34 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-f46ee3fd-7a66-43d0-a712-7fa1041b7201 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Acquiring lock "cinder-quobyte-05e95e19-b81b-45ad-b224-af4de09f8bc8" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:53:34 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-f46ee3fd-7a66-43d0-a712-7fa1041b7201 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "cinder-quobyte-05e95e19-b81b-45ad-b224-af4de09f8bc8" acquired by "delete_volume" :: waited 0.021s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:53:34 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a61aae1-64bd-4dc6-8e91-70c943231293]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:53:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f46ee3fd-7a66-43d0-a712-7fa1041b7201 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-05e95e19-b81b-45ad-b224-af4de09f8bc8 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:35 devstack sudo[114961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-05e95e19-b81b-45ad-b224-af4de09f8bc8 Jun 23 16:53:35 devstack sudo[114961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:35 devstack sudo[114956]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-00ae9941-ba66-441b-b10a-0ff977878715 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.793s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:35 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-00ae9941-ba66-441b-b10a-0ff977878715 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:53:35 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-00ae9941-ba66-441b-b10a-0ff977878715 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Deleted volume successfully. Jun 23 16:53:35 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-00ae9941-ba66-441b-b10a-0ff977878715 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "cinder-f73a7a9a-91c5-471e-b47e-73e08da6f71f-delete_volume" released by "delete_volume" :: held 5.313s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:53:35 devstack sudo[114955]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-271d1624-320c-4ce7-b383-2f7a655d76a2" returned: 0 in 0.943s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-271d1624-320c-4ce7-b383-2f7a655d76a2 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:35 devstack sudo[114966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-271d1624-320c-4ce7-b383-2f7a655d76a2 Jun 23 16:53:35 devstack sudo[114966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:35 devstack sudo[114959]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c" returned: 0 in 1.165s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:35 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] Image conversion details: src /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c, size 1024.00 MB, duration 6.51 sec, destination /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-41d3cf62-0bea-4f97-86a3-6836a503e721 {{(pid=93788) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 16:53:35 devstack cinder-volume[93788]: INFO cinder.image.image_utils [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] Converted 1024.00 MB image at 157.36 MB/s Jun 23 16:53:35 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-41d3cf62-0bea-4f97-86a3-6836a503e721 is being set with open permissions: ugo+rw Jun 23 16:53:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-41d3cf62-0bea-4f97-86a3-6836a503e721 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:35 devstack sudo[114974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-41d3cf62-0bea-4f97-86a3-6836a503e721 Jun 23 16:53:35 devstack sudo[114974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:35 devstack sudo[114961]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f46ee3fd-7a66-43d0-a712-7fa1041b7201 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-05e95e19-b81b-45ad-b224-af4de09f8bc8" returned: 0 in 0.899s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f46ee3fd-7a66-43d0-a712-7fa1041b7201 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-05e95e19-b81b-45ad-b224-af4de09f8bc8 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:35 devstack sudo[114976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-05e95e19-b81b-45ad-b224-af4de09f8bc8 Jun 23 16:53:35 devstack sudo[114976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:36 devstack sudo[114966]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-271d1624-320c-4ce7-b383-2f7a655d76a2" returned: 1 in 0.860s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-271d1624-320c-4ce7-b383-2f7a655d76a2' failed. Not Retrying. {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:53:36 devstack cinder-volume[93788]: DEBUG cinder.volume.volume_utils [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Downloaded image 4ffea667-a82b-4464-8864-6a6edf822b0e ((None, [{'url': 'file:///opt/stack/data/glance/images/4ffea667-a82b-4464-8864-6a6edf822b0e', 'metadata': {}}])) to volume 271d1624-320c-4ce7-b383-2f7a655d76a2 successfully. {{(pid=93788) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 16:53:36 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Temporary image 4ffea667-a82b-4464-8864-6a6edf822b0e for user d4845fafb2714f9b9a4c3e9b796addea is deleted. {{(pid=93788) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 16:53:36 devstack cinder-volume[93788]: DEBUG cinder.volume.volume_utils [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Marking volume 271d1624-320c-4ce7-b383-2f7a655d76a2 as bootable. {{(pid=93788) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 16:53:36 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Copying metadata from image 4ffea667-a82b-4464-8864-6a6edf822b0e to 271d1624-320c-4ce7-b383-2f7a655d76a2. {{(pid=93788) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 16:53:36 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Creating volume glance metadata for volume 271d1624-320c-4ce7-b383-2f7a655d76a2 backed by image 4ffea667-a82b-4464-8864-6a6edf822b0e with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '4ffea667-a82b-4464-8864-6a6edf822b0e', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'dc397a555389a80183011104bf2f89bb', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93788) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 16:53:36 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f56f0759-c95f-4be9-a0de-a7c863b0d088) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-271d1624-320c-4ce7-b383-2f7a655d76a2', 'volume_size': 1, 'image_id': '4ffea667-a82b-4464-8864-6a6edf822b0e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ffea667-a82b-4464-8864-6a6edf822b0e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dc397a555389a80183011104bf2f89bb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c7e5b99e6ea744d0b40434da9789d53b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'affe39a68fc360e3fc4eaa7b888bdad4349cf2f9ea732b939ffc6b4e1199cf3961d2e3cf21a25323d6dacdc72457b02c0e0763b6b78d3ed3064764347f1018da', 'id': '4ffea667-a82b-4464-8864-6a6edf822b0e', 'created_at': datetime.datetime(2026, 6, 23, 14, 52, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 14, 53, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ffea667-a82b-4464-8864-6a6edf822b0e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:36 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1edd1bdd-fc40-4edf-9fdb-be5144c7a423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:36 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Volume volume-271d1624-320c-4ce7-b383-2f7a655d76a2 (271d1624-320c-4ce7-b383-2f7a655d76a2): created successfully Jun 23 16:53:36 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1edd1bdd-fc40-4edf-9fdb-be5144c7a423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:36 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Flow 'volume_create_manager' (58caff1e-9431-433d-a8ef-ea0827655cf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:53:36 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-36877260-29c9-4881-a0da-6ae84f5f1c41 tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Created volume successfully. Jun 23 16:53:36 devstack sudo[114974]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-41d3cf62-0bea-4f97-86a3-6836a503e721" returned: 0 in 0.750s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:36 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] Lock "cinder-quobyte-41d3cf62-0bea-4f97-86a3-6836a503e721" released by "_copy_volume_from_snapshot" :: held 10.303s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:53:36 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] Lock "cinder-quobyte-eff209fa-ebe8-4460-aea3-2dd3517931f3-41d3cf62-0bea-4f97-86a3-6836a503e721" released by "_create_volume_from_snapshot" :: held 10.373s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:53:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.410s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a40e2c44-b673-42d7-98f8-27a270991896 tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.120s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:36 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-a40e2c44-b673-42d7-98f8-27a270991896 tempest-CreateVolumesFromSnapshotTest-525468326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:53:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2047733280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c95eecc-9b71-4237-b60e-74ad55aeff9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de57e463bed04ea0b216353fdb854d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:53:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:53:26Z,use_quota=True,user_id='3c0432866a214888b7355cf22f0fc64d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:53:36 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-a40e2c44-b673-42d7-98f8-27a270991896 tempest-CreateVolumesFromSnapshotTest-525468326 None] Creating volume 5c95eecc-9b71-4237-b60e-74ad55aeff9b {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:53:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a40e2c44-b673-42d7-98f8-27a270991896 tempest-CreateVolumesFromSnapshotTest-525468326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:53:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a40e2c44-b673-42d7-98f8-27a270991896 tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:36 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-a40e2c44-b673-42d7-98f8-27a270991896 tempest-CreateVolumesFromSnapshotTest-525468326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:53:36 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-a40e2c44-b673-42d7-98f8-27a270991896 tempest-CreateVolumesFromSnapshotTest-525468326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:53:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a40e2c44-b673-42d7-98f8-27a270991896 tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:36 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-a40e2c44-b673-42d7-98f8-27a270991896 tempest-CreateVolumesFromSnapshotTest-525468326 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:53:36 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-a40e2c44-b673-42d7-98f8-27a270991896 tempest-CreateVolumesFromSnapshotTest-525468326 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:53:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a40e2c44-b673-42d7-98f8-27a270991896 tempest-CreateVolumesFromSnapshotTest-525468326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:36 devstack sudo[114983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b 1073741824 Jun 23 16:53:36 devstack sudo[114983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:36 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c6942ec-30aa-467b-95d9-ed04217c2797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41d3cf62-0bea-4f97-86a3-6836a503e721', 'volume_size': 1, 'snapshot_id': 'eff209fa-ebe8-4460-aea3-2dd3517931f3'}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:36 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a3ae0a6-9353-4586-a48a-a46a793e2eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:36 devstack sudo[114976]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f46ee3fd-7a66-43d0-a712-7fa1041b7201 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-05e95e19-b81b-45ad-b224-af4de09f8bc8" returned: 0 in 0.739s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:36 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] Volume volume-41d3cf62-0bea-4f97-86a3-6836a503e721 (41d3cf62-0bea-4f97-86a3-6836a503e721): created successfully Jun 23 16:53:36 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a3ae0a6-9353-4586-a48a-a46a793e2eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:36 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] Flow 'volume_create_manager' (6671ea0c-2e3c-468e-af7f-1e999242ae15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:53:36 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-f46ee3fd-7a66-43d0-a712-7fa1041b7201 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "cinder-quobyte-05e95e19-b81b-45ad-b224-af4de09f8bc8" released by "delete_volume" :: held 1.711s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:53:36 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-ae8ce7e6-3677-41ee-a3fb-7eb0961101c8 tempest-VolumeDependencyTests-488053045 None] Created volume successfully. Jun 23 16:53:36 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-f46ee3fd-7a66-43d0-a712-7fa1041b7201 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Created reservations ['a0234f07-961e-48eb-865c-c3091ab37525', '232c9eff-320e-404c-9e3d-ef26750fac55', '5d7355ed-63e1-4100-86ff-779e4747dd28', '50899db8-f63f-494f-9e62-efaa6001d59f'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:53:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f46ee3fd-7a66-43d0-a712-7fa1041b7201 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:53:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f46ee3fd-7a66-43d0-a712-7fa1041b7201 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:36 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-f46ee3fd-7a66-43d0-a712-7fa1041b7201 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:53:36 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-f46ee3fd-7a66-43d0-a712-7fa1041b7201 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:53:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f46ee3fd-7a66-43d0-a712-7fa1041b7201 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f46ee3fd-7a66-43d0-a712-7fa1041b7201 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:36 devstack sudo[114985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:53:36 devstack sudo[114985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:37 devstack sudo[114983]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a40e2c44-b673-42d7-98f8-27a270991896 tempest-CreateVolumesFromSnapshotTest-525468326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b 1073741824" returned: 0 in 0.940s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:37 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-652c4250-12e0-4f4d-b951-2d9e4797caaa tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Acquiring lock "cinder-271d1624-320c-4ce7-b383-2f7a655d76a2-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:53:37 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-652c4250-12e0-4f4d-b951-2d9e4797caaa tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Lock "cinder-271d1624-320c-4ce7-b383-2f7a655d76a2-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:53:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a40e2c44-b673-42d7-98f8-27a270991896 tempest-CreateVolumesFromSnapshotTest-525468326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:37 devstack sudo[114992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b Jun 23 16:53:37 devstack sudo[114992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:37 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-652c4250-12e0-4f4d-b951-2d9e4797caaa tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Acquiring lock "cinder-quobyte-271d1624-320c-4ce7-b383-2f7a655d76a2" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:53:37 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-652c4250-12e0-4f4d-b951-2d9e4797caaa tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Lock "cinder-quobyte-271d1624-320c-4ce7-b383-2f7a655d76a2" acquired by "delete_volume" :: waited 0.019s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:53:37 devstack sudo[114985]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f46ee3fd-7a66-43d0-a712-7fa1041b7201 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.914s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:37 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-f46ee3fd-7a66-43d0-a712-7fa1041b7201 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:53:37 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-59930760-f8cf-4c8f-999b-a976f64e2bb6 tempest-VolumeDependencyTests-488053045 None] Acquiring lock "cinder-eff209fa-ebe8-4460-aea3-2dd3517931f3-delete_snapshot" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:53:37 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-f46ee3fd-7a66-43d0-a712-7fa1041b7201 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Deleted volume successfully. Jun 23 16:53:37 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-59930760-f8cf-4c8f-999b-a976f64e2bb6 tempest-VolumeDependencyTests-488053045 None] Lock "cinder-eff209fa-ebe8-4460-aea3-2dd3517931f3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:53:37 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-59930760-f8cf-4c8f-999b-a976f64e2bb6 tempest-VolumeDependencyTests-488053045 None] Acquiring lock "cinder-quobyte-9c19b71c-89d4-42e0-920d-b8cde74a3f0c" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:53:37 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1d3eec-72ef-455a-b970-0c8924d8780b]: (4, 'raw') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:53:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-652c4250-12e0-4f4d-b951-2d9e4797caaa tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-271d1624-320c-4ce7-b383-2f7a655d76a2 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:37 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-f46ee3fd-7a66-43d0-a712-7fa1041b7201 tempest-CreateVolumesFromSourceVolumeTest-294615950 None] Lock "cinder-05e95e19-b81b-45ad-b224-af4de09f8bc8-delete_volume" released by "delete_volume" :: held 2.926s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:53:37 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-59930760-f8cf-4c8f-999b-a976f64e2bb6 tempest-VolumeDependencyTests-488053045 None] Lock "cinder-quobyte-9c19b71c-89d4-42e0-920d-b8cde74a3f0c" acquired by "delete_snapshot" :: waited 0.047s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:53:37 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-59930760-f8cf-4c8f-999b-a976f64e2bb6 tempest-VolumeDependencyTests-488053045 None] Acquiring lock "cinder-quobyte-eff209fa-ebe8-4460-aea3-2dd3517931f3" by "_delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:53:37 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-59930760-f8cf-4c8f-999b-a976f64e2bb6 tempest-VolumeDependencyTests-488053045 None] Lock "cinder-quobyte-eff209fa-ebe8-4460-aea3-2dd3517931f3" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:53:37 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-59930760-f8cf-4c8f-999b-a976f64e2bb6 tempest-VolumeDependencyTests-488053045 None] Deleting offline snapshot eff209fa-ebe8-4460-aea3-2dd3517931f3 of volume 9c19b71c-89d4-42e0-920d-b8cde74a3f0c {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:53:37 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-59930760-f8cf-4c8f-999b-a976f64e2bb6 tempest-VolumeDependencyTests-488053045 None] snapshot_file for this snap is: volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c.eff209fa-ebe8-4460-aea3-2dd3517931f3 {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:53:37 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b9326f-1f66-4c1f-9439-f3c44b105072]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:53:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-59930760-f8cf-4c8f-999b-a976f64e2bb6 tempest-VolumeDependencyTests-488053045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c.eff209fa-ebe8-4460-aea3-2dd3517931f3 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:37 devstack sudo[114994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-271d1624-320c-4ce7-b383-2f7a655d76a2 Jun 23 16:53:37 devstack sudo[114994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:37 devstack sudo[114995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c.eff209fa-ebe8-4460-aea3-2dd3517931f3 Jun 23 16:53:37 devstack sudo[114995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:38 devstack sudo[114992]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a40e2c44-b673-42d7-98f8-27a270991896 tempest-CreateVolumesFromSnapshotTest-525468326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b" returned: 0 in 0.861s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:38 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-a40e2c44-b673-42d7-98f8-27a270991896 tempest-CreateVolumesFromSnapshotTest-525468326 None] <== create_volume: return (1893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:53:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a40e2c44-b673-42d7-98f8-27a270991896 tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.898s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:38 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a40e2c44-b673-42d7-98f8-27a270991896 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f02b50d-e5ac-4081-9639-4c5713389b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:38 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a40e2c44-b673-42d7-98f8-27a270991896 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3363fc4-9bc1-493e-9d48-dee8f5b354b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:38 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-a40e2c44-b673-42d7-98f8-27a270991896 tempest-CreateVolumesFromSnapshotTest-525468326 None] Volume volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b (5c95eecc-9b71-4237-b60e-74ad55aeff9b): created successfully Jun 23 16:53:38 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a40e2c44-b673-42d7-98f8-27a270991896 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3363fc4-9bc1-493e-9d48-dee8f5b354b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:38 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-a40e2c44-b673-42d7-98f8-27a270991896 tempest-CreateVolumesFromSnapshotTest-525468326 None] Flow 'volume_create_manager' (e7ed568d-4285-4915-9e1f-110bbbad7713) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:53:38 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-a40e2c44-b673-42d7-98f8-27a270991896 tempest-CreateVolumesFromSnapshotTest-525468326 None] Created volume successfully. Jun 23 16:53:38 devstack sudo[114994]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-652c4250-12e0-4f4d-b951-2d9e4797caaa tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-271d1624-320c-4ce7-b383-2f7a655d76a2" returned: 0 in 1.177s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-652c4250-12e0-4f4d-b951-2d9e4797caaa tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-271d1624-320c-4ce7-b383-2f7a655d76a2 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:38 devstack sudo[114995]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5db4edbc-5925-4136-9b89-628c7a1cf6a4 tempest-CreateVolumesFromSnapshotTest-525468326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:53:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5db4edbc-5925-4136-9b89-628c7a1cf6a4 tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-59930760-f8cf-4c8f-999b-a976f64e2bb6 tempest-VolumeDependencyTests-488053045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c.eff209fa-ebe8-4460-aea3-2dd3517931f3" returned: 0 in 1.197s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:38 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-59930760-f8cf-4c8f-999b-a976f64e2bb6 tempest-VolumeDependencyTests-488053045 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:53:38 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-5db4edbc-5925-4136-9b89-628c7a1cf6a4 tempest-CreateVolumesFromSnapshotTest-525468326 None] Creating offline snapshot 883ad187-39eb-4266-a587-1181db5ca96e of volume 5c95eecc-9b71-4237-b60e-74ad55aeff9b {{(pid=93788) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:53:38 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb58661f-04ca-422e-94af-571daf8162db]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:53:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-59930760-f8cf-4c8f-999b-a976f64e2bb6 tempest-VolumeDependencyTests-488053045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:39 devstack sudo[115004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-271d1624-320c-4ce7-b383-2f7a655d76a2 Jun 23 16:53:39 devstack sudo[115004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:39 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[62569a8e-202c-429a-ada0-b608d216bdd7]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:53:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5db4edbc-5925-4136-9b89-628c7a1cf6a4 tempest-CreateVolumesFromSnapshotTest-525468326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:39 devstack sudo[115008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b Jun 23 16:53:39 devstack sudo[115008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:39 devstack sudo[115006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c Jun 23 16:53:39 devstack sudo[115006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:39 devstack sudo[115004]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-652c4250-12e0-4f4d-b951-2d9e4797caaa tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-271d1624-320c-4ce7-b383-2f7a655d76a2" returned: 1 in 1.034s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-652c4250-12e0-4f4d-b951-2d9e4797caaa tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-271d1624-320c-4ce7-b383-2f7a655d76a2' failed. Not Retrying. {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:53:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-652c4250-12e0-4f4d-b951-2d9e4797caaa tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-271d1624-320c-4ce7-b383-2f7a655d76a2 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:39 devstack sudo[115022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-271d1624-320c-4ce7-b383-2f7a655d76a2 Jun 23 16:53:39 devstack sudo[115022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:39 devstack sudo[115006]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-59930760-f8cf-4c8f-999b-a976f64e2bb6 tempest-VolumeDependencyTests-488053045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c" returned: 0 in 0.984s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-59930760-f8cf-4c8f-999b-a976f64e2bb6 tempest-VolumeDependencyTests-488053045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c.eff209fa-ebe8-4460-aea3-2dd3517931f3 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:40 devstack sudo[115008]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5db4edbc-5925-4136-9b89-628c7a1cf6a4 tempest-CreateVolumesFromSnapshotTest-525468326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b" returned: 0 in 0.984s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5db4edbc-5925-4136-9b89-628c7a1cf6a4 tempest-CreateVolumesFromSnapshotTest-525468326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b.883ad187-39eb-4266-a587-1181db5ca96e 1G {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:40 devstack sudo[115024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c.eff209fa-ebe8-4460-aea3-2dd3517931f3 Jun 23 16:53:40 devstack sudo[115024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:40 devstack sudo[115025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b.883ad187-39eb-4266-a587-1181db5ca96e 1G Jun 23 16:53:40 devstack sudo[115025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:40 devstack sudo[115022]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-652c4250-12e0-4f4d-b951-2d9e4797caaa tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-271d1624-320c-4ce7-b383-2f7a655d76a2" returned: 0 in 0.817s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:40 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-652c4250-12e0-4f4d-b951-2d9e4797caaa tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Lock "cinder-quobyte-271d1624-320c-4ce7-b383-2f7a655d76a2" released by "delete_volume" :: held 3.143s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:53:40 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-652c4250-12e0-4f4d-b951-2d9e4797caaa tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Created reservations ['850e8edc-4242-4838-a2e4-105ba0154eb0', '15a8a072-561e-4b5f-83f8-feb612227149', 'ca74fdc9-a5ee-4260-8a7f-851dce6d6133', 'a7d01984-f0e3-4170-8a9b-91afba841fe9'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:53:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-652c4250-12e0-4f4d-b951-2d9e4797caaa tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:53:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-652c4250-12e0-4f4d-b951-2d9e4797caaa tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:40 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-652c4250-12e0-4f4d-b951-2d9e4797caaa tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:53:40 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-652c4250-12e0-4f4d-b951-2d9e4797caaa tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:53:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-652c4250-12e0-4f4d-b951-2d9e4797caaa tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-652c4250-12e0-4f4d-b951-2d9e4797caaa tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:40 devstack sudo[115035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:53:40 devstack sudo[115035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:41 devstack sudo[115024]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-59930760-f8cf-4c8f-999b-a976f64e2bb6 tempest-VolumeDependencyTests-488053045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c.eff209fa-ebe8-4460-aea3-2dd3517931f3" returned: 0 in 1.099s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-59930760-f8cf-4c8f-999b-a976f64e2bb6 tempest-VolumeDependencyTests-488053045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c.eff209fa-ebe8-4460-aea3-2dd3517931f3 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:41 devstack sudo[115038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c.eff209fa-ebe8-4460-aea3-2dd3517931f3 Jun 23 16:53:41 devstack sudo[115038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:41 devstack sudo[115025]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5db4edbc-5925-4136-9b89-628c7a1cf6a4 tempest-CreateVolumesFromSnapshotTest-525468326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b.883ad187-39eb-4266-a587-1181db5ca96e 1G" returned: 0 in 1.186s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5db4edbc-5925-4136-9b89-628c7a1cf6a4 tempest-CreateVolumesFromSnapshotTest-525468326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b.883ad187-39eb-4266-a587-1181db5ca96e {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:41 devstack sudo[115040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b.883ad187-39eb-4266-a587-1181db5ca96e Jun 23 16:53:41 devstack sudo[115040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:41 devstack sudo[115035]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-652c4250-12e0-4f4d-b951-2d9e4797caaa tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.858s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:41 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-652c4250-12e0-4f4d-b951-2d9e4797caaa tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:53:41 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-652c4250-12e0-4f4d-b951-2d9e4797caaa tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Deleted volume successfully. Jun 23 16:53:41 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-652c4250-12e0-4f4d-b951-2d9e4797caaa tempest-VolumeAndVolumeTypeFromImageTest-1527359861 None] Lock "cinder-271d1624-320c-4ce7-b383-2f7a655d76a2-delete_volume" released by "delete_volume" :: held 4.399s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:53:42 devstack sudo[115038]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:42 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-59930760-f8cf-4c8f-999b-a976f64e2bb6 tempest-VolumeDependencyTests-488053045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c.eff209fa-ebe8-4460-aea3-2dd3517931f3" returned: 0 in 1.107s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:42 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-59930760-f8cf-4c8f-999b-a976f64e2bb6 tempest-VolumeDependencyTests-488053045 None] Lock "cinder-quobyte-eff209fa-ebe8-4460-aea3-2dd3517931f3" released by "_delete_snapshot" :: held 4.536s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:53:42 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-59930760-f8cf-4c8f-999b-a976f64e2bb6 tempest-VolumeDependencyTests-488053045 None] Lock "cinder-quobyte-9c19b71c-89d4-42e0-920d-b8cde74a3f0c" released by "delete_snapshot" :: held 4.568s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:53:42 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-59930760-f8cf-4c8f-999b-a976f64e2bb6 tempest-VolumeDependencyTests-488053045 None] Created reservations ['c6145eda-cc19-4fa3-956f-d3882e9e7a07', 'a559faa7-5e83-49af-bcf6-d4e3a66b790b', 'fe84f27f-64f0-46c2-a914-1fe5ba509849', '12a8c975-6ebc-4bf6-b9f9-d661b5ac269c'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:53:42 devstack sudo[115040]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:42 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5db4edbc-5925-4136-9b89-628c7a1cf6a4 tempest-CreateVolumesFromSnapshotTest-525468326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b.883ad187-39eb-4266-a587-1181db5ca96e" returned: 0 in 1.218s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:42 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-5db4edbc-5925-4136-9b89-628c7a1cf6a4 tempest-CreateVolumesFromSnapshotTest-525468326 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b.883ad187-39eb-4266-a587-1181db5ca96e is being set with open permissions: ugo+rw Jun 23 16:53:42 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5db4edbc-5925-4136-9b89-628c7a1cf6a4 tempest-CreateVolumesFromSnapshotTest-525468326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b.883ad187-39eb-4266-a587-1181db5ca96e {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:42 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-59930760-f8cf-4c8f-999b-a976f64e2bb6 tempest-VolumeDependencyTests-488053045 None] Delete snapshot completed successfully. Jun 23 16:53:42 devstack sudo[115083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b.883ad187-39eb-4266-a587-1181db5ca96e Jun 23 16:53:42 devstack sudo[115083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:42 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-59930760-f8cf-4c8f-999b-a976f64e2bb6 tempest-VolumeDependencyTests-488053045 None] Lock "cinder-eff209fa-ebe8-4460-aea3-2dd3517931f3-delete_snapshot" released by "delete_snapshot" :: held 4.815s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:53:43 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b9baf003-d361-4468-9f14-6da757389072 tempest-VolumeDependencyTests-488053045 None] Acquiring lock "cinder-9c19b71c-89d4-42e0-920d-b8cde74a3f0c-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:53:43 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b9baf003-d361-4468-9f14-6da757389072 tempest-VolumeDependencyTests-488053045 None] Lock "cinder-9c19b71c-89d4-42e0-920d-b8cde74a3f0c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:53:43 devstack sudo[115083]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5db4edbc-5925-4136-9b89-628c7a1cf6a4 tempest-CreateVolumesFromSnapshotTest-525468326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b.883ad187-39eb-4266-a587-1181db5ca96e" returned: 0 in 0.769s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:43 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b9baf003-d361-4468-9f14-6da757389072 tempest-VolumeDependencyTests-488053045 None] Acquiring lock "cinder-quobyte-9c19b71c-89d4-42e0-920d-b8cde74a3f0c" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:53:43 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b9baf003-d361-4468-9f14-6da757389072 tempest-VolumeDependencyTests-488053045 None] Lock "cinder-quobyte-9c19b71c-89d4-42e0-920d-b8cde74a3f0c" acquired by "delete_volume" :: waited 0.026s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:53:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5db4edbc-5925-4136-9b89-628c7a1cf6a4 tempest-CreateVolumesFromSnapshotTest-525468326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:43 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e32af1-ae53-4da1-a549-cbd5b4123b26]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:53:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b9baf003-d361-4468-9f14-6da757389072 tempest-VolumeDependencyTests-488053045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:43 devstack sudo[115086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b.info Jun 23 16:53:43 devstack sudo[115086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:43 devstack sudo[115087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c Jun 23 16:53:43 devstack sudo[115087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:44 devstack sudo[115086]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5db4edbc-5925-4136-9b89-628c7a1cf6a4 tempest-CreateVolumesFromSnapshotTest-525468326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b.info" returned: 0 in 0.828s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:44 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-5db4edbc-5925-4136-9b89-628c7a1cf6a4 tempest-CreateVolumesFromSnapshotTest-525468326 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b.info is being set with open permissions: ugo+rw Jun 23 16:53:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5db4edbc-5925-4136-9b89-628c7a1cf6a4 tempest-CreateVolumesFromSnapshotTest-525468326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:44 devstack sudo[115091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b.info Jun 23 16:53:44 devstack sudo[115091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:44 devstack sudo[115087]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b9baf003-d361-4468-9f14-6da757389072 tempest-VolumeDependencyTests-488053045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c" returned: 0 in 1.059s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:44 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b9baf003-d361-4468-9f14-6da757389072 tempest-VolumeDependencyTests-488053045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:44 devstack sudo[115096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c Jun 23 16:53:44 devstack sudo[115096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:45 devstack sudo[115091]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:45 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5db4edbc-5925-4136-9b89-628c7a1cf6a4 tempest-CreateVolumesFromSnapshotTest-525468326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b.info" returned: 0 in 0.928s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:45 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5db4edbc-5925-4136-9b89-628c7a1cf6a4 tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.137s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:45 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-5db4edbc-5925-4136-9b89-628c7a1cf6a4 tempest-CreateVolumesFromSnapshotTest-525468326 None] Create snapshot completed successfully Jun 23 16:53:45 devstack sudo[115096]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:45 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b9baf003-d361-4468-9f14-6da757389072 tempest-VolumeDependencyTests-488053045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9c19b71c-89d4-42e0-920d-b8cde74a3f0c" returned: 0 in 0.913s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:45 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b9baf003-d361-4468-9f14-6da757389072 tempest-VolumeDependencyTests-488053045 None] Lock "cinder-quobyte-9c19b71c-89d4-42e0-920d-b8cde74a3f0c" released by "delete_volume" :: held 2.097s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:53:45 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-b9baf003-d361-4468-9f14-6da757389072 tempest-VolumeDependencyTests-488053045 None] Created reservations ['fa0abe80-4e0c-46b9-a921-e688656a13bd', '1bc4988d-bc17-4c96-96e9-c3b8c17f801e', 'b7065005-5487-4a51-a4ab-2eec29529e61', '656256ab-8f45-4a72-a313-b898c9c0ae27'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:53:45 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b9baf003-d361-4468-9f14-6da757389072 tempest-VolumeDependencyTests-488053045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:53:45 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b9baf003-d361-4468-9f14-6da757389072 tempest-VolumeDependencyTests-488053045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:45 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b9baf003-d361-4468-9f14-6da757389072 tempest-VolumeDependencyTests-488053045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:53:45 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-b9baf003-d361-4468-9f14-6da757389072 tempest-VolumeDependencyTests-488053045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:53:45 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-b9baf003-d361-4468-9f14-6da757389072 tempest-VolumeDependencyTests-488053045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:45 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b9baf003-d361-4468-9f14-6da757389072 tempest-VolumeDependencyTests-488053045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:45 devstack sudo[115100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:53:45 devstack sudo[115100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:46 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a9219c1-5201-45f6-aac2-c92d80aa2379 tempest-CreateVolumesFromSnapshotTest-525468326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:53:46 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a9219c1-5201-45f6-aac2-c92d80aa2379 tempest-CreateVolumesFromSnapshotTest-525468326 None] Flow 'volume_create_manager' (5d936483-2113-46d2-9f7e-a8017bdf26b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:53:46 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a9219c1-5201-45f6-aac2-c92d80aa2379 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d056ebb-ed28-4516-b1c9-53f6c2ca5f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:46 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a9219c1-5201-45f6-aac2-c92d80aa2379 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d056ebb-ed28-4516-b1c9-53f6c2ca5f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1258349003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4af0956f-90f5-45c1-91d8-ed297c3b2bb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de57e463bed04ea0b216353fdb854d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:53:46Z,use_quota=True,user_id='3c0432866a214888b7355cf22f0fc64d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:46 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a9219c1-5201-45f6-aac2-c92d80aa2379 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fb2924e-2075-4db9-85f7-482460ecc6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:46 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a9219c1-5201-45f6-aac2-c92d80aa2379 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fb2924e-2075-4db9-85f7-482460ecc6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:46 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a9219c1-5201-45f6-aac2-c92d80aa2379 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae4ff726-3c4a-4a84-9c57-3c2e3e5c8b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:46 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a9219c1-5201-45f6-aac2-c92d80aa2379 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae4ff726-3c4a-4a84-9c57-3c2e3e5c8b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4af0956f-90f5-45c1-91d8-ed297c3b2bb8', 'volume_name': 'volume-4af0956f-90f5-45c1-91d8-ed297c3b2bb8', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:46 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a9219c1-5201-45f6-aac2-c92d80aa2379 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb3be425-d598-4fef-b9c2-a1b128de0f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:46 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a9219c1-5201-45f6-aac2-c92d80aa2379 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb3be425-d598-4fef-b9c2-a1b128de0f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:46 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a9219c1-5201-45f6-aac2-c92d80aa2379 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0b1a4fb-7f63-48a3-8350-f51427b318ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:46 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-0a9219c1-5201-45f6-aac2-c92d80aa2379 tempest-CreateVolumesFromSnapshotTest-525468326 None] Volume 4af0956f-90f5-45c1-91d8-ed297c3b2bb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4af0956f-90f5-45c1-91d8-ed297c3b2bb8', 'volume_size': 1} Jun 23 16:53:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-0a9219c1-5201-45f6-aac2-c92d80aa2379 tempest-CreateVolumesFromSnapshotTest-525468326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:53:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-0a9219c1-5201-45f6-aac2-c92d80aa2379 tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:46 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-0a9219c1-5201-45f6-aac2-c92d80aa2379 tempest-CreateVolumesFromSnapshotTest-525468326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1258349003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4af0956f-90f5-45c1-91d8-ed297c3b2bb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de57e463bed04ea0b216353fdb854d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:53:46Z,use_quota=True,user_id='3c0432866a214888b7355cf22f0fc64d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:53:46 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-0a9219c1-5201-45f6-aac2-c92d80aa2379 tempest-CreateVolumesFromSnapshotTest-525468326 None] Creating volume 4af0956f-90f5-45c1-91d8-ed297c3b2bb8 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:53:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-0a9219c1-5201-45f6-aac2-c92d80aa2379 tempest-CreateVolumesFromSnapshotTest-525468326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:53:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-0a9219c1-5201-45f6-aac2-c92d80aa2379 tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:46 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-0a9219c1-5201-45f6-aac2-c92d80aa2379 tempest-CreateVolumesFromSnapshotTest-525468326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:53:46 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-0a9219c1-5201-45f6-aac2-c92d80aa2379 tempest-CreateVolumesFromSnapshotTest-525468326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:53:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-0a9219c1-5201-45f6-aac2-c92d80aa2379 tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:46 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-0a9219c1-5201-45f6-aac2-c92d80aa2379 tempest-CreateVolumesFromSnapshotTest-525468326 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:53:46 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-0a9219c1-5201-45f6-aac2-c92d80aa2379 tempest-CreateVolumesFromSnapshotTest-525468326 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:53:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0a9219c1-5201-45f6-aac2-c92d80aa2379 tempest-CreateVolumesFromSnapshotTest-525468326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4af0956f-90f5-45c1-91d8-ed297c3b2bb8 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:46 devstack sudo[115103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4af0956f-90f5-45c1-91d8-ed297c3b2bb8 1073741824 Jun 23 16:53:46 devstack sudo[115103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:46 devstack sudo[115100]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-b9baf003-d361-4468-9f14-6da757389072 tempest-VolumeDependencyTests-488053045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.091s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:46 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-b9baf003-d361-4468-9f14-6da757389072 tempest-VolumeDependencyTests-488053045 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:53:46 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-b9baf003-d361-4468-9f14-6da757389072 tempest-VolumeDependencyTests-488053045 None] Deleted volume successfully. Jun 23 16:53:46 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-b9baf003-d361-4468-9f14-6da757389072 tempest-VolumeDependencyTests-488053045 None] Lock "cinder-9c19b71c-89d4-42e0-920d-b8cde74a3f0c-delete_volume" released by "delete_volume" :: held 3.569s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:53:46 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-833f9de8-77bf-415e-8ba9-b4b210b79d0e tempest-VolumeDependencyTests-488053045 None] Acquiring lock "cinder-41d3cf62-0bea-4f97-86a3-6836a503e721-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:53:46 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-833f9de8-77bf-415e-8ba9-b4b210b79d0e tempest-VolumeDependencyTests-488053045 None] Lock "cinder-41d3cf62-0bea-4f97-86a3-6836a503e721-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:53:46 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-833f9de8-77bf-415e-8ba9-b4b210b79d0e tempest-VolumeDependencyTests-488053045 None] Acquiring lock "cinder-quobyte-41d3cf62-0bea-4f97-86a3-6836a503e721" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:53:46 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-f893aa55-bcec-4cde-a49c-0bf5e8c5f6cb tempest-CreateVolumesFromSnapshotTest-525468326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:53:46 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f893aa55-bcec-4cde-a49c-0bf5e8c5f6cb tempest-CreateVolumesFromSnapshotTest-525468326 None] Flow 'volume_create_manager' (b7b4956b-6e93-493e-a584-c59869b744b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:53:46 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f893aa55-bcec-4cde-a49c-0bf5e8c5f6cb tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (289f5bc1-5f04-4bc3-a23f-dcc06f534c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:46 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f893aa55-bcec-4cde-a49c-0bf5e8c5f6cb tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (289f5bc1-5f04-4bc3-a23f-dcc06f534c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-926114603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8d10f8f-0e4e-4431-a364-4976dd380ee7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de57e463bed04ea0b216353fdb854d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:53:47Z,use_quota=True,user_id='3c0432866a214888b7355cf22f0fc64d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:46 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f893aa55-bcec-4cde-a49c-0bf5e8c5f6cb tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c50282c3-1f89-4156-bf0d-8750f30922d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:46 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f893aa55-bcec-4cde-a49c-0bf5e8c5f6cb tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c50282c3-1f89-4156-bf0d-8750f30922d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:46 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f893aa55-bcec-4cde-a49c-0bf5e8c5f6cb tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec95bcfd-4d63-4ef3-b8a1-b836e0318231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:46 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f893aa55-bcec-4cde-a49c-0bf5e8c5f6cb tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec95bcfd-4d63-4ef3-b8a1-b836e0318231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8d10f8f-0e4e-4431-a364-4976dd380ee7', 'volume_name': 'volume-a8d10f8f-0e4e-4431-a364-4976dd380ee7', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:46 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f893aa55-bcec-4cde-a49c-0bf5e8c5f6cb tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00ca2756-9762-437a-85e6-ebed7e3aac75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:46 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f893aa55-bcec-4cde-a49c-0bf5e8c5f6cb tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00ca2756-9762-437a-85e6-ebed7e3aac75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:46 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f893aa55-bcec-4cde-a49c-0bf5e8c5f6cb tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4537d2c-d716-4f9d-a5d6-867b6238f1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:46 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-f893aa55-bcec-4cde-a49c-0bf5e8c5f6cb tempest-CreateVolumesFromSnapshotTest-525468326 None] Volume a8d10f8f-0e4e-4431-a364-4976dd380ee7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8d10f8f-0e4e-4431-a364-4976dd380ee7', 'volume_size': 1} Jun 23 16:53:46 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f893aa55-bcec-4cde-a49c-0bf5e8c5f6cb tempest-CreateVolumesFromSnapshotTest-525468326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:53:46 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-833f9de8-77bf-415e-8ba9-b4b210b79d0e tempest-VolumeDependencyTests-488053045 None] Lock "cinder-quobyte-41d3cf62-0bea-4f97-86a3-6836a503e721" acquired by "delete_volume" :: waited 0.114s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:53:47 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[04df75fa-9867-4c25-bed0-4d9b2a2cd09e]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:53:47 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-833f9de8-77bf-415e-8ba9-b4b210b79d0e tempest-VolumeDependencyTests-488053045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-41d3cf62-0bea-4f97-86a3-6836a503e721 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:47 devstack sudo[115105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-41d3cf62-0bea-4f97-86a3-6836a503e721 Jun 23 16:53:47 devstack sudo[115105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:47 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a3672a3-d874-4634-ace2-67fc7fcd7462 tempest-CreateVolumesFromSnapshotTest-525468326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:53:47 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a3672a3-d874-4634-ace2-67fc7fcd7462 tempest-CreateVolumesFromSnapshotTest-525468326 None] Flow 'volume_create_manager' (74ad8b91-b027-4c68-9545-2e294ea5adeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:53:47 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a3672a3-d874-4634-ace2-67fc7fcd7462 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42411091-78fd-45e7-971d-bcdec22d89b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:47 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a3672a3-d874-4634-ace2-67fc7fcd7462 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42411091-78fd-45e7-971d-bcdec22d89b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2146660987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=134aca79-5fb4-4d65-8aaa-76ebadcb8ae9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de57e463bed04ea0b216353fdb854d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:53:48Z,use_quota=True,user_id='3c0432866a214888b7355cf22f0fc64d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:47 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a3672a3-d874-4634-ace2-67fc7fcd7462 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2fd9e5f-7235-44ca-8d12-7124baca7845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:47 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a3672a3-d874-4634-ace2-67fc7fcd7462 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2fd9e5f-7235-44ca-8d12-7124baca7845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:47 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a3672a3-d874-4634-ace2-67fc7fcd7462 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6be8e291-bca3-44d1-b1fb-6b1dae74acef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:47 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a3672a3-d874-4634-ace2-67fc7fcd7462 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6be8e291-bca3-44d1-b1fb-6b1dae74acef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '134aca79-5fb4-4d65-8aaa-76ebadcb8ae9', 'volume_name': 'volume-134aca79-5fb4-4d65-8aaa-76ebadcb8ae9', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:47 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a3672a3-d874-4634-ace2-67fc7fcd7462 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0545e4be-1589-428d-a8cb-b669b02e849b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:47 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a3672a3-d874-4634-ace2-67fc7fcd7462 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0545e4be-1589-428d-a8cb-b669b02e849b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:48 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a3672a3-d874-4634-ace2-67fc7fcd7462 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df7a8c63-b1b5-435f-9da6-1fc0fa9b642e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:48 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-0a3672a3-d874-4634-ace2-67fc7fcd7462 tempest-CreateVolumesFromSnapshotTest-525468326 None] Volume 134aca79-5fb4-4d65-8aaa-76ebadcb8ae9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-134aca79-5fb4-4d65-8aaa-76ebadcb8ae9', 'volume_size': 1} Jun 23 16:53:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-0a3672a3-d874-4634-ace2-67fc7fcd7462 tempest-CreateVolumesFromSnapshotTest-525468326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:53:48 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:SELECT=112,cinder:UPDATE=164,cinder:INSERT=39,cinder:DELETE=17 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:53:48 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-068182d0-4b02-405d-b37e-4694d026cc89 tempest-CreateVolumesFromSnapshotTest-525468326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:53:48 devstack sudo[115103]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:48 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-068182d0-4b02-405d-b37e-4694d026cc89 tempest-CreateVolumesFromSnapshotTest-525468326 None] Flow 'volume_create_manager' (b446102a-debe-47bd-8e10-bd2d3868f069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:53:48 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-068182d0-4b02-405d-b37e-4694d026cc89 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eaa921c-9261-4fef-ba52-7b8d62e42a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0a9219c1-5201-45f6-aac2-c92d80aa2379 tempest-CreateVolumesFromSnapshotTest-525468326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4af0956f-90f5-45c1-91d8-ed297c3b2bb8 1073741824" returned: 0 in 2.018s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:48 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-068182d0-4b02-405d-b37e-4694d026cc89 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eaa921c-9261-4fef-ba52-7b8d62e42a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1397270813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=685eaefc-6cd5-4d29-b676-4594911cbfa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de57e463bed04ea0b216353fdb854d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:53:48Z,use_quota=True,user_id='3c0432866a214888b7355cf22f0fc64d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:48 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-068182d0-4b02-405d-b37e-4694d026cc89 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b47fee2-342c-44d7-9418-fc0953329d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:48 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-068182d0-4b02-405d-b37e-4694d026cc89 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b47fee2-342c-44d7-9418-fc0953329d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:48 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-068182d0-4b02-405d-b37e-4694d026cc89 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d69a5cb-19fa-447a-8aad-0d3a63466343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:48 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-068182d0-4b02-405d-b37e-4694d026cc89 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d69a5cb-19fa-447a-8aad-0d3a63466343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '685eaefc-6cd5-4d29-b676-4594911cbfa4', 'volume_name': 'volume-685eaefc-6cd5-4d29-b676-4594911cbfa4', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:48 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-068182d0-4b02-405d-b37e-4694d026cc89 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feb11531-de70-4077-a02e-eec1d83ec190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:48 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-068182d0-4b02-405d-b37e-4694d026cc89 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feb11531-de70-4077-a02e-eec1d83ec190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:48 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-068182d0-4b02-405d-b37e-4694d026cc89 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba4009e7-3ba4-46dc-b217-2b3b6c754a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:48 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-068182d0-4b02-405d-b37e-4694d026cc89 tempest-CreateVolumesFromSnapshotTest-525468326 None] Volume 685eaefc-6cd5-4d29-b676-4594911cbfa4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-685eaefc-6cd5-4d29-b676-4594911cbfa4', 'volume_size': 1} Jun 23 16:53:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-068182d0-4b02-405d-b37e-4694d026cc89 tempest-CreateVolumesFromSnapshotTest-525468326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:53:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0a9219c1-5201-45f6-aac2-c92d80aa2379 tempest-CreateVolumesFromSnapshotTest-525468326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4af0956f-90f5-45c1-91d8-ed297c3b2bb8 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:48 devstack sudo[115119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4af0956f-90f5-45c1-91d8-ed297c3b2bb8 Jun 23 16:53:48 devstack sudo[115119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:48 devstack sudo[115105]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-833f9de8-77bf-415e-8ba9-b4b210b79d0e tempest-VolumeDependencyTests-488053045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-41d3cf62-0bea-4f97-86a3-6836a503e721" returned: 0 in 1.669s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:48 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-833f9de8-77bf-415e-8ba9-b4b210b79d0e tempest-VolumeDependencyTests-488053045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-41d3cf62-0bea-4f97-86a3-6836a503e721 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:48 devstack sudo[115121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-41d3cf62-0bea-4f97-86a3-6836a503e721 Jun 23 16:53:48 devstack sudo[115121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:49 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c3b6817-20c6-4cb0-8e14-ea2d0d13eb58 tempest-CreateVolumesFromSnapshotTest-525468326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:53:49 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2c3b6817-20c6-4cb0-8e14-ea2d0d13eb58 tempest-CreateVolumesFromSnapshotTest-525468326 None] Flow 'volume_create_manager' (d0fe58cd-664a-4eb5-8806-b87553974130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:53:49 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2c3b6817-20c6-4cb0-8e14-ea2d0d13eb58 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (861f530d-2fef-471c-aa04-da87de340593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:49 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2c3b6817-20c6-4cb0-8e14-ea2d0d13eb58 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (861f530d-2fef-471c-aa04-da87de340593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2007557754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23e1ac67-84b3-478b-8858-139460990467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de57e463bed04ea0b216353fdb854d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:53:49Z,use_quota=True,user_id='3c0432866a214888b7355cf22f0fc64d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:49 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2c3b6817-20c6-4cb0-8e14-ea2d0d13eb58 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95cf65fd-7137-48a9-b679-086c6f13b4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:49 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2c3b6817-20c6-4cb0-8e14-ea2d0d13eb58 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95cf65fd-7137-48a9-b679-086c6f13b4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:49 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2c3b6817-20c6-4cb0-8e14-ea2d0d13eb58 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (823dfd00-f3f7-4339-9234-3edd9f085c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:49 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2c3b6817-20c6-4cb0-8e14-ea2d0d13eb58 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (823dfd00-f3f7-4339-9234-3edd9f085c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23e1ac67-84b3-478b-8858-139460990467', 'volume_name': 'volume-23e1ac67-84b3-478b-8858-139460990467', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:49 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2c3b6817-20c6-4cb0-8e14-ea2d0d13eb58 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96b0d2db-806e-4c1f-baae-17e0c0fcf639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:49 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2c3b6817-20c6-4cb0-8e14-ea2d0d13eb58 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96b0d2db-806e-4c1f-baae-17e0c0fcf639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:49 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2c3b6817-20c6-4cb0-8e14-ea2d0d13eb58 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5dc19cf-2bc5-4af4-a661-505f70435245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:49 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-2c3b6817-20c6-4cb0-8e14-ea2d0d13eb58 tempest-CreateVolumesFromSnapshotTest-525468326 None] Volume 23e1ac67-84b3-478b-8858-139460990467: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23e1ac67-84b3-478b-8858-139460990467', 'volume_size': 1} Jun 23 16:53:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-2c3b6817-20c6-4cb0-8e14-ea2d0d13eb58 tempest-CreateVolumesFromSnapshotTest-525468326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:53:49 devstack sudo[115119]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0a9219c1-5201-45f6-aac2-c92d80aa2379 tempest-CreateVolumesFromSnapshotTest-525468326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4af0956f-90f5-45c1-91d8-ed297c3b2bb8" returned: 0 in 1.016s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:49 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-0a9219c1-5201-45f6-aac2-c92d80aa2379 tempest-CreateVolumesFromSnapshotTest-525468326 None] <== create_volume: return (3172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:53:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-0a9219c1-5201-45f6-aac2-c92d80aa2379 tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.174s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f893aa55-bcec-4cde-a49c-0bf5e8c5f6cb tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.591s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:49 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-f893aa55-bcec-4cde-a49c-0bf5e8c5f6cb tempest-CreateVolumesFromSnapshotTest-525468326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-926114603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8d10f8f-0e4e-4431-a364-4976dd380ee7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de57e463bed04ea0b216353fdb854d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:53:47Z,use_quota=True,user_id='3c0432866a214888b7355cf22f0fc64d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:53:49 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-f893aa55-bcec-4cde-a49c-0bf5e8c5f6cb tempest-CreateVolumesFromSnapshotTest-525468326 None] Creating volume a8d10f8f-0e4e-4431-a364-4976dd380ee7 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:53:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f893aa55-bcec-4cde-a49c-0bf5e8c5f6cb tempest-CreateVolumesFromSnapshotTest-525468326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:53:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f893aa55-bcec-4cde-a49c-0bf5e8c5f6cb tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:49 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-f893aa55-bcec-4cde-a49c-0bf5e8c5f6cb tempest-CreateVolumesFromSnapshotTest-525468326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:53:49 devstack sudo[115121]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:49 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-f893aa55-bcec-4cde-a49c-0bf5e8c5f6cb tempest-CreateVolumesFromSnapshotTest-525468326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:53:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f893aa55-bcec-4cde-a49c-0bf5e8c5f6cb tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:49 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-f893aa55-bcec-4cde-a49c-0bf5e8c5f6cb tempest-CreateVolumesFromSnapshotTest-525468326 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:53:49 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-f893aa55-bcec-4cde-a49c-0bf5e8c5f6cb tempest-CreateVolumesFromSnapshotTest-525468326 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:53:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f893aa55-bcec-4cde-a49c-0bf5e8c5f6cb tempest-CreateVolumesFromSnapshotTest-525468326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-a8d10f8f-0e4e-4431-a364-4976dd380ee7 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:49 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a9219c1-5201-45f6-aac2-c92d80aa2379 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0b1a4fb-7f63-48a3-8350-f51427b318ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4af0956f-90f5-45c1-91d8-ed297c3b2bb8', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:49 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a9219c1-5201-45f6-aac2-c92d80aa2379 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dd9d2fa-d9ea-4233-8151-a18a06d31165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-833f9de8-77bf-415e-8ba9-b4b210b79d0e tempest-VolumeDependencyTests-488053045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-41d3cf62-0bea-4f97-86a3-6836a503e721" returned: 0 in 0.922s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:49 devstack sudo[115126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-a8d10f8f-0e4e-4431-a364-4976dd380ee7 1073741824 Jun 23 16:53:49 devstack sudo[115126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:49 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-0a9219c1-5201-45f6-aac2-c92d80aa2379 tempest-CreateVolumesFromSnapshotTest-525468326 None] Volume volume-4af0956f-90f5-45c1-91d8-ed297c3b2bb8 (4af0956f-90f5-45c1-91d8-ed297c3b2bb8): created successfully Jun 23 16:53:49 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a9219c1-5201-45f6-aac2-c92d80aa2379 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dd9d2fa-d9ea-4233-8151-a18a06d31165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:49 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a9219c1-5201-45f6-aac2-c92d80aa2379 tempest-CreateVolumesFromSnapshotTest-525468326 None] Flow 'volume_create_manager' (5d936483-2113-46d2-9f7e-a8017bdf26b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:53:49 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-833f9de8-77bf-415e-8ba9-b4b210b79d0e tempest-VolumeDependencyTests-488053045 None] Lock "cinder-quobyte-41d3cf62-0bea-4f97-86a3-6836a503e721" released by "delete_volume" :: held 2.676s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:53:49 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-0a9219c1-5201-45f6-aac2-c92d80aa2379 tempest-CreateVolumesFromSnapshotTest-525468326 None] Created volume successfully. Jun 23 16:53:49 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-833f9de8-77bf-415e-8ba9-b4b210b79d0e tempest-VolumeDependencyTests-488053045 None] Created reservations ['e858742f-e97c-4cf7-9d4d-eadd2c647432', 'd5423a06-06c6-49b1-b8b9-7e3ddcfbf594', '51ee5758-0aa4-43e5-aa3f-4ba3a4c629f8', '43ae3d17-299e-411e-9d3b-03afe789f669'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:53:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-833f9de8-77bf-415e-8ba9-b4b210b79d0e tempest-VolumeDependencyTests-488053045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:53:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-833f9de8-77bf-415e-8ba9-b4b210b79d0e tempest-VolumeDependencyTests-488053045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:49 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-833f9de8-77bf-415e-8ba9-b4b210b79d0e tempest-VolumeDependencyTests-488053045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:53:49 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-833f9de8-77bf-415e-8ba9-b4b210b79d0e tempest-VolumeDependencyTests-488053045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:53:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-833f9de8-77bf-415e-8ba9-b4b210b79d0e tempest-VolumeDependencyTests-488053045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:49 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-833f9de8-77bf-415e-8ba9-b4b210b79d0e tempest-VolumeDependencyTests-488053045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:49 devstack sudo[115128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:53:49 devstack sudo[115128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:50 devstack sudo[115126]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f893aa55-bcec-4cde-a49c-0bf5e8c5f6cb tempest-CreateVolumesFromSnapshotTest-525468326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-a8d10f8f-0e4e-4431-a364-4976dd380ee7 1073741824" returned: 0 in 1.361s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:50 devstack sudo[115128]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:50 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-833f9de8-77bf-415e-8ba9-b4b210b79d0e tempest-VolumeDependencyTests-488053045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.091s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:50 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-833f9de8-77bf-415e-8ba9-b4b210b79d0e tempest-VolumeDependencyTests-488053045 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:53:51 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-833f9de8-77bf-415e-8ba9-b4b210b79d0e tempest-VolumeDependencyTests-488053045 None] Deleted volume successfully. Jun 23 16:53:51 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f893aa55-bcec-4cde-a49c-0bf5e8c5f6cb tempest-CreateVolumesFromSnapshotTest-525468326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-a8d10f8f-0e4e-4431-a364-4976dd380ee7 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:51 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-833f9de8-77bf-415e-8ba9-b4b210b79d0e tempest-VolumeDependencyTests-488053045 None] Lock "cinder-41d3cf62-0bea-4f97-86a3-6836a503e721-delete_volume" released by "delete_volume" :: held 4.284s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:53:51 devstack sudo[115135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-a8d10f8f-0e4e-4431-a364-4976dd380ee7 Jun 23 16:53:51 devstack sudo[115135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:52 devstack sudo[115135]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f893aa55-bcec-4cde-a49c-0bf5e8c5f6cb tempest-CreateVolumesFromSnapshotTest-525468326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-a8d10f8f-0e4e-4431-a364-4976dd380ee7" returned: 0 in 1.020s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:52 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-f893aa55-bcec-4cde-a49c-0bf5e8c5f6cb tempest-CreateVolumesFromSnapshotTest-525468326 None] <== create_volume: return (2445ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:53:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f893aa55-bcec-4cde-a49c-0bf5e8c5f6cb tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.449s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-0a3672a3-d874-4634-ace2-67fc7fcd7462 tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.006s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:52 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-0a3672a3-d874-4634-ace2-67fc7fcd7462 tempest-CreateVolumesFromSnapshotTest-525468326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2146660987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=134aca79-5fb4-4d65-8aaa-76ebadcb8ae9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de57e463bed04ea0b216353fdb854d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:53:48Z,use_quota=True,user_id='3c0432866a214888b7355cf22f0fc64d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:53:52 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-0a3672a3-d874-4634-ace2-67fc7fcd7462 tempest-CreateVolumesFromSnapshotTest-525468326 None] Creating volume 134aca79-5fb4-4d65-8aaa-76ebadcb8ae9 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:53:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-0a3672a3-d874-4634-ace2-67fc7fcd7462 tempest-CreateVolumesFromSnapshotTest-525468326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:53:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-0a3672a3-d874-4634-ace2-67fc7fcd7462 tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:52 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-0a3672a3-d874-4634-ace2-67fc7fcd7462 tempest-CreateVolumesFromSnapshotTest-525468326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:53:52 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-0a3672a3-d874-4634-ace2-67fc7fcd7462 tempest-CreateVolumesFromSnapshotTest-525468326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:53:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-0a3672a3-d874-4634-ace2-67fc7fcd7462 tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:52 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-0a3672a3-d874-4634-ace2-67fc7fcd7462 tempest-CreateVolumesFromSnapshotTest-525468326 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:53:52 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-0a3672a3-d874-4634-ace2-67fc7fcd7462 tempest-CreateVolumesFromSnapshotTest-525468326 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:53:52 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0a3672a3-d874-4634-ace2-67fc7fcd7462 tempest-CreateVolumesFromSnapshotTest-525468326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-134aca79-5fb4-4d65-8aaa-76ebadcb8ae9 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:52 devstack sudo[115138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-134aca79-5fb4-4d65-8aaa-76ebadcb8ae9 1073741824 Jun 23 16:53:52 devstack sudo[115138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f893aa55-bcec-4cde-a49c-0bf5e8c5f6cb tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4537d2c-d716-4f9d-a5d6-867b6238f1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8d10f8f-0e4e-4431-a364-4976dd380ee7', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f893aa55-bcec-4cde-a49c-0bf5e8c5f6cb tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b704aad4-ea3a-40b8-b9c3-da9934575f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:52 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-f893aa55-bcec-4cde-a49c-0bf5e8c5f6cb tempest-CreateVolumesFromSnapshotTest-525468326 None] Volume volume-a8d10f8f-0e4e-4431-a364-4976dd380ee7 (a8d10f8f-0e4e-4431-a364-4976dd380ee7): created successfully Jun 23 16:53:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f893aa55-bcec-4cde-a49c-0bf5e8c5f6cb tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b704aad4-ea3a-40b8-b9c3-da9934575f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:52 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f893aa55-bcec-4cde-a49c-0bf5e8c5f6cb tempest-CreateVolumesFromSnapshotTest-525468326 None] Flow 'volume_create_manager' (b7b4956b-6e93-493e-a584-c59869b744b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:53:52 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-f893aa55-bcec-4cde-a49c-0bf5e8c5f6cb tempest-CreateVolumesFromSnapshotTest-525468326 None] Created volume successfully. Jun 23 16:53:53 devstack sudo[115138]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:53 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0a3672a3-d874-4634-ace2-67fc7fcd7462 tempest-CreateVolumesFromSnapshotTest-525468326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-134aca79-5fb4-4d65-8aaa-76ebadcb8ae9 1073741824" returned: 0 in 1.181s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:53 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0a3672a3-d874-4634-ace2-67fc7fcd7462 tempest-CreateVolumesFromSnapshotTest-525468326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-134aca79-5fb4-4d65-8aaa-76ebadcb8ae9 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:53 devstack sudo[115144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-134aca79-5fb4-4d65-8aaa-76ebadcb8ae9 Jun 23 16:53:53 devstack sudo[115144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:53 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:53:53 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Flow 'volume_create_manager' (bc765e01-5a54-4245-8bad-8141d979fbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:53:53 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd329daa-0e5d-4f07-b57a-d5f24ab1a79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:53 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd329daa-0e5d-4f07-b57a-d5f24ab1a79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc933636-4ffd-46e0-bbda-1179a8f63507,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='796d88e8b1ec487988528074de970784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:53:54Z,use_quota=True,user_id='a88bab4a1cdd4f5385698f2acb7ebfb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:53 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a69768e8-9f10-4f87-939d-d256dea0f784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:53 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a69768e8-9f10-4f87-939d-d256dea0f784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:53 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68d6638b-5b0c-4476-8e4e-e9142e8fc06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:53 devstack cinder-volume[93788]: DEBUG cinder.image.glance [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Creating Keystone auth plugin from conf {{(pid=93788) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 16:53:54 devstack sudo[115144]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-0a3672a3-d874-4634-ace2-67fc7fcd7462 tempest-CreateVolumesFromSnapshotTest-525468326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-134aca79-5fb4-4d65-8aaa-76ebadcb8ae9" returned: 0 in 0.847s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:54 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-0a3672a3-d874-4634-ace2-67fc7fcd7462 tempest-CreateVolumesFromSnapshotTest-525468326 None] <== create_volume: return (2086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:53:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-0a3672a3-d874-4634-ace2-67fc7fcd7462 tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.091s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-068182d0-4b02-405d-b37e-4694d026cc89 tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.605s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:54 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-068182d0-4b02-405d-b37e-4694d026cc89 tempest-CreateVolumesFromSnapshotTest-525468326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1397270813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=685eaefc-6cd5-4d29-b676-4594911cbfa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de57e463bed04ea0b216353fdb854d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:53:48Z,use_quota=True,user_id='3c0432866a214888b7355cf22f0fc64d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:53:54 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-068182d0-4b02-405d-b37e-4694d026cc89 tempest-CreateVolumesFromSnapshotTest-525468326 None] Creating volume 685eaefc-6cd5-4d29-b676-4594911cbfa4 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:53:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-068182d0-4b02-405d-b37e-4694d026cc89 tempest-CreateVolumesFromSnapshotTest-525468326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:53:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-068182d0-4b02-405d-b37e-4694d026cc89 tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:54 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-068182d0-4b02-405d-b37e-4694d026cc89 tempest-CreateVolumesFromSnapshotTest-525468326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:53:54 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-068182d0-4b02-405d-b37e-4694d026cc89 tempest-CreateVolumesFromSnapshotTest-525468326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:53:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-068182d0-4b02-405d-b37e-4694d026cc89 tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:54 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-068182d0-4b02-405d-b37e-4694d026cc89 tempest-CreateVolumesFromSnapshotTest-525468326 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:53:54 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-068182d0-4b02-405d-b37e-4694d026cc89 tempest-CreateVolumesFromSnapshotTest-525468326 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:53:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-068182d0-4b02-405d-b37e-4694d026cc89 tempest-CreateVolumesFromSnapshotTest-525468326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-685eaefc-6cd5-4d29-b676-4594911cbfa4 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:54 devstack sudo[115147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-685eaefc-6cd5-4d29-b676-4594911cbfa4 1073741824 Jun 23 16:53:54 devstack sudo[115147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:54 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a3672a3-d874-4634-ace2-67fc7fcd7462 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df7a8c63-b1b5-435f-9da6-1fc0fa9b642e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-134aca79-5fb4-4d65-8aaa-76ebadcb8ae9', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:54 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a3672a3-d874-4634-ace2-67fc7fcd7462 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a130a43d-3f67-42f6-a189-09b0840dec8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:54 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-0a3672a3-d874-4634-ace2-67fc7fcd7462 tempest-CreateVolumesFromSnapshotTest-525468326 None] Volume volume-134aca79-5fb4-4d65-8aaa-76ebadcb8ae9 (134aca79-5fb4-4d65-8aaa-76ebadcb8ae9): created successfully Jun 23 16:53:54 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a3672a3-d874-4634-ace2-67fc7fcd7462 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a130a43d-3f67-42f6-a189-09b0840dec8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:54 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-0a3672a3-d874-4634-ace2-67fc7fcd7462 tempest-CreateVolumesFromSnapshotTest-525468326 None] Flow 'volume_create_manager' (74ad8b91-b027-4c68-9545-2e294ea5adeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:53:54 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68d6638b-5b0c-4476-8e4e-e9142e8fc06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bc933636-4ffd-46e0-bbda-1179a8f63507', 'volume_name': 'volume-bc933636-4ffd-46e0-bbda-1179a8f63507', 'volume_size': 1, 'image_id': '191c04b7-dce1-4319-b74d-85991b12a8fe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/191c04b7-dce1-4319-b74d-85991b12a8fe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '59730d1b9e89b38d625f82b306e58d1f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '796d88e8b1ec487988528074de970784', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '96f6bf9ce59f13881e994dd7cbb3340b6040da91e7191d1dbbd6b6a07c47e145731772bdb0da4f24e4333fdcc433d2443584fee71a51bc9de4e20907ffa8db75', 'id': '191c04b7-dce1-4319-b74d-85991b12a8fe', 'created_at': datetime.datetime(2026, 6, 23, 14, 53, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 14, 53, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/191c04b7-dce1-4319-b74d-85991b12a8fe/file', 'properties': {}}, 'image_service': }' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:54 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (749b1102-9919-4820-89b6-b64f4628e9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:54 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (749b1102-9919-4820-89b6-b64f4628e9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:54 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da300036-bff0-4c41-920c-07502c93b462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:54 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Volume bc933636-4ffd-46e0-bbda-1179a8f63507: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bc933636-4ffd-46e0-bbda-1179a8f63507', 'volume_size': 1, 'image_id': '191c04b7-dce1-4319-b74d-85991b12a8fe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/191c04b7-dce1-4319-b74d-85991b12a8fe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '59730d1b9e89b38d625f82b306e58d1f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '796d88e8b1ec487988528074de970784', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '96f6bf9ce59f13881e994dd7cbb3340b6040da91e7191d1dbbd6b6a07c47e145731772bdb0da4f24e4333fdcc433d2443584fee71a51bc9de4e20907ffa8db75', 'id': '191c04b7-dce1-4319-b74d-85991b12a8fe', 'created_at': datetime.datetime(2026, 6, 23, 14, 53, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 14, 53, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/191c04b7-dce1-4319-b74d-85991b12a8fe/file', 'properties': {}}, 'image_service': } Jun 23 16:53:54 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Trying to clone bc933636-4ffd-46e0-bbda-1179a8f63507 from image 191c04b7-dce1-4319-b74d-85991b12a8fe at location (None, [{'url': 'file:///opt/stack/data/glance/images/191c04b7-dce1-4319-b74d-85991b12a8fe', 'metadata': {}}]). {{(pid=93788) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 16:53:54 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-0a3672a3-d874-4634-ace2-67fc7fcd7462 tempest-CreateVolumesFromSnapshotTest-525468326 None] Created volume successfully. Jun 23 16:53:54 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_191c04b7-dce1-4319-b74d-85991b12a8fe_dcbq2bq3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93788) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 16:53:54 devstack cinder-volume[93788]: INFO cinder.image.image_utils [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Image download 0.00 MB at 0.00 MB/s Jun 23 16:53:54 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead60c5f-6e79-4f51-a542-f4bf5d2eccc8]: (4, 'raw') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:53:54 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_191c04b7-dce1-4319-b74d-85991b12a8fe_dcbq2bq3devstack@QuobyteHD {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:54 devstack sudo[115149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_191c04b7-dce1-4319-b74d-85991b12a8fe_dcbq2bq3devstack@QuobyteHD Jun 23 16:53:54 devstack sudo[115149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:55 devstack sudo[115147]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-068182d0-4b02-405d-b37e-4694d026cc89 tempest-CreateVolumesFromSnapshotTest-525468326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-685eaefc-6cd5-4d29-b676-4594911cbfa4 1073741824" returned: 0 in 1.089s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-068182d0-4b02-405d-b37e-4694d026cc89 tempest-CreateVolumesFromSnapshotTest-525468326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-685eaefc-6cd5-4d29-b676-4594911cbfa4 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:55 devstack sudo[115156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-685eaefc-6cd5-4d29-b676-4594911cbfa4 Jun 23 16:53:55 devstack sudo[115156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:55 devstack sudo[115149]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_191c04b7-dce1-4319-b74d-85991b12a8fe_dcbq2bq3devstack@QuobyteHD" returned: 0 in 0.842s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:55 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_191c04b7-dce1-4319-b74d-85991b12a8fe_dcbq2bq3devstack@QuobyteHD {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:55 devstack sudo[115158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_191c04b7-dce1-4319-b74d-85991b12a8fe_dcbq2bq3devstack@QuobyteHD Jun 23 16:53:55 devstack sudo[115158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:56 devstack sudo[115156]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-068182d0-4b02-405d-b37e-4694d026cc89 tempest-CreateVolumesFromSnapshotTest-525468326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-685eaefc-6cd5-4d29-b676-4594911cbfa4" returned: 0 in 0.858s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:56 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-068182d0-4b02-405d-b37e-4694d026cc89 tempest-CreateVolumesFromSnapshotTest-525468326 None] <== create_volume: return (2001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:53:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-068182d0-4b02-405d-b37e-4694d026cc89 tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.006s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-2c3b6817-20c6-4cb0-8e14-ea2d0d13eb58 tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.913s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:56 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-2c3b6817-20c6-4cb0-8e14-ea2d0d13eb58 tempest-CreateVolumesFromSnapshotTest-525468326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2007557754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23e1ac67-84b3-478b-8858-139460990467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de57e463bed04ea0b216353fdb854d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:53:49Z,use_quota=True,user_id='3c0432866a214888b7355cf22f0fc64d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:53:56 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-2c3b6817-20c6-4cb0-8e14-ea2d0d13eb58 tempest-CreateVolumesFromSnapshotTest-525468326 None] Creating volume 23e1ac67-84b3-478b-8858-139460990467 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:53:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-2c3b6817-20c6-4cb0-8e14-ea2d0d13eb58 tempest-CreateVolumesFromSnapshotTest-525468326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:53:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-2c3b6817-20c6-4cb0-8e14-ea2d0d13eb58 tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:56 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-2c3b6817-20c6-4cb0-8e14-ea2d0d13eb58 tempest-CreateVolumesFromSnapshotTest-525468326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:53:56 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-2c3b6817-20c6-4cb0-8e14-ea2d0d13eb58 tempest-CreateVolumesFromSnapshotTest-525468326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:53:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-2c3b6817-20c6-4cb0-8e14-ea2d0d13eb58 tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:56 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-2c3b6817-20c6-4cb0-8e14-ea2d0d13eb58 tempest-CreateVolumesFromSnapshotTest-525468326 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:53:56 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-2c3b6817-20c6-4cb0-8e14-ea2d0d13eb58 tempest-CreateVolumesFromSnapshotTest-525468326 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:53:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2c3b6817-20c6-4cb0-8e14-ea2d0d13eb58 tempest-CreateVolumesFromSnapshotTest-525468326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-23e1ac67-84b3-478b-8858-139460990467 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:56 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-068182d0-4b02-405d-b37e-4694d026cc89 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba4009e7-3ba4-46dc-b217-2b3b6c754a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-685eaefc-6cd5-4d29-b676-4594911cbfa4', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:56 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-068182d0-4b02-405d-b37e-4694d026cc89 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04e6cfc7-b9b1-49d6-8cd3-6c9667f036c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:56 devstack sudo[115165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-23e1ac67-84b3-478b-8858-139460990467 1073741824 Jun 23 16:53:56 devstack sudo[115165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:56 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-068182d0-4b02-405d-b37e-4694d026cc89 tempest-CreateVolumesFromSnapshotTest-525468326 None] Volume volume-685eaefc-6cd5-4d29-b676-4594911cbfa4 (685eaefc-6cd5-4d29-b676-4594911cbfa4): created successfully Jun 23 16:53:56 devstack sudo[115158]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:56 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-068182d0-4b02-405d-b37e-4694d026cc89 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04e6cfc7-b9b1-49d6-8cd3-6c9667f036c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:56 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-068182d0-4b02-405d-b37e-4694d026cc89 tempest-CreateVolumesFromSnapshotTest-525468326 None] Flow 'volume_create_manager' (b446102a-debe-47bd-8e10-bd2d3868f069) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:53:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_191c04b7-dce1-4319-b74d-85991b12a8fe_dcbq2bq3devstack@QuobyteHD" returned: 1 in 0.925s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_191c04b7-dce1-4319-b74d-85991b12a8fe_dcbq2bq3devstack@QuobyteHD' failed. Not Retrying. {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:53:56 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Temporary image 191c04b7-dce1-4319-b74d-85991b12a8fe is fetched for user a88bab4a1cdd4f5385698f2acb7ebfb8. {{(pid=93788) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 16:53:56 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-068182d0-4b02-405d-b37e-4694d026cc89 tempest-CreateVolumesFromSnapshotTest-525468326 None] Created volume successfully. Jun 23 16:53:56 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fae42e-fb3f-4a3f-b5fc-798860fdc3ab]: (4, 'raw') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:53:56 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_191c04b7-dce1-4319-b74d-85991b12a8fe_dcbq2bq3devstack@QuobyteHD {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:56 devstack sudo[115167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_191c04b7-dce1-4319-b74d-85991b12a8fe_dcbq2bq3devstack@QuobyteHD Jun 23 16:53:56 devstack sudo[115167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:57 devstack sudo[115167]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_191c04b7-dce1-4319-b74d-85991b12a8fe_dcbq2bq3devstack@QuobyteHD" returned: 0 in 0.834s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_191c04b7-dce1-4319-b74d-85991b12a8fe_dcbq2bq3devstack@QuobyteHD {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:57 devstack sudo[115165]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2c3b6817-20c6-4cb0-8e14-ea2d0d13eb58 tempest-CreateVolumesFromSnapshotTest-525468326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-23e1ac67-84b3-478b-8858-139460990467 1073741824" returned: 0 in 1.069s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:57 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:UPDATE=180,cinder:SELECT=137,cinder:DELETE=16,cinder:INSERT=46 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:53:57 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2c3b6817-20c6-4cb0-8e14-ea2d0d13eb58 tempest-CreateVolumesFromSnapshotTest-525468326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-23e1ac67-84b3-478b-8858-139460990467 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:57 devstack sudo[115176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-23e1ac67-84b3-478b-8858-139460990467 Jun 23 16:53:57 devstack sudo[115176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:57 devstack sudo[115175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_191c04b7-dce1-4319-b74d-85991b12a8fe_dcbq2bq3devstack@QuobyteHD Jun 23 16:53:57 devstack sudo[115175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:58 devstack sudo[115175]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_191c04b7-dce1-4319-b74d-85991b12a8fe_dcbq2bq3devstack@QuobyteHD" returned: 1 in 0.799s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:58 devstack sudo[115176]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_191c04b7-dce1-4319-b74d-85991b12a8fe_dcbq2bq3devstack@QuobyteHD' failed. Not Retrying. {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:53:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:53:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-2c3b6817-20c6-4cb0-8e14-ea2d0d13eb58 tempest-CreateVolumesFromSnapshotTest-525468326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-23e1ac67-84b3-478b-8858-139460990467" returned: 0 in 0.731s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:58 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-2c3b6817-20c6-4cb0-8e14-ea2d0d13eb58 tempest-CreateVolumesFromSnapshotTest-525468326 None] <== create_volume: return (1860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:53:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-2c3b6817-20c6-4cb0-8e14-ea2d0d13eb58 tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.865s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.011s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:58 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc933636-4ffd-46e0-bbda-1179a8f63507,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='796d88e8b1ec487988528074de970784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:53:54Z,use_quota=True,user_id='a88bab4a1cdd4f5385698f2acb7ebfb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:53:58 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Creating volume bc933636-4ffd-46e0-bbda-1179a8f63507 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:53:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:53:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:53:58 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:53:58 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:53:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:58 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:53:58 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:53:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bc933636-4ffd-46e0-bbda-1179a8f63507 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2c3b6817-20c6-4cb0-8e14-ea2d0d13eb58 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5dc19cf-2bc5-4af4-a661-505f70435245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23e1ac67-84b3-478b-8858-139460990467', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:58 devstack sudo[115183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bc933636-4ffd-46e0-bbda-1179a8f63507 1073741824 Jun 23 16:53:58 devstack sudo[115183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2c3b6817-20c6-4cb0-8e14-ea2d0d13eb58 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0faa7f2d-482c-44b1-8773-83a5425d770a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:53:58 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-2c3b6817-20c6-4cb0-8e14-ea2d0d13eb58 tempest-CreateVolumesFromSnapshotTest-525468326 None] Volume volume-23e1ac67-84b3-478b-8858-139460990467 (23e1ac67-84b3-478b-8858-139460990467): created successfully Jun 23 16:53:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2c3b6817-20c6-4cb0-8e14-ea2d0d13eb58 tempest-CreateVolumesFromSnapshotTest-525468326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0faa7f2d-482c-44b1-8773-83a5425d770a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:53:58 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-2c3b6817-20c6-4cb0-8e14-ea2d0d13eb58 tempest-CreateVolumesFromSnapshotTest-525468326 None] Flow 'volume_create_manager' (d0fe58cd-664a-4eb5-8806-b87553974130) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:53:58 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-2c3b6817-20c6-4cb0-8e14-ea2d0d13eb58 tempest-CreateVolumesFromSnapshotTest-525468326 None] Created volume successfully. Jun 23 16:53:58 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-3bd43b90-ddab-454c-90a8-0036d113b696 tempest-CreateVolumesFromSnapshotTest-525468326 None] Acquiring lock "cinder-23e1ac67-84b3-478b-8858-139460990467-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:53:58 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-3bd43b90-ddab-454c-90a8-0036d113b696 tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "cinder-23e1ac67-84b3-478b-8858-139460990467-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:53:58 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-3bd43b90-ddab-454c-90a8-0036d113b696 tempest-CreateVolumesFromSnapshotTest-525468326 None] Acquiring lock "cinder-quobyte-23e1ac67-84b3-478b-8858-139460990467" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:53:58 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-3bd43b90-ddab-454c-90a8-0036d113b696 tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "cinder-quobyte-23e1ac67-84b3-478b-8858-139460990467" acquired by "delete_volume" :: waited 0.016s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:53:58 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2b44f6-9573-4a12-afec-d35f8a0abe6f]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:53:58 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-3bd43b90-ddab-454c-90a8-0036d113b696 tempest-CreateVolumesFromSnapshotTest-525468326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-23e1ac67-84b3-478b-8858-139460990467 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:58 devstack sudo[115185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-23e1ac67-84b3-478b-8858-139460990467 Jun 23 16:53:58 devstack sudo[115185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:59 devstack sudo[115183]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bc933636-4ffd-46e0-bbda-1179a8f63507 1073741824" returned: 0 in 1.111s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bc933636-4ffd-46e0-bbda-1179a8f63507 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:59 devstack sudo[115195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bc933636-4ffd-46e0-bbda-1179a8f63507 Jun 23 16:53:59 devstack sudo[115195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:59 devstack sudo[115185]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-3bd43b90-ddab-454c-90a8-0036d113b696 tempest-CreateVolumesFromSnapshotTest-525468326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-23e1ac67-84b3-478b-8858-139460990467" returned: 0 in 0.894s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-3bd43b90-ddab-454c-90a8-0036d113b696 tempest-CreateVolumesFromSnapshotTest-525468326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-23e1ac67-84b3-478b-8858-139460990467 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:53:59 devstack sudo[115197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-23e1ac67-84b3-478b-8858-139460990467 Jun 23 16:53:59 devstack sudo[115197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:53:59 devstack sudo[115195]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bc933636-4ffd-46e0-bbda-1179a8f63507" returned: 0 in 0.736s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:59 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] <== create_volume: return (1931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:53:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.935s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:53:59 devstack sudo[115197]: pam_unix(sudo:session): session closed for user root Jun 23 16:53:59 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-3bd43b90-ddab-454c-90a8-0036d113b696 tempest-CreateVolumesFromSnapshotTest-525468326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-23e1ac67-84b3-478b-8858-139460990467" returned: 0 in 0.693s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:53:59 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-3bd43b90-ddab-454c-90a8-0036d113b696 tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "cinder-quobyte-23e1ac67-84b3-478b-8858-139460990467" released by "delete_volume" :: held 1.632s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:54:00 devstack cinder-volume[93788]: DEBUG cinder.volume.volume_utils [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Attempting download of 191c04b7-dce1-4319-b74d-85991b12a8fe ((None, [{'url': 'file:///opt/stack/data/glance/images/191c04b7-dce1-4319-b74d-85991b12a8fe', 'metadata': {}}])) to volume bc933636-4ffd-46e0-bbda-1179a8f63507. {{(pid=93788) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 16:54:00 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-3bd43b90-ddab-454c-90a8-0036d113b696 tempest-CreateVolumesFromSnapshotTest-525468326 None] Created reservations ['edfed25a-e6c6-4c0d-893e-e6c5fdb0d8ef', 'd99ecad4-5f0a-4331-b050-4508d77cc5f2', '0df3e05c-d6bc-48d1-bedc-670a6194821c', '4ef1096a-87ab-4b48-878a-865bde14eb45'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:54:00 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae51ce0-8687-4a2e-8582-8868feb02198]: (4, 'raw') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:54:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_191c04b7-dce1-4319-b74d-85991b12a8fe_xeu5r854 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-3bd43b90-ddab-454c-90a8-0036d113b696 tempest-CreateVolumesFromSnapshotTest-525468326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:54:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-3bd43b90-ddab-454c-90a8-0036d113b696 tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:54:00 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-3bd43b90-ddab-454c-90a8-0036d113b696 tempest-CreateVolumesFromSnapshotTest-525468326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:54:00 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-3bd43b90-ddab-454c-90a8-0036d113b696 tempest-CreateVolumesFromSnapshotTest-525468326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:54:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-3bd43b90-ddab-454c-90a8-0036d113b696 tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:54:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-3bd43b90-ddab-454c-90a8-0036d113b696 tempest-CreateVolumesFromSnapshotTest-525468326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:00 devstack sudo[115203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:54:00 devstack sudo[115203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:00 devstack sudo[115202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_191c04b7-dce1-4319-b74d-85991b12a8fe_xeu5r854 Jun 23 16:54:00 devstack sudo[115202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:00 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ae7f10e0-b295-4200-8a6c-e9a4b21734f9 tempest-CreateVolumesFromSnapshotTest-525468326 None] Acquiring lock "cinder-685eaefc-6cd5-4d29-b676-4594911cbfa4-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:54:00 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ae7f10e0-b295-4200-8a6c-e9a4b21734f9 tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "cinder-685eaefc-6cd5-4d29-b676-4594911cbfa4-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:54:00 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ae7f10e0-b295-4200-8a6c-e9a4b21734f9 tempest-CreateVolumesFromSnapshotTest-525468326 None] Acquiring lock "cinder-quobyte-685eaefc-6cd5-4d29-b676-4594911cbfa4" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:54:00 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ae7f10e0-b295-4200-8a6c-e9a4b21734f9 tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "cinder-quobyte-685eaefc-6cd5-4d29-b676-4594911cbfa4" acquired by "delete_volume" :: waited 0.022s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:54:00 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c788f6-4e0c-40ae-8b95-0ccaf34feb4f]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:54:00 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ae7f10e0-b295-4200-8a6c-e9a4b21734f9 tempest-CreateVolumesFromSnapshotTest-525468326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-685eaefc-6cd5-4d29-b676-4594911cbfa4 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:00 devstack sudo[115206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-685eaefc-6cd5-4d29-b676-4594911cbfa4 Jun 23 16:54:00 devstack sudo[115206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:01 devstack sudo[115203]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-3bd43b90-ddab-454c-90a8-0036d113b696 tempest-CreateVolumesFromSnapshotTest-525468326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.821s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:01 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-3bd43b90-ddab-454c-90a8-0036d113b696 tempest-CreateVolumesFromSnapshotTest-525468326 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:54:01 devstack sudo[115202]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_191c04b7-dce1-4319-b74d-85991b12a8fe_xeu5r854" returned: 0 in 0.947s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_191c04b7-dce1-4319-b74d-85991b12a8fe_xeu5r854 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:01 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-3bd43b90-ddab-454c-90a8-0036d113b696 tempest-CreateVolumesFromSnapshotTest-525468326 None] Deleted volume successfully. Jun 23 16:54:01 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-3bd43b90-ddab-454c-90a8-0036d113b696 tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "cinder-23e1ac67-84b3-478b-8858-139460990467-delete_volume" released by "delete_volume" :: held 2.803s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:54:01 devstack sudo[115211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_191c04b7-dce1-4319-b74d-85991b12a8fe_xeu5r854 Jun 23 16:54:01 devstack sudo[115211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:01 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:54:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:54:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:54:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:54:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:54:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:54:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:01 devstack sudo[115213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:54:01 devstack sudo[115213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:01 devstack sudo[115206]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ae7f10e0-b295-4200-8a6c-e9a4b21734f9 tempest-CreateVolumesFromSnapshotTest-525468326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-685eaefc-6cd5-4d29-b676-4594911cbfa4" returned: 0 in 0.866s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ae7f10e0-b295-4200-8a6c-e9a4b21734f9 tempest-CreateVolumesFromSnapshotTest-525468326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-685eaefc-6cd5-4d29-b676-4594911cbfa4 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:01 devstack sudo[115219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-685eaefc-6cd5-4d29-b676-4594911cbfa4 Jun 23 16:54:01 devstack sudo[115219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:01 devstack sudo[115211]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_191c04b7-dce1-4319-b74d-85991b12a8fe_xeu5r854" returned: 1 in 0.850s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_191c04b7-dce1-4319-b74d-85991b12a8fe_xeu5r854' failed. Not Retrying. {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:54:01 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9ac23b-27c1-4c66-9064-2d19ff2f7158]: (4, 'raw') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:54:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_191c04b7-dce1-4319-b74d-85991b12a8fe_dcbq2bq3devstack@QuobyteHD {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:02 devstack sudo[115223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_191c04b7-dce1-4319-b74d-85991b12a8fe_dcbq2bq3devstack@QuobyteHD Jun 23 16:54:02 devstack sudo[115223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:02 devstack sudo[115213]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.988s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:02 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:54:02 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager._thread_info {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:54:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread count: 28 {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 16:54:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread info: [<_MainThread(MainThread, started 126303828988032)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 16:54:02 devstack sudo[115219]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ae7f10e0-b295-4200-8a6c-e9a4b21734f9 tempest-CreateVolumesFromSnapshotTest-525468326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-685eaefc-6cd5-4d29-b676-4594911cbfa4" returned: 0 in 0.951s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:02 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ae7f10e0-b295-4200-8a6c-e9a4b21734f9 tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "cinder-quobyte-685eaefc-6cd5-4d29-b676-4594911cbfa4" released by "delete_volume" :: held 1.877s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:54:02 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-ae7f10e0-b295-4200-8a6c-e9a4b21734f9 tempest-CreateVolumesFromSnapshotTest-525468326 None] Created reservations ['aaba19b6-855f-40f8-944d-ac543170967b', '0aa18a1b-d69d-47e0-b449-b8e3162df9da', '1d53666e-3d3e-49c0-abdf-a501b529f06d', 'd26d8551-5d1c-48ab-8594-7dd6fa70e21e'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:54:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ae7f10e0-b295-4200-8a6c-e9a4b21734f9 tempest-CreateVolumesFromSnapshotTest-525468326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:54:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ae7f10e0-b295-4200-8a6c-e9a4b21734f9 tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:54:02 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-ae7f10e0-b295-4200-8a6c-e9a4b21734f9 tempest-CreateVolumesFromSnapshotTest-525468326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:54:02 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-ae7f10e0-b295-4200-8a6c-e9a4b21734f9 tempest-CreateVolumesFromSnapshotTest-525468326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:54:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-ae7f10e0-b295-4200-8a6c-e9a4b21734f9 tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:54:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ae7f10e0-b295-4200-8a6c-e9a4b21734f9 tempest-CreateVolumesFromSnapshotTest-525468326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:02 devstack sudo[115227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:54:02 devstack sudo[115227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:02 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-42a80f3c-b6bd-4004-9133-81f0ad69e9d4 tempest-CreateVolumesFromSnapshotTest-525468326 None] Acquiring lock "cinder-134aca79-5fb4-4d65-8aaa-76ebadcb8ae9-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:54:02 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-42a80f3c-b6bd-4004-9133-81f0ad69e9d4 tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "cinder-134aca79-5fb4-4d65-8aaa-76ebadcb8ae9-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:54:03 devstack sudo[115223]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:03 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-42a80f3c-b6bd-4004-9133-81f0ad69e9d4 tempest-CreateVolumesFromSnapshotTest-525468326 None] Acquiring lock "cinder-quobyte-134aca79-5fb4-4d65-8aaa-76ebadcb8ae9" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:54:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_191c04b7-dce1-4319-b74d-85991b12a8fe_dcbq2bq3devstack@QuobyteHD" returned: 0 in 1.147s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_191c04b7-dce1-4319-b74d-85991b12a8fe_dcbq2bq3devstack@QuobyteHD {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:03 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-42a80f3c-b6bd-4004-9133-81f0ad69e9d4 tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "cinder-quobyte-134aca79-5fb4-4d65-8aaa-76ebadcb8ae9" acquired by "delete_volume" :: waited 0.032s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:54:03 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[32110f52-995b-40ae-a6ff-99ae73c3c029]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:54:03 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-42a80f3c-b6bd-4004-9133-81f0ad69e9d4 tempest-CreateVolumesFromSnapshotTest-525468326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-134aca79-5fb4-4d65-8aaa-76ebadcb8ae9 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:03 devstack sudo[115231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_191c04b7-dce1-4319-b74d-85991b12a8fe_dcbq2bq3devstack@QuobyteHD Jun 23 16:54:03 devstack sudo[115231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:03 devstack sudo[115232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-134aca79-5fb4-4d65-8aaa-76ebadcb8ae9 Jun 23 16:54:03 devstack sudo[115232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:04 devstack sudo[115227]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ae7f10e0-b295-4200-8a6c-e9a4b21734f9 tempest-CreateVolumesFromSnapshotTest-525468326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 1.326s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:04 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-ae7f10e0-b295-4200-8a6c-e9a4b21734f9 tempest-CreateVolumesFromSnapshotTest-525468326 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:54:04 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-ae7f10e0-b295-4200-8a6c-e9a4b21734f9 tempest-CreateVolumesFromSnapshotTest-525468326 None] Deleted volume successfully. Jun 23 16:54:04 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ae7f10e0-b295-4200-8a6c-e9a4b21734f9 tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "cinder-685eaefc-6cd5-4d29-b676-4594911cbfa4-delete_volume" released by "delete_volume" :: held 3.521s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:54:04 devstack sudo[115232]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-42a80f3c-b6bd-4004-9133-81f0ad69e9d4 tempest-CreateVolumesFromSnapshotTest-525468326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-134aca79-5fb4-4d65-8aaa-76ebadcb8ae9" returned: 0 in 1.075s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-42a80f3c-b6bd-4004-9133-81f0ad69e9d4 tempest-CreateVolumesFromSnapshotTest-525468326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-134aca79-5fb4-4d65-8aaa-76ebadcb8ae9 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:04 devstack sudo[115241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-134aca79-5fb4-4d65-8aaa-76ebadcb8ae9 Jun 23 16:54:04 devstack sudo[115241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:04 devstack sudo[115231]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_191c04b7-dce1-4319-b74d-85991b12a8fe_dcbq2bq3devstack@QuobyteHD" returned: 1 in 1.344s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_191c04b7-dce1-4319-b74d-85991b12a8fe_dcbq2bq3devstack@QuobyteHD' failed. Not Retrying. {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:54:04 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] 191c04b7-dce1-4319-b74d-85991b12a8fe was raw, converting to raw {{(pid=93788) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 16:54:04 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_191c04b7-dce1-4319-b74d-85991b12a8fe_dcbq2bq3devstack@QuobyteHD /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bc933636-4ffd-46e0-bbda-1179a8f63507 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:04 devstack sudo[115245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_191c04b7-dce1-4319-b74d-85991b12a8fe_dcbq2bq3devstack@QuobyteHD /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bc933636-4ffd-46e0-bbda-1179a8f63507 Jun 23 16:54:04 devstack sudo[115245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:05 devstack sudo[115241]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-42a80f3c-b6bd-4004-9133-81f0ad69e9d4 tempest-CreateVolumesFromSnapshotTest-525468326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-134aca79-5fb4-4d65-8aaa-76ebadcb8ae9" returned: 0 in 0.861s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:05 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-42a80f3c-b6bd-4004-9133-81f0ad69e9d4 tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "cinder-quobyte-134aca79-5fb4-4d65-8aaa-76ebadcb8ae9" released by "delete_volume" :: held 2.003s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:54:05 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-42a80f3c-b6bd-4004-9133-81f0ad69e9d4 tempest-CreateVolumesFromSnapshotTest-525468326 None] Created reservations ['93fcd15d-d665-4fbd-aa38-22fd0bc533e6', '708bb000-5f8f-4b4a-ba1a-e09c9b7b4774', '75a5b564-f734-495c-b5ec-99f6a88cc88c', '23ac3a86-194e-4bd2-8e5e-f8480dad58c9'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:54:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-42a80f3c-b6bd-4004-9133-81f0ad69e9d4 tempest-CreateVolumesFromSnapshotTest-525468326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:54:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-42a80f3c-b6bd-4004-9133-81f0ad69e9d4 tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:54:05 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-42a80f3c-b6bd-4004-9133-81f0ad69e9d4 tempest-CreateVolumesFromSnapshotTest-525468326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:54:05 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-42a80f3c-b6bd-4004-9133-81f0ad69e9d4 tempest-CreateVolumesFromSnapshotTest-525468326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:54:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-42a80f3c-b6bd-4004-9133-81f0ad69e9d4 tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:54:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-42a80f3c-b6bd-4004-9133-81f0ad69e9d4 tempest-CreateVolumesFromSnapshotTest-525468326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:05 devstack sudo[115251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:54:05 devstack sudo[115251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:05 devstack sudo[115245]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_191c04b7-dce1-4319-b74d-85991b12a8fe_dcbq2bq3devstack@QuobyteHD /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bc933636-4ffd-46e0-bbda-1179a8f63507" returned: 0 in 0.955s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:05 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_191c04b7-dce1-4319-b74d-85991b12a8fe_dcbq2bq3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bc933636-4ffd-46e0-bbda-1179a8f63507 {{(pid=93788) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 16:54:05 devstack cinder-volume[93788]: INFO cinder.image.image_utils [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Converted 0.00 MB image at 0.00 MB/s Jun 23 16:54:05 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bc933636-4ffd-46e0-bbda-1179a8f63507 1G {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:05 devstack sudo[115253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bc933636-4ffd-46e0-bbda-1179a8f63507 1G Jun 23 16:54:05 devstack sudo[115253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:06 devstack sudo[115251]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-42a80f3c-b6bd-4004-9133-81f0ad69e9d4 tempest-CreateVolumesFromSnapshotTest-525468326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.750s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:06 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-42a80f3c-b6bd-4004-9133-81f0ad69e9d4 tempest-CreateVolumesFromSnapshotTest-525468326 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:54:06 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-42a80f3c-b6bd-4004-9133-81f0ad69e9d4 tempest-CreateVolumesFromSnapshotTest-525468326 None] Deleted volume successfully. Jun 23 16:54:06 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-42a80f3c-b6bd-4004-9133-81f0ad69e9d4 tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "cinder-134aca79-5fb4-4d65-8aaa-76ebadcb8ae9-delete_volume" released by "delete_volume" :: held 3.115s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:54:06 devstack sudo[115253]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bc933636-4ffd-46e0-bbda-1179a8f63507 1G" returned: 0 in 0.779s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:06 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c9cccf-0b36-4fa1-890b-5a1bcb39e7d8]: (4, 'raw') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:54:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bc933636-4ffd-46e0-bbda-1179a8f63507 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:06 devstack sudo[115259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bc933636-4ffd-46e0-bbda-1179a8f63507 Jun 23 16:54:06 devstack sudo[115259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:06 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-9d2df437-c3af-4e07-b05c-774c86b75658 tempest-CreateVolumesFromSnapshotTest-525468326 None] Acquiring lock "cinder-a8d10f8f-0e4e-4431-a364-4976dd380ee7-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:54:06 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-9d2df437-c3af-4e07-b05c-774c86b75658 tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "cinder-a8d10f8f-0e4e-4431-a364-4976dd380ee7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:54:06 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-9d2df437-c3af-4e07-b05c-774c86b75658 tempest-CreateVolumesFromSnapshotTest-525468326 None] Acquiring lock "cinder-quobyte-a8d10f8f-0e4e-4431-a364-4976dd380ee7" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:54:06 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-9d2df437-c3af-4e07-b05c-774c86b75658 tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "cinder-quobyte-a8d10f8f-0e4e-4431-a364-4976dd380ee7" acquired by "delete_volume" :: waited 0.023s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:54:06 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1ba769-4d59-4d36-bad9-076d50a44ac8]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:54:06 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-9d2df437-c3af-4e07-b05c-774c86b75658 tempest-CreateVolumesFromSnapshotTest-525468326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-a8d10f8f-0e4e-4431-a364-4976dd380ee7 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:06 devstack sudo[115261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-a8d10f8f-0e4e-4431-a364-4976dd380ee7 Jun 23 16:54:06 devstack sudo[115261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:07 devstack sudo[115259]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bc933636-4ffd-46e0-bbda-1179a8f63507" returned: 0 in 0.899s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bc933636-4ffd-46e0-bbda-1179a8f63507 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:07 devstack sudo[115265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bc933636-4ffd-46e0-bbda-1179a8f63507 Jun 23 16:54:07 devstack sudo[115265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:07 devstack sudo[115261]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-9d2df437-c3af-4e07-b05c-774c86b75658 tempest-CreateVolumesFromSnapshotTest-525468326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-a8d10f8f-0e4e-4431-a364-4976dd380ee7" returned: 0 in 0.910s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:07 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-9d2df437-c3af-4e07-b05c-774c86b75658 tempest-CreateVolumesFromSnapshotTest-525468326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-a8d10f8f-0e4e-4431-a364-4976dd380ee7 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:07 devstack sudo[115270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-a8d10f8f-0e4e-4431-a364-4976dd380ee7 Jun 23 16:54:07 devstack sudo[115270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:08 devstack sudo[115265]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bc933636-4ffd-46e0-bbda-1179a8f63507" returned: 1 in 0.927s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bc933636-4ffd-46e0-bbda-1179a8f63507' failed. Not Retrying. {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:54:08 devstack cinder-volume[93788]: DEBUG cinder.volume.volume_utils [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Downloaded image 191c04b7-dce1-4319-b74d-85991b12a8fe ((None, [{'url': 'file:///opt/stack/data/glance/images/191c04b7-dce1-4319-b74d-85991b12a8fe', 'metadata': {}}])) to volume bc933636-4ffd-46e0-bbda-1179a8f63507 successfully. {{(pid=93788) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 16:54:08 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Temporary image 191c04b7-dce1-4319-b74d-85991b12a8fe for user a88bab4a1cdd4f5385698f2acb7ebfb8 is deleted. {{(pid=93788) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 16:54:08 devstack cinder-volume[93788]: DEBUG cinder.volume.volume_utils [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Marking volume bc933636-4ffd-46e0-bbda-1179a8f63507 as bootable. {{(pid=93788) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 16:54:08 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Copying metadata from image 191c04b7-dce1-4319-b74d-85991b12a8fe to bc933636-4ffd-46e0-bbda-1179a8f63507. {{(pid=93788) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 16:54:08 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Creating volume glance metadata for volume bc933636-4ffd-46e0-bbda-1179a8f63507 backed by image 191c04b7-dce1-4319-b74d-85991b12a8fe with: {'image_id': '191c04b7-dce1-4319-b74d-85991b12a8fe', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '59730d1b9e89b38d625f82b306e58d1f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93788) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 16:54:08 devstack sudo[115270]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-9d2df437-c3af-4e07-b05c-774c86b75658 tempest-CreateVolumesFromSnapshotTest-525468326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-a8d10f8f-0e4e-4431-a364-4976dd380ee7" returned: 0 in 0.701s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:08 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-9d2df437-c3af-4e07-b05c-774c86b75658 tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "cinder-quobyte-a8d10f8f-0e4e-4431-a364-4976dd380ee7" released by "delete_volume" :: held 1.668s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:54:08 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da300036-bff0-4c41-920c-07502c93b462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc933636-4ffd-46e0-bbda-1179a8f63507', 'volume_size': 1, 'image_id': '191c04b7-dce1-4319-b74d-85991b12a8fe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/191c04b7-dce1-4319-b74d-85991b12a8fe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '59730d1b9e89b38d625f82b306e58d1f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '796d88e8b1ec487988528074de970784', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '96f6bf9ce59f13881e994dd7cbb3340b6040da91e7191d1dbbd6b6a07c47e145731772bdb0da4f24e4333fdcc433d2443584fee71a51bc9de4e20907ffa8db75', 'id': '191c04b7-dce1-4319-b74d-85991b12a8fe', 'created_at': datetime.datetime(2026, 6, 23, 14, 53, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 14, 53, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/191c04b7-dce1-4319-b74d-85991b12a8fe/file', 'properties': {}}, 'image_service': }' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:54:08 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac2d4b4c-7155-463f-b3c6-431fc3d26be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:54:08 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Volume volume-bc933636-4ffd-46e0-bbda-1179a8f63507 (bc933636-4ffd-46e0-bbda-1179a8f63507): created successfully Jun 23 16:54:08 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac2d4b4c-7155-463f-b3c6-431fc3d26be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:54:08 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Flow 'volume_create_manager' (bc765e01-5a54-4245-8bad-8141d979fbcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:54:08 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-f9ebb3b9-7277-430f-9f34-cad68f102953 tempest-VolumeImageDependencyTests-85628683 None] Created volume successfully. Jun 23 16:54:08 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-9d2df437-c3af-4e07-b05c-774c86b75658 tempest-CreateVolumesFromSnapshotTest-525468326 None] Created reservations ['d329ed53-d491-4f7e-b808-9d7da1dc5a71', '9e43d4bb-002f-4685-8216-7c055284820d', 'c83113bd-0431-4e7a-af86-91d8b10e77e9', 'a8224231-bfe7-46fc-a63a-9ae68e90fc3b'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:54:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-9d2df437-c3af-4e07-b05c-774c86b75658 tempest-CreateVolumesFromSnapshotTest-525468326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:54:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-9d2df437-c3af-4e07-b05c-774c86b75658 tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:54:08 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-9d2df437-c3af-4e07-b05c-774c86b75658 tempest-CreateVolumesFromSnapshotTest-525468326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:54:08 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-9d2df437-c3af-4e07-b05c-774c86b75658 tempest-CreateVolumesFromSnapshotTest-525468326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:54:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-9d2df437-c3af-4e07-b05c-774c86b75658 tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:54:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-9d2df437-c3af-4e07-b05c-774c86b75658 tempest-CreateVolumesFromSnapshotTest-525468326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:08 devstack sudo[115276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:54:08 devstack sudo[115276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:08 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5da9e9e-7f7c-448c-a6bf-c3819be3e153 tempest-SnapshotDependencyTests-778078912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:54:08 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5da9e9e-7f7c-448c-a6bf-c3819be3e153 tempest-SnapshotDependencyTests-778078912 None] Flow 'volume_create_manager' (5f0ac39b-0b3a-4230-bd77-e6c9be96ef72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:54:08 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5da9e9e-7f7c-448c-a6bf-c3819be3e153 tempest-SnapshotDependencyTests-778078912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ff87c2b-af76-4814-b946-89884104ed3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:54:08 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5da9e9e-7f7c-448c-a6bf-c3819be3e153 tempest-SnapshotDependencyTests-778078912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ff87c2b-af76-4814-b946-89884104ed3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:54:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1858570942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97c4d79a-969b-45c5-acdd-633a19eae7d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4ffdaa469314b28bb3f4cf06cde73d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:54:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:54:08Z,use_quota=True,user_id='2881c1b9f33846019cedd3cd49ad1ac6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:54:08 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5da9e9e-7f7c-448c-a6bf-c3819be3e153 tempest-SnapshotDependencyTests-778078912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d135dcfc-44e0-413a-a313-cbdf474dd0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:54:08 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5da9e9e-7f7c-448c-a6bf-c3819be3e153 tempest-SnapshotDependencyTests-778078912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d135dcfc-44e0-413a-a313-cbdf474dd0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:54:08 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5da9e9e-7f7c-448c-a6bf-c3819be3e153 tempest-SnapshotDependencyTests-778078912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (446d61d7-ee8d-4015-9a5e-8450c8f35478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:54:08 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5da9e9e-7f7c-448c-a6bf-c3819be3e153 tempest-SnapshotDependencyTests-778078912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (446d61d7-ee8d-4015-9a5e-8450c8f35478) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97c4d79a-969b-45c5-acdd-633a19eae7d1', 'volume_name': 'volume-97c4d79a-969b-45c5-acdd-633a19eae7d1', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:54:08 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5da9e9e-7f7c-448c-a6bf-c3819be3e153 tempest-SnapshotDependencyTests-778078912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30a200bc-28e3-4ad6-a29f-b2dc3fdf41ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:54:08 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5da9e9e-7f7c-448c-a6bf-c3819be3e153 tempest-SnapshotDependencyTests-778078912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30a200bc-28e3-4ad6-a29f-b2dc3fdf41ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:54:08 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5da9e9e-7f7c-448c-a6bf-c3819be3e153 tempest-SnapshotDependencyTests-778078912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (519d6a66-2964-4eb3-86cf-a87e9cdcb58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:54:08 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-c5da9e9e-7f7c-448c-a6bf-c3819be3e153 tempest-SnapshotDependencyTests-778078912 None] Volume 97c4d79a-969b-45c5-acdd-633a19eae7d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97c4d79a-969b-45c5-acdd-633a19eae7d1', 'volume_size': 1} Jun 23 16:54:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-c5da9e9e-7f7c-448c-a6bf-c3819be3e153 tempest-SnapshotDependencyTests-778078912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:54:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-c5da9e9e-7f7c-448c-a6bf-c3819be3e153 tempest-SnapshotDependencyTests-778078912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:54:08 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-c5da9e9e-7f7c-448c-a6bf-c3819be3e153 tempest-SnapshotDependencyTests-778078912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:54:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1858570942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97c4d79a-969b-45c5-acdd-633a19eae7d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4ffdaa469314b28bb3f4cf06cde73d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:54:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:54:08Z,use_quota=True,user_id='2881c1b9f33846019cedd3cd49ad1ac6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:54:08 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-c5da9e9e-7f7c-448c-a6bf-c3819be3e153 tempest-SnapshotDependencyTests-778078912 None] Creating volume 97c4d79a-969b-45c5-acdd-633a19eae7d1 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:54:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-c5da9e9e-7f7c-448c-a6bf-c3819be3e153 tempest-SnapshotDependencyTests-778078912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:54:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-c5da9e9e-7f7c-448c-a6bf-c3819be3e153 tempest-SnapshotDependencyTests-778078912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:54:08 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-c5da9e9e-7f7c-448c-a6bf-c3819be3e153 tempest-SnapshotDependencyTests-778078912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:54:08 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-c5da9e9e-7f7c-448c-a6bf-c3819be3e153 tempest-SnapshotDependencyTests-778078912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:54:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-c5da9e9e-7f7c-448c-a6bf-c3819be3e153 tempest-SnapshotDependencyTests-778078912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:54:08 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-c5da9e9e-7f7c-448c-a6bf-c3819be3e153 tempest-SnapshotDependencyTests-778078912 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:54:08 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-c5da9e9e-7f7c-448c-a6bf-c3819be3e153 tempest-SnapshotDependencyTests-778078912 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:54:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c5da9e9e-7f7c-448c-a6bf-c3819be3e153 tempest-SnapshotDependencyTests-778078912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:08 devstack sudo[115278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1 1073741824 Jun 23 16:54:08 devstack sudo[115278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:08 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-6b4fffb4-9c36-4174-b95a-2cb2988ffeeb tempest-CreateVolumesFromSnapshotTest-525468326 None] Acquiring lock "cinder-4af0956f-90f5-45c1-91d8-ed297c3b2bb8-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:54:08 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-6b4fffb4-9c36-4174-b95a-2cb2988ffeeb tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "cinder-4af0956f-90f5-45c1-91d8-ed297c3b2bb8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:54:08 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-6b4fffb4-9c36-4174-b95a-2cb2988ffeeb tempest-CreateVolumesFromSnapshotTest-525468326 None] Acquiring lock "cinder-quobyte-4af0956f-90f5-45c1-91d8-ed297c3b2bb8" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:54:08 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-6b4fffb4-9c36-4174-b95a-2cb2988ffeeb tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "cinder-quobyte-4af0956f-90f5-45c1-91d8-ed297c3b2bb8" acquired by "delete_volume" :: waited 0.015s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:54:08 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df8b357-80b2-4e8a-8e64-4bc6dfa2f101]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:54:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-6b4fffb4-9c36-4174-b95a-2cb2988ffeeb tempest-CreateVolumesFromSnapshotTest-525468326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4af0956f-90f5-45c1-91d8-ed297c3b2bb8 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:08 devstack sudo[115280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4af0956f-90f5-45c1-91d8-ed297c3b2bb8 Jun 23 16:54:08 devstack sudo[115280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:08 devstack sudo[115276]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:08 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-9d2df437-c3af-4e07-b05c-774c86b75658 tempest-CreateVolumesFromSnapshotTest-525468326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.673s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:08 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-9d2df437-c3af-4e07-b05c-774c86b75658 tempest-CreateVolumesFromSnapshotTest-525468326 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:54:08 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-9d2df437-c3af-4e07-b05c-774c86b75658 tempest-CreateVolumesFromSnapshotTest-525468326 None] Deleted volume successfully. Jun 23 16:54:08 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-9d2df437-c3af-4e07-b05c-774c86b75658 tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "cinder-a8d10f8f-0e4e-4431-a364-4976dd380ee7-delete_volume" released by "delete_volume" :: held 2.618s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:54:09 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-a6b6725d-df37-4032-8fa9-acf899d97163 tempest-VolumeImageDependencyTests-85628683 None] Acquiring lock "cinder-bc933636-4ffd-46e0-bbda-1179a8f63507-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:54:09 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-a6b6725d-df37-4032-8fa9-acf899d97163 tempest-VolumeImageDependencyTests-85628683 None] Lock "cinder-bc933636-4ffd-46e0-bbda-1179a8f63507-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:54:09 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-a6b6725d-df37-4032-8fa9-acf899d97163 tempest-VolumeImageDependencyTests-85628683 None] Acquiring lock "cinder-quobyte-bc933636-4ffd-46e0-bbda-1179a8f63507" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:54:09 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-a6b6725d-df37-4032-8fa9-acf899d97163 tempest-VolumeImageDependencyTests-85628683 None] Lock "cinder-quobyte-bc933636-4ffd-46e0-bbda-1179a8f63507" acquired by "delete_volume" :: waited 0.013s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:54:09 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[02925f53-1604-4a2c-9cd5-557fb07a01e9]: (4, 'raw') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:54:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a6b6725d-df37-4032-8fa9-acf899d97163 tempest-VolumeImageDependencyTests-85628683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bc933636-4ffd-46e0-bbda-1179a8f63507 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:09 devstack sudo[115286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bc933636-4ffd-46e0-bbda-1179a8f63507 Jun 23 16:54:09 devstack sudo[115286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:09 devstack sudo[115278]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c5da9e9e-7f7c-448c-a6bf-c3819be3e153 tempest-SnapshotDependencyTests-778078912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1 1073741824" returned: 0 in 0.980s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c5da9e9e-7f7c-448c-a6bf-c3819be3e153 tempest-SnapshotDependencyTests-778078912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:09 devstack sudo[115292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1 Jun 23 16:54:09 devstack sudo[115292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:09 devstack sudo[115280]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-6b4fffb4-9c36-4174-b95a-2cb2988ffeeb tempest-CreateVolumesFromSnapshotTest-525468326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4af0956f-90f5-45c1-91d8-ed297c3b2bb8" returned: 0 in 0.905s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:09 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-6b4fffb4-9c36-4174-b95a-2cb2988ffeeb tempest-CreateVolumesFromSnapshotTest-525468326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4af0956f-90f5-45c1-91d8-ed297c3b2bb8 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:09 devstack sudo[115294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4af0956f-90f5-45c1-91d8-ed297c3b2bb8 Jun 23 16:54:09 devstack sudo[115294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:10 devstack sudo[115286]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a6b6725d-df37-4032-8fa9-acf899d97163 tempest-VolumeImageDependencyTests-85628683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bc933636-4ffd-46e0-bbda-1179a8f63507" returned: 0 in 0.814s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a6b6725d-df37-4032-8fa9-acf899d97163 tempest-VolumeImageDependencyTests-85628683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bc933636-4ffd-46e0-bbda-1179a8f63507 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:10 devstack sudo[115292]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c5da9e9e-7f7c-448c-a6bf-c3819be3e153 tempest-SnapshotDependencyTests-778078912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1" returned: 0 in 0.645s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:10 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-c5da9e9e-7f7c-448c-a6bf-c3819be3e153 tempest-SnapshotDependencyTests-778078912 None] <== create_volume: return (1672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:54:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-c5da9e9e-7f7c-448c-a6bf-c3819be3e153 tempest-SnapshotDependencyTests-778078912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:54:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5da9e9e-7f7c-448c-a6bf-c3819be3e153 tempest-SnapshotDependencyTests-778078912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (519d6a66-2964-4eb3-86cf-a87e9cdcb58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97c4d79a-969b-45c5-acdd-633a19eae7d1', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:54:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5da9e9e-7f7c-448c-a6bf-c3819be3e153 tempest-SnapshotDependencyTests-778078912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbe6a8d3-32e5-4366-8ef5-47a2a009b6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:54:10 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-c5da9e9e-7f7c-448c-a6bf-c3819be3e153 tempest-SnapshotDependencyTests-778078912 None] Volume volume-97c4d79a-969b-45c5-acdd-633a19eae7d1 (97c4d79a-969b-45c5-acdd-633a19eae7d1): created successfully Jun 23 16:54:10 devstack sudo[115299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bc933636-4ffd-46e0-bbda-1179a8f63507 Jun 23 16:54:10 devstack sudo[115299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5da9e9e-7f7c-448c-a6bf-c3819be3e153 tempest-SnapshotDependencyTests-778078912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbe6a8d3-32e5-4366-8ef5-47a2a009b6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:54:10 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5da9e9e-7f7c-448c-a6bf-c3819be3e153 tempest-SnapshotDependencyTests-778078912 None] Flow 'volume_create_manager' (5f0ac39b-0b3a-4230-bd77-e6c9be96ef72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:54:10 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-c5da9e9e-7f7c-448c-a6bf-c3819be3e153 tempest-SnapshotDependencyTests-778078912 None] Created volume successfully. Jun 23 16:54:10 devstack sudo[115294]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-6b4fffb4-9c36-4174-b95a-2cb2988ffeeb tempest-CreateVolumesFromSnapshotTest-525468326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-4af0956f-90f5-45c1-91d8-ed297c3b2bb8" returned: 0 in 0.692s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:10 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-6b4fffb4-9c36-4174-b95a-2cb2988ffeeb tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "cinder-quobyte-4af0956f-90f5-45c1-91d8-ed297c3b2bb8" released by "delete_volume" :: held 1.643s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:54:10 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-6b4fffb4-9c36-4174-b95a-2cb2988ffeeb tempest-CreateVolumesFromSnapshotTest-525468326 None] Created reservations ['6646cbcb-c8df-4ef5-be51-48e02e5784a9', '8e9f65f8-3273-472d-9a1b-e007e14c87cb', '9840e0e3-0442-46f8-a2c5-8bbab744f1f8', '2febba18-df4e-449d-a0ed-03aa7f89d0d2'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:54:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-6b4fffb4-9c36-4174-b95a-2cb2988ffeeb tempest-CreateVolumesFromSnapshotTest-525468326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:54:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-6b4fffb4-9c36-4174-b95a-2cb2988ffeeb tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:54:10 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-6b4fffb4-9c36-4174-b95a-2cb2988ffeeb tempest-CreateVolumesFromSnapshotTest-525468326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:54:10 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-6b4fffb4-9c36-4174-b95a-2cb2988ffeeb tempest-CreateVolumesFromSnapshotTest-525468326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:54:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-6b4fffb4-9c36-4174-b95a-2cb2988ffeeb tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:54:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-6b4fffb4-9c36-4174-b95a-2cb2988ffeeb tempest-CreateVolumesFromSnapshotTest-525468326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:10 devstack sudo[115302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:54:10 devstack sudo[115302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5dbbea9e-37d6-4321-bd5e-4ea352c7613a tempest-SnapshotDependencyTests-778078912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:54:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5dbbea9e-37d6-4321-bd5e-4ea352c7613a tempest-SnapshotDependencyTests-778078912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:54:10 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-5dbbea9e-37d6-4321-bd5e-4ea352c7613a tempest-SnapshotDependencyTests-778078912 None] Creating offline snapshot d1a0d049-1bdf-4178-a45b-69d343c19453 of volume 97c4d79a-969b-45c5-acdd-633a19eae7d1 {{(pid=93788) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:54:10 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9edc8d8-d063-4682-ae3e-067e2468ccc6]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:54:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5dbbea9e-37d6-4321-bd5e-4ea352c7613a tempest-SnapshotDependencyTests-778078912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:10 devstack sudo[115299]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a6b6725d-df37-4032-8fa9-acf899d97163 tempest-VolumeImageDependencyTests-85628683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bc933636-4ffd-46e0-bbda-1179a8f63507" returned: 1 in 0.833s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a6b6725d-df37-4032-8fa9-acf899d97163 tempest-VolumeImageDependencyTests-85628683 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bc933636-4ffd-46e0-bbda-1179a8f63507' failed. Not Retrying. {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:54:10 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a6b6725d-df37-4032-8fa9-acf899d97163 tempest-VolumeImageDependencyTests-85628683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bc933636-4ffd-46e0-bbda-1179a8f63507 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:10 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ec1021fa-f967-46c2-9eda-3b4749039696 tempest-CreateVolumesFromSnapshotTest-525468326 None] Acquiring lock "cinder-883ad187-39eb-4266-a587-1181db5ca96e-delete_snapshot" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:54:10 devstack sudo[115308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bc933636-4ffd-46e0-bbda-1179a8f63507 Jun 23 16:54:10 devstack sudo[115308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:10 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ec1021fa-f967-46c2-9eda-3b4749039696 tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "cinder-883ad187-39eb-4266-a587-1181db5ca96e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:54:10 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ec1021fa-f967-46c2-9eda-3b4749039696 tempest-CreateVolumesFromSnapshotTest-525468326 None] Acquiring lock "cinder-quobyte-5c95eecc-9b71-4237-b60e-74ad55aeff9b" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:54:11 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ec1021fa-f967-46c2-9eda-3b4749039696 tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "cinder-quobyte-5c95eecc-9b71-4237-b60e-74ad55aeff9b" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:54:11 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ec1021fa-f967-46c2-9eda-3b4749039696 tempest-CreateVolumesFromSnapshotTest-525468326 None] Acquiring lock "cinder-quobyte-883ad187-39eb-4266-a587-1181db5ca96e" by "_delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:54:11 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ec1021fa-f967-46c2-9eda-3b4749039696 tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "cinder-quobyte-883ad187-39eb-4266-a587-1181db5ca96e" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:54:11 devstack sudo[115307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1 Jun 23 16:54:11 devstack sudo[115307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:11 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-ec1021fa-f967-46c2-9eda-3b4749039696 tempest-CreateVolumesFromSnapshotTest-525468326 None] Deleting offline snapshot 883ad187-39eb-4266-a587-1181db5ca96e of volume 5c95eecc-9b71-4237-b60e-74ad55aeff9b {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:54:11 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-ec1021fa-f967-46c2-9eda-3b4749039696 tempest-CreateVolumesFromSnapshotTest-525468326 None] snapshot_file for this snap is: volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b.883ad187-39eb-4266-a587-1181db5ca96e {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:54:11 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[096ddbf4-999f-411d-826b-99244f9f60bf]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:54:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ec1021fa-f967-46c2-9eda-3b4749039696 tempest-CreateVolumesFromSnapshotTest-525468326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b.883ad187-39eb-4266-a587-1181db5ca96e {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:11 devstack sudo[115311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b.883ad187-39eb-4266-a587-1181db5ca96e Jun 23 16:54:11 devstack sudo[115311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:11 devstack sudo[115302]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-6b4fffb4-9c36-4174-b95a-2cb2988ffeeb tempest-CreateVolumesFromSnapshotTest-525468326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.811s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:11 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-6b4fffb4-9c36-4174-b95a-2cb2988ffeeb tempest-CreateVolumesFromSnapshotTest-525468326 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:54:11 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-6b4fffb4-9c36-4174-b95a-2cb2988ffeeb tempest-CreateVolumesFromSnapshotTest-525468326 None] Deleted volume successfully. Jun 23 16:54:11 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-6b4fffb4-9c36-4174-b95a-2cb2988ffeeb tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "cinder-4af0956f-90f5-45c1-91d8-ed297c3b2bb8-delete_volume" released by "delete_volume" :: held 2.708s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:54:11 devstack sudo[115308]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a6b6725d-df37-4032-8fa9-acf899d97163 tempest-VolumeImageDependencyTests-85628683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-bc933636-4ffd-46e0-bbda-1179a8f63507" returned: 0 in 0.748s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:11 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-a6b6725d-df37-4032-8fa9-acf899d97163 tempest-VolumeImageDependencyTests-85628683 None] Lock "cinder-quobyte-bc933636-4ffd-46e0-bbda-1179a8f63507" released by "delete_volume" :: held 2.470s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:54:11 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-a6b6725d-df37-4032-8fa9-acf899d97163 tempest-VolumeImageDependencyTests-85628683 None] Created reservations ['f6403518-7674-4340-80d8-0d220bf0403e', 'ce361d06-c874-41dc-a697-50417df2262f', '94cfbfef-d1cb-4c45-afd9-12d3ac5ec93d', 'f6b78335-0d38-4684-b645-287f269675f5'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:54:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a6b6725d-df37-4032-8fa9-acf899d97163 tempest-VolumeImageDependencyTests-85628683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:54:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a6b6725d-df37-4032-8fa9-acf899d97163 tempest-VolumeImageDependencyTests-85628683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:54:11 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-a6b6725d-df37-4032-8fa9-acf899d97163 tempest-VolumeImageDependencyTests-85628683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:54:11 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-a6b6725d-df37-4032-8fa9-acf899d97163 tempest-VolumeImageDependencyTests-85628683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:54:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-a6b6725d-df37-4032-8fa9-acf899d97163 tempest-VolumeImageDependencyTests-85628683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:54:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a6b6725d-df37-4032-8fa9-acf899d97163 tempest-VolumeImageDependencyTests-85628683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:11 devstack sudo[115307]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5dbbea9e-37d6-4321-bd5e-4ea352c7613a tempest-SnapshotDependencyTests-778078912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1" returned: 0 in 0.975s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5dbbea9e-37d6-4321-bd5e-4ea352c7613a tempest-SnapshotDependencyTests-778078912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1.d1a0d049-1bdf-4178-a45b-69d343c19453 1G {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:11 devstack sudo[115320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:54:11 devstack sudo[115320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:11 devstack sudo[115321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1.d1a0d049-1bdf-4178-a45b-69d343c19453 1G Jun 23 16:54:11 devstack sudo[115321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:11 devstack sudo[115311]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:11 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ec1021fa-f967-46c2-9eda-3b4749039696 tempest-CreateVolumesFromSnapshotTest-525468326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b.883ad187-39eb-4266-a587-1181db5ca96e" returned: 0 in 0.915s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:11 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-ec1021fa-f967-46c2-9eda-3b4749039696 tempest-CreateVolumesFromSnapshotTest-525468326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:54:12 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9d4353-d021-4671-aaf7-b7fb6f7c0283]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:54:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ec1021fa-f967-46c2-9eda-3b4749039696 tempest-CreateVolumesFromSnapshotTest-525468326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:12 devstack sudo[115326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b Jun 23 16:54:12 devstack sudo[115326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:12 devstack sudo[115320]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-a6b6725d-df37-4032-8fa9-acf899d97163 tempest-VolumeImageDependencyTests-85628683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.756s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:12 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-a6b6725d-df37-4032-8fa9-acf899d97163 tempest-VolumeImageDependencyTests-85628683 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:54:12 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-a6b6725d-df37-4032-8fa9-acf899d97163 tempest-VolumeImageDependencyTests-85628683 None] Deleted volume successfully. Jun 23 16:54:12 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-a6b6725d-df37-4032-8fa9-acf899d97163 tempest-VolumeImageDependencyTests-85628683 None] Lock "cinder-bc933636-4ffd-46e0-bbda-1179a8f63507-delete_volume" released by "delete_volume" :: held 3.490s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:54:12 devstack sudo[115321]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5dbbea9e-37d6-4321-bd5e-4ea352c7613a tempest-SnapshotDependencyTests-778078912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1.d1a0d049-1bdf-4178-a45b-69d343c19453 1G" returned: 0 in 0.998s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5dbbea9e-37d6-4321-bd5e-4ea352c7613a tempest-SnapshotDependencyTests-778078912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97c4d79a-969b-45c5-acdd-633a19eae7d1 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1.d1a0d049-1bdf-4178-a45b-69d343c19453 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:12 devstack sudo[115336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97c4d79a-969b-45c5-acdd-633a19eae7d1 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1.d1a0d049-1bdf-4178-a45b-69d343c19453 Jun 23 16:54:12 devstack sudo[115336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:12 devstack sudo[115326]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ec1021fa-f967-46c2-9eda-3b4749039696 tempest-CreateVolumesFromSnapshotTest-525468326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b" returned: 0 in 0.962s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:12 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ec1021fa-f967-46c2-9eda-3b4749039696 tempest-CreateVolumesFromSnapshotTest-525468326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b.883ad187-39eb-4266-a587-1181db5ca96e {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:13 devstack sudo[115338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b.883ad187-39eb-4266-a587-1181db5ca96e Jun 23 16:54:13 devstack sudo[115338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:13 devstack sudo[115336]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5dbbea9e-37d6-4321-bd5e-4ea352c7613a tempest-SnapshotDependencyTests-778078912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97c4d79a-969b-45c5-acdd-633a19eae7d1 -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1.d1a0d049-1bdf-4178-a45b-69d343c19453" returned: 0 in 0.792s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:13 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-5dbbea9e-37d6-4321-bd5e-4ea352c7613a tempest-SnapshotDependencyTests-778078912 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1.d1a0d049-1bdf-4178-a45b-69d343c19453 is being set with open permissions: ugo+rw Jun 23 16:54:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5dbbea9e-37d6-4321-bd5e-4ea352c7613a tempest-SnapshotDependencyTests-778078912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1.d1a0d049-1bdf-4178-a45b-69d343c19453 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:13 devstack sudo[115346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1.d1a0d049-1bdf-4178-a45b-69d343c19453 Jun 23 16:54:13 devstack sudo[115346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:13 devstack sudo[115338]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ec1021fa-f967-46c2-9eda-3b4749039696 tempest-CreateVolumesFromSnapshotTest-525468326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b.883ad187-39eb-4266-a587-1181db5ca96e" returned: 0 in 0.865s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:13 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ec1021fa-f967-46c2-9eda-3b4749039696 tempest-CreateVolumesFromSnapshotTest-525468326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b.883ad187-39eb-4266-a587-1181db5ca96e {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:13 devstack sudo[115350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b.883ad187-39eb-4266-a587-1181db5ca96e Jun 23 16:54:13 devstack sudo[115350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:14 devstack sudo[115346]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5dbbea9e-37d6-4321-bd5e-4ea352c7613a tempest-SnapshotDependencyTests-778078912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1.d1a0d049-1bdf-4178-a45b-69d343c19453" returned: 0 in 0.730s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5dbbea9e-37d6-4321-bd5e-4ea352c7613a tempest-SnapshotDependencyTests-778078912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:14 devstack sudo[115355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1.info Jun 23 16:54:14 devstack sudo[115355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:14 devstack sudo[115350]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:14 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ec1021fa-f967-46c2-9eda-3b4749039696 tempest-CreateVolumesFromSnapshotTest-525468326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b.883ad187-39eb-4266-a587-1181db5ca96e" returned: 0 in 0.735s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:14 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ec1021fa-f967-46c2-9eda-3b4749039696 tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "cinder-quobyte-883ad187-39eb-4266-a587-1181db5ca96e" released by "_delete_snapshot" :: held 3.600s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:54:14 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ec1021fa-f967-46c2-9eda-3b4749039696 tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "cinder-quobyte-5c95eecc-9b71-4237-b60e-74ad55aeff9b" released by "delete_snapshot" :: held 3.635s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:54:14 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-ec1021fa-f967-46c2-9eda-3b4749039696 tempest-CreateVolumesFromSnapshotTest-525468326 None] Created reservations ['f108cb29-69af-41c3-abbd-4ea65e709f25', '60bfad80-20ae-40e5-bc18-ac939e8cc66b', '0cc150f3-9767-49ba-b648-9ba1876857bf', 'c806632c-3536-4fe6-9af5-d6fa4f520c28'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:54:14 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-ec1021fa-f967-46c2-9eda-3b4749039696 tempest-CreateVolumesFromSnapshotTest-525468326 None] Delete snapshot completed successfully. Jun 23 16:54:14 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ec1021fa-f967-46c2-9eda-3b4749039696 tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "cinder-883ad187-39eb-4266-a587-1181db5ca96e-delete_snapshot" released by "delete_snapshot" :: held 3.805s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:54:15 devstack sudo[115355]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5dbbea9e-37d6-4321-bd5e-4ea352c7613a tempest-SnapshotDependencyTests-778078912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1.info" returned: 0 in 0.704s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:15 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-5dbbea9e-37d6-4321-bd5e-4ea352c7613a tempest-SnapshotDependencyTests-778078912 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1.info is being set with open permissions: ugo+rw Jun 23 16:54:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5dbbea9e-37d6-4321-bd5e-4ea352c7613a tempest-SnapshotDependencyTests-778078912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:15 devstack sudo[115359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1.info Jun 23 16:54:15 devstack sudo[115359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:15 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d5b4f05b-c846-4e8b-bd9d-7e63586aa91c tempest-CreateVolumesFromSnapshotTest-525468326 None] Acquiring lock "cinder-5c95eecc-9b71-4237-b60e-74ad55aeff9b-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:54:15 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d5b4f05b-c846-4e8b-bd9d-7e63586aa91c tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "cinder-5c95eecc-9b71-4237-b60e-74ad55aeff9b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:54:15 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d5b4f05b-c846-4e8b-bd9d-7e63586aa91c tempest-CreateVolumesFromSnapshotTest-525468326 None] Acquiring lock "cinder-quobyte-5c95eecc-9b71-4237-b60e-74ad55aeff9b" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:54:15 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d5b4f05b-c846-4e8b-bd9d-7e63586aa91c tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "cinder-quobyte-5c95eecc-9b71-4237-b60e-74ad55aeff9b" acquired by "delete_volume" :: waited 0.018s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:54:15 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87558f7-dbe8-445a-bf06-922a98241c07]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:54:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d5b4f05b-c846-4e8b-bd9d-7e63586aa91c tempest-CreateVolumesFromSnapshotTest-525468326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:15 devstack sudo[115361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b Jun 23 16:54:15 devstack sudo[115361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:15 devstack sudo[115359]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-5dbbea9e-37d6-4321-bd5e-4ea352c7613a tempest-SnapshotDependencyTests-778078912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1.info" returned: 0 in 0.690s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:15 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-5dbbea9e-37d6-4321-bd5e-4ea352c7613a tempest-SnapshotDependencyTests-778078912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.020s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:54:15 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-5dbbea9e-37d6-4321-bd5e-4ea352c7613a tempest-SnapshotDependencyTests-778078912 None] Create snapshot completed successfully Jun 23 16:54:16 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5245ed9-6de4-4915-b6ed-8ccf3962d58a tempest-CinderUnicodeTest-1720540397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:54:16 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5245ed9-6de4-4915-b6ed-8ccf3962d58a tempest-CinderUnicodeTest-1720540397 None] Flow 'volume_create_manager' (49b30f79-9251-42ef-8ce9-799ef84adc41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:54:16 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5245ed9-6de4-4915-b6ed-8ccf3962d58a tempest-CinderUnicodeTest-1720540397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff183457-6860-4d6f-bf9b-24093f184933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:54:16 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5245ed9-6de4-4915-b6ed-8ccf3962d58a tempest-CinderUnicodeTest-1720540397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff183457-6860-4d6f-bf9b-24093f184933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5adbce70-5ff7-4f46-8a54-d9f6276c1432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23559ffde8654a53991b7dacd5c57b6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:54:16Z,use_quota=True,user_id='978c0ad0d8bd45f8b2f5628552420124',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:54:16 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5245ed9-6de4-4915-b6ed-8ccf3962d58a tempest-CinderUnicodeTest-1720540397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c80ca5b-791d-458b-b6dc-fd546e636e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:54:16 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5245ed9-6de4-4915-b6ed-8ccf3962d58a tempest-CinderUnicodeTest-1720540397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c80ca5b-791d-458b-b6dc-fd546e636e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:54:16 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5245ed9-6de4-4915-b6ed-8ccf3962d58a tempest-CinderUnicodeTest-1720540397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2a1a9e2-71b2-4dc0-b187-19f85061063a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:54:16 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5245ed9-6de4-4915-b6ed-8ccf3962d58a tempest-CinderUnicodeTest-1720540397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2a1a9e2-71b2-4dc0-b187-19f85061063a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5adbce70-5ff7-4f46-8a54-d9f6276c1432', 'volume_name': 'volume-5adbce70-5ff7-4f46-8a54-d9f6276c1432', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:54:16 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5245ed9-6de4-4915-b6ed-8ccf3962d58a tempest-CinderUnicodeTest-1720540397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8af99920-e060-4848-b18a-4a4e98ba70da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:54:16 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5245ed9-6de4-4915-b6ed-8ccf3962d58a tempest-CinderUnicodeTest-1720540397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8af99920-e060-4848-b18a-4a4e98ba70da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:54:16 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5245ed9-6de4-4915-b6ed-8ccf3962d58a tempest-CinderUnicodeTest-1720540397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aba27e17-bc05-4ad7-a541-948405f76472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:54:16 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-c5245ed9-6de4-4915-b6ed-8ccf3962d58a tempest-CinderUnicodeTest-1720540397 None] Volume 5adbce70-5ff7-4f46-8a54-d9f6276c1432: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5adbce70-5ff7-4f46-8a54-d9f6276c1432', 'volume_size': 1} Jun 23 16:54:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-c5245ed9-6de4-4915-b6ed-8ccf3962d58a tempest-CinderUnicodeTest-1720540397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:54:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-c5245ed9-6de4-4915-b6ed-8ccf3962d58a tempest-CinderUnicodeTest-1720540397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:54:16 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-c5245ed9-6de4-4915-b6ed-8ccf3962d58a tempest-CinderUnicodeTest-1720540397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5adbce70-5ff7-4f46-8a54-d9f6276c1432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23559ffde8654a53991b7dacd5c57b6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:54:16Z,use_quota=True,user_id='978c0ad0d8bd45f8b2f5628552420124',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:54:16 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-c5245ed9-6de4-4915-b6ed-8ccf3962d58a tempest-CinderUnicodeTest-1720540397 None] Creating volume 5adbce70-5ff7-4f46-8a54-d9f6276c1432 {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:54:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-c5245ed9-6de4-4915-b6ed-8ccf3962d58a tempest-CinderUnicodeTest-1720540397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:54:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-c5245ed9-6de4-4915-b6ed-8ccf3962d58a tempest-CinderUnicodeTest-1720540397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:54:16 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-c5245ed9-6de4-4915-b6ed-8ccf3962d58a tempest-CinderUnicodeTest-1720540397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:54:16 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-c5245ed9-6de4-4915-b6ed-8ccf3962d58a tempest-CinderUnicodeTest-1720540397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:54:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-c5245ed9-6de4-4915-b6ed-8ccf3962d58a tempest-CinderUnicodeTest-1720540397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:54:16 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-c5245ed9-6de4-4915-b6ed-8ccf3962d58a tempest-CinderUnicodeTest-1720540397 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:54:16 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-c5245ed9-6de4-4915-b6ed-8ccf3962d58a tempest-CinderUnicodeTest-1720540397 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:54:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c5245ed9-6de4-4915-b6ed-8ccf3962d58a tempest-CinderUnicodeTest-1720540397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5adbce70-5ff7-4f46-8a54-d9f6276c1432 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:16 devstack sudo[115367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5adbce70-5ff7-4f46-8a54-d9f6276c1432 1073741824 Jun 23 16:54:16 devstack sudo[115367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:16 devstack sudo[115361]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d5b4f05b-c846-4e8b-bd9d-7e63586aa91c tempest-CreateVolumesFromSnapshotTest-525468326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b" returned: 0 in 0.828s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d5b4f05b-c846-4e8b-bd9d-7e63586aa91c tempest-CreateVolumesFromSnapshotTest-525468326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:16 devstack sudo[115369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b Jun 23 16:54:16 devstack sudo[115369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:16 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:54:16 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] Flow 'volume_create_manager' (c60f227c-ca44-40dd-8925-46c211feacd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:54:16 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33f44974-1175-4f72-8345-1415b748ad6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:54:16 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33f44974-1175-4f72-8345-1415b748ad6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b3eb372-a779-46e3-acf2-8148157861e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4ffdaa469314b28bb3f4cf06cde73d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d1a0d049-1bdf-4178-a45b-69d343c19453,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:54:17Z,use_quota=True,user_id='2881c1b9f33846019cedd3cd49ad1ac6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:54:16 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (758687e4-9d88-464b-9f1e-52922a0e74b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:54:16 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (758687e4-9d88-464b-9f1e-52922a0e74b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:54:16 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e152b3a-bc02-4b49-9501-13c9e4de11ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:54:16 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e152b3a-bc02-4b49-9501-13c9e4de11ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9b3eb372-a779-46e3-acf2-8148157861e5', 'volume_name': 'volume-9b3eb372-a779-46e3-acf2-8148157861e5', 'volume_size': 1, 'snapshot_id': 'd1a0d049-1bdf-4178-a45b-69d343c19453'}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:54:16 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa74a8dc-5609-4453-b3c6-e1f361952e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:54:16 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa74a8dc-5609-4453-b3c6-e1f361952e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:54:16 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c54fb0dd-4ae9-42a7-a8cb-a4efdbc1956c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:54:16 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] Volume 9b3eb372-a779-46e3-acf2-8148157861e5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9b3eb372-a779-46e3-acf2-8148157861e5', 'volume_size': 1, 'snapshot_id': 'd1a0d049-1bdf-4178-a45b-69d343c19453'} Jun 23 16:54:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:54:16 devstack sudo[115369]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:16 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d5b4f05b-c846-4e8b-bd9d-7e63586aa91c tempest-CreateVolumesFromSnapshotTest-525468326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5c95eecc-9b71-4237-b60e-74ad55aeff9b" returned: 0 in 0.703s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:16 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d5b4f05b-c846-4e8b-bd9d-7e63586aa91c tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "cinder-quobyte-5c95eecc-9b71-4237-b60e-74ad55aeff9b" released by "delete_volume" :: held 1.617s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:54:17 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-d5b4f05b-c846-4e8b-bd9d-7e63586aa91c tempest-CreateVolumesFromSnapshotTest-525468326 None] Created reservations ['472b5369-9eb4-4a7e-9139-c37b010b31d1', '979899d3-91d1-44cb-95c0-0aeba4135b80', '1df6107b-dc15-4299-8ee2-3f74741d4cc4', '4d899961-9771-4134-9468-60f869204f4e'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:54:17 devstack sudo[115367]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c5245ed9-6de4-4915-b6ed-8ccf3962d58a tempest-CinderUnicodeTest-1720540397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5adbce70-5ff7-4f46-8a54-d9f6276c1432 1073741824" returned: 0 in 0.910s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c5245ed9-6de4-4915-b6ed-8ccf3962d58a tempest-CinderUnicodeTest-1720540397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5adbce70-5ff7-4f46-8a54-d9f6276c1432 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d5b4f05b-c846-4e8b-bd9d-7e63586aa91c tempest-CreateVolumesFromSnapshotTest-525468326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:54:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d5b4f05b-c846-4e8b-bd9d-7e63586aa91c tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:54:17 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-d5b4f05b-c846-4e8b-bd9d-7e63586aa91c tempest-CreateVolumesFromSnapshotTest-525468326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:54:17 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-d5b4f05b-c846-4e8b-bd9d-7e63586aa91c tempest-CreateVolumesFromSnapshotTest-525468326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:54:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-d5b4f05b-c846-4e8b-bd9d-7e63586aa91c tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:54:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d5b4f05b-c846-4e8b-bd9d-7e63586aa91c tempest-CreateVolumesFromSnapshotTest-525468326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:17 devstack sudo[115376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5adbce70-5ff7-4f46-8a54-d9f6276c1432 Jun 23 16:54:17 devstack sudo[115376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:17 devstack sudo[115377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:54:17 devstack sudo[115377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:17 devstack sudo[115376]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-c5245ed9-6de4-4915-b6ed-8ccf3962d58a tempest-CinderUnicodeTest-1720540397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5adbce70-5ff7-4f46-8a54-d9f6276c1432" returned: 0 in 0.694s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:17 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-c5245ed9-6de4-4915-b6ed-8ccf3962d58a tempest-CinderUnicodeTest-1720540397 None] <== create_volume: return (1650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:54:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-c5245ed9-6de4-4915-b6ed-8ccf3962d58a tempest-CinderUnicodeTest-1720540397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.653s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:54:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.923s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:54:17 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] Acquiring lock "cinder-quobyte-d1a0d049-1bdf-4178-a45b-69d343c19453-9b3eb372-a779-46e3-acf2-8148157861e5" by "_create_volume_from_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:54:17 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5245ed9-6de4-4915-b6ed-8ccf3962d58a tempest-CinderUnicodeTest-1720540397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aba27e17-bc05-4ad7-a541-948405f76472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5adbce70-5ff7-4f46-8a54-d9f6276c1432', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:54:17 devstack sudo[115377]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:17 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5245ed9-6de4-4915-b6ed-8ccf3962d58a tempest-CinderUnicodeTest-1720540397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8d84bf0-ae71-458f-ab8d-d1849a65f483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:54:17 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] Lock "cinder-quobyte-d1a0d049-1bdf-4178-a45b-69d343c19453-9b3eb372-a779-46e3-acf2-8148157861e5" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:54:17 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] Creating volume 9b3eb372-a779-46e3-acf2-8148157861e5 from snapshot d1a0d049-1bdf-4178-a45b-69d343c19453 {{(pid=93788) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 16:54:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:54:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:54:17 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:54:17 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:54:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:54:17 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:54:17 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] Acquiring lock "cinder-quobyte-9b3eb372-a779-46e3-acf2-8148157861e5" by "_copy_volume_from_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:54:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-d5b4f05b-c846-4e8b-bd9d-7e63586aa91c tempest-CreateVolumesFromSnapshotTest-525468326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.737s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:17 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-d5b4f05b-c846-4e8b-bd9d-7e63586aa91c tempest-CreateVolumesFromSnapshotTest-525468326 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:54:17 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-d5b4f05b-c846-4e8b-bd9d-7e63586aa91c tempest-CreateVolumesFromSnapshotTest-525468326 None] Deleted volume successfully. Jun 23 16:54:17 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-c5245ed9-6de4-4915-b6ed-8ccf3962d58a tempest-CinderUnicodeTest-1720540397 None] Volume volume-5adbce70-5ff7-4f46-8a54-d9f6276c1432 (5adbce70-5ff7-4f46-8a54-d9f6276c1432): created successfully Jun 23 16:54:17 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5245ed9-6de4-4915-b6ed-8ccf3962d58a tempest-CinderUnicodeTest-1720540397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8d84bf0-ae71-458f-ab8d-d1849a65f483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:54:17 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-c5245ed9-6de4-4915-b6ed-8ccf3962d58a tempest-CinderUnicodeTest-1720540397 None] Flow 'volume_create_manager' (49b30f79-9251-42ef-8ce9-799ef84adc41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:54:17 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] Lock "cinder-quobyte-9b3eb372-a779-46e3-acf2-8148157861e5" acquired by "_copy_volume_from_snapshot" :: waited 0.042s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:54:17 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] snapshot: d1a0d049-1bdf-4178-a45b-69d343c19453, volume: 9b3eb372-a779-46e3-acf2-8148157861e5, {{(pid=93788) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 16:54:17 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-c5245ed9-6de4-4915-b6ed-8ccf3962d58a tempest-CinderUnicodeTest-1720540397 None] Created volume successfully. Jun 23 16:54:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:54:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:54:17 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:54:17 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:54:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:54:17 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-d5b4f05b-c846-4e8b-bd9d-7e63586aa91c tempest-CreateVolumesFromSnapshotTest-525468326 None] Lock "cinder-5c95eecc-9b71-4237-b60e-74ad55aeff9b-delete_volume" released by "delete_volume" :: held 2.622s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:54:17 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b040c6-4693-42a3-a5c7-aec24abcf963]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:54:17 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1.d1a0d049-1bdf-4178-a45b-69d343c19453 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:18 devstack sudo[115382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1.d1a0d049-1bdf-4178-a45b-69d343c19453 Jun 23 16:54:18 devstack sudo[115382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:18 devstack cinder-volume[93788]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e4e57d8-115b-47df-8a19-c2cc45856e44 tempest-CinderUnicodeTest-1720540397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93788) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:54:18 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4e4e57d8-115b-47df-8a19-c2cc45856e44 tempest-CinderUnicodeTest-1720540397 None] Flow 'volume_create_manager' (5eb4398a-c04d-4e30-92ca-a8e1372d83d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:54:18 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4e4e57d8-115b-47df-8a19-c2cc45856e44 tempest-CinderUnicodeTest-1720540397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b203dae-2814-490b-a386-5249ce384589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:54:18 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4e4e57d8-115b-47df-8a19-c2cc45856e44 tempest-CinderUnicodeTest-1720540397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b203dae-2814-490b-a386-5249ce384589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:54:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-555997813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e52997c0-3cc7-4a6d-99e6-29b191b100aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23559ffde8654a53991b7dacd5c57b6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:54:19Z,use_quota=True,user_id='978c0ad0d8bd45f8b2f5628552420124',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:54:18 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4e4e57d8-115b-47df-8a19-c2cc45856e44 tempest-CinderUnicodeTest-1720540397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb6c12e9-3701-44ae-b03f-de80c271cca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:54:18 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4e4e57d8-115b-47df-8a19-c2cc45856e44 tempest-CinderUnicodeTest-1720540397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb6c12e9-3701-44ae-b03f-de80c271cca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:54:18 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4e4e57d8-115b-47df-8a19-c2cc45856e44 tempest-CinderUnicodeTest-1720540397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9395042d-edfc-48ab-ace1-5262d2fbd60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:54:18 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4e4e57d8-115b-47df-8a19-c2cc45856e44 tempest-CinderUnicodeTest-1720540397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9395042d-edfc-48ab-ace1-5262d2fbd60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e52997c0-3cc7-4a6d-99e6-29b191b100aa', 'volume_name': 'volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:54:18 devstack sudo[115382]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:18 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4e4e57d8-115b-47df-8a19-c2cc45856e44 tempest-CinderUnicodeTest-1720540397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee6b9ffe-6792-48d1-a949-98bff58fe579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:54:18 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4e4e57d8-115b-47df-8a19-c2cc45856e44 tempest-CinderUnicodeTest-1720540397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee6b9ffe-6792-48d1-a949-98bff58fe579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:54:18 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4e4e57d8-115b-47df-8a19-c2cc45856e44 tempest-CinderUnicodeTest-1720540397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b37c0620-b5b3-43b1-a650-178091535dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:54:18 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-4e4e57d8-115b-47df-8a19-c2cc45856e44 tempest-CinderUnicodeTest-1720540397 None] Volume e52997c0-3cc7-4a6d-99e6-29b191b100aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa', 'volume_size': 1} Jun 23 16:54:18 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-4e4e57d8-115b-47df-8a19-c2cc45856e44 tempest-CinderUnicodeTest-1720540397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:54:18 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1.d1a0d049-1bdf-4178-a45b-69d343c19453" returned: 0 in 0.948s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:18 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97c4d79a-969b-45c5-acdd-633a19eae7d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:54:18 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1 {{(pid=93788) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 16:54:18 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] Creating direct copy from snapshot {{(pid=93788) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 16:54:18 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e3f830-2be8-45d9-8bef-2d1ae7e5d5b1]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:54:18 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:19 devstack sudo[115387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1 Jun 23 16:54:19 devstack sudo[115387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:19 devstack sudo[115387]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:19 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1" returned: 0 in 0.812s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:19 devstack cinder-volume[93788]: DEBUG cinder.utils [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] Path /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9b3eb372-a779-46e3-acf2-8148157861e5 not found in is_blk_device check {{(pid=93788) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 16:54:19 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9b3eb372-a779-46e3-acf2-8148157861e5 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:19 devstack sudo[115394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9b3eb372-a779-46e3-acf2-8148157861e5 Jun 23 16:54:19 devstack sudo[115394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:24 devstack sudo[115394]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9b3eb372-a779-46e3-acf2-8148157861e5" returned: 0 in 4.678s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:24 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c1c1cb-f25c-4df5-81c0-3d803eb94c06]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:54:24 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:24 devstack sudo[115407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1 Jun 23 16:54:24 devstack sudo[115407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:25 devstack sudo[115407]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1" returned: 0 in 0.943s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:25 devstack cinder-volume[93788]: DEBUG cinder.image.image_utils [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] Image conversion details: src /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1, size 1024.00 MB, duration 4.68 sec, destination /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9b3eb372-a779-46e3-acf2-8148157861e5 {{(pid=93788) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 16:54:25 devstack cinder-volume[93788]: INFO cinder.image.image_utils [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] Converted 1024.00 MB image at 218.83 MB/s Jun 23 16:54:25 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9b3eb372-a779-46e3-acf2-8148157861e5 is being set with open permissions: ugo+rw Jun 23 16:54:25 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9b3eb372-a779-46e3-acf2-8148157861e5 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:25 devstack sudo[115412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9b3eb372-a779-46e3-acf2-8148157861e5 Jun 23 16:54:25 devstack sudo[115412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:26 devstack sudo[115412]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9b3eb372-a779-46e3-acf2-8148157861e5" returned: 0 in 0.655s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:26 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] Lock "cinder-quobyte-9b3eb372-a779-46e3-acf2-8148157861e5" released by "_copy_volume_from_snapshot" :: held 8.150s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:54:26 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] Lock "cinder-quobyte-d1a0d049-1bdf-4178-a45b-69d343c19453-9b3eb372-a779-46e3-acf2-8148157861e5" released by "_create_volume_from_snapshot" :: held 8.208s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:54:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.250s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:54:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-4e4e57d8-115b-47df-8a19-c2cc45856e44 tempest-CinderUnicodeTest-1720540397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.146s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:54:26 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-4e4e57d8-115b-47df-8a19-c2cc45856e44 tempest-CinderUnicodeTest-1720540397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:54:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-555997813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e52997c0-3cc7-4a6d-99e6-29b191b100aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23559ffde8654a53991b7dacd5c57b6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:54:19Z,use_quota=True,user_id='978c0ad0d8bd45f8b2f5628552420124',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d68686bb-15d5-4b78-9c41-bf5baccea3a4),volume_type_id=d68686bb-15d5-4b78-9c41-bf5baccea3a4)}" {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:54:26 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-4e4e57d8-115b-47df-8a19-c2cc45856e44 tempest-CinderUnicodeTest-1720540397 None] Creating volume e52997c0-3cc7-4a6d-99e6-29b191b100aa {{(pid=93788) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:54:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-4e4e57d8-115b-47df-8a19-c2cc45856e44 tempest-CinderUnicodeTest-1720540397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:54:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-4e4e57d8-115b-47df-8a19-c2cc45856e44 tempest-CinderUnicodeTest-1720540397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:54:26 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-4e4e57d8-115b-47df-8a19-c2cc45856e44 tempest-CinderUnicodeTest-1720540397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:54:26 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-4e4e57d8-115b-47df-8a19-c2cc45856e44 tempest-CinderUnicodeTest-1720540397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:54:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-4e4e57d8-115b-47df-8a19-c2cc45856e44 tempest-CinderUnicodeTest-1720540397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:54:26 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-4e4e57d8-115b-47df-8a19-c2cc45856e44 tempest-CinderUnicodeTest-1720540397 None] Selected osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e as target Quobyte volume. {{(pid=93788) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:54:26 devstack cinder-volume[93788]: INFO cinder.volume.drivers.remotefs [None req-4e4e57d8-115b-47df-8a19-c2cc45856e44 tempest-CinderUnicodeTest-1720540397 None] casted to osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e Jun 23 16:54:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4e4e57d8-115b-47df-8a19-c2cc45856e44 tempest-CinderUnicodeTest-1720540397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa 1073741824 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:26 devstack sudo[115415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa 1073741824 Jun 23 16:54:26 devstack sudo[115415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c54fb0dd-4ae9-42a7-a8cb-a4efdbc1956c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b3eb372-a779-46e3-acf2-8148157861e5', 'volume_size': 1, 'snapshot_id': 'd1a0d049-1bdf-4178-a45b-69d343c19453'}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:54:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beb8e29b-e03b-46c3-a1aa-f1d961526903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:54:26 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] Volume volume-9b3eb372-a779-46e3-acf2-8148157861e5 (9b3eb372-a779-46e3-acf2-8148157861e5): created successfully Jun 23 16:54:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beb8e29b-e03b-46c3-a1aa-f1d961526903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:54:26 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] Flow 'volume_create_manager' (c60f227c-ca44-40dd-8925-46c211feacd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:54:26 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-e88f43a0-d19b-4508-a312-05a1014f985d tempest-SnapshotDependencyTests-778078912 None] Created volume successfully. Jun 23 16:54:26 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-1906c417-d817-47ad-8ec0-8e5fb00c5000 tempest-SnapshotDependencyTests-778078912 None] Acquiring lock "cinder-d1a0d049-1bdf-4178-a45b-69d343c19453-delete_snapshot" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:54:26 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-1906c417-d817-47ad-8ec0-8e5fb00c5000 tempest-SnapshotDependencyTests-778078912 None] Lock "cinder-d1a0d049-1bdf-4178-a45b-69d343c19453-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:54:26 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-1906c417-d817-47ad-8ec0-8e5fb00c5000 tempest-SnapshotDependencyTests-778078912 None] Acquiring lock "cinder-quobyte-97c4d79a-969b-45c5-acdd-633a19eae7d1" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:54:26 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-1906c417-d817-47ad-8ec0-8e5fb00c5000 tempest-SnapshotDependencyTests-778078912 None] Lock "cinder-quobyte-97c4d79a-969b-45c5-acdd-633a19eae7d1" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:54:26 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-1906c417-d817-47ad-8ec0-8e5fb00c5000 tempest-SnapshotDependencyTests-778078912 None] Acquiring lock "cinder-quobyte-d1a0d049-1bdf-4178-a45b-69d343c19453" by "_delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:54:26 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-1906c417-d817-47ad-8ec0-8e5fb00c5000 tempest-SnapshotDependencyTests-778078912 None] Lock "cinder-quobyte-d1a0d049-1bdf-4178-a45b-69d343c19453" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:54:26 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-1906c417-d817-47ad-8ec0-8e5fb00c5000 tempest-SnapshotDependencyTests-778078912 None] Deleting offline snapshot d1a0d049-1bdf-4178-a45b-69d343c19453 of volume 97c4d79a-969b-45c5-acdd-633a19eae7d1 {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:54:26 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-1906c417-d817-47ad-8ec0-8e5fb00c5000 tempest-SnapshotDependencyTests-778078912 None] snapshot_file for this snap is: volume-97c4d79a-969b-45c5-acdd-633a19eae7d1.d1a0d049-1bdf-4178-a45b-69d343c19453 {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:54:26 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3bfdf01-63c8-4762-9c3c-da6a4f154c0f]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:54:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1906c417-d817-47ad-8ec0-8e5fb00c5000 tempest-SnapshotDependencyTests-778078912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1.d1a0d049-1bdf-4178-a45b-69d343c19453 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:26 devstack sudo[115420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1.d1a0d049-1bdf-4178-a45b-69d343c19453 Jun 23 16:54:26 devstack sudo[115420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:26 devstack sudo[115415]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4e4e57d8-115b-47df-8a19-c2cc45856e44 tempest-CinderUnicodeTest-1720540397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa 1073741824" returned: 0 in 0.875s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:26 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4e4e57d8-115b-47df-8a19-c2cc45856e44 tempest-CinderUnicodeTest-1720540397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:26 devstack sudo[115422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa Jun 23 16:54:26 devstack sudo[115422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:27 devstack sudo[115420]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1906c417-d817-47ad-8ec0-8e5fb00c5000 tempest-SnapshotDependencyTests-778078912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1.d1a0d049-1bdf-4178-a45b-69d343c19453" returned: 0 in 0.767s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:27 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-1906c417-d817-47ad-8ec0-8e5fb00c5000 tempest-SnapshotDependencyTests-778078912 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97c4d79a-969b-45c5-acdd-633a19eae7d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:54:27 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6dce5a-dcdc-4934-a390-c30e13850431]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:54:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1906c417-d817-47ad-8ec0-8e5fb00c5000 tempest-SnapshotDependencyTests-778078912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:27 devstack sudo[115422]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4e4e57d8-115b-47df-8a19-c2cc45856e44 tempest-CinderUnicodeTest-1720540397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa" returned: 0 in 0.637s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:27 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-4e4e57d8-115b-47df-8a19-c2cc45856e44 tempest-CinderUnicodeTest-1720540397 None] <== create_volume: return (1553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'} {{(pid=93788) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:54:27 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-4e4e57d8-115b-47df-8a19-c2cc45856e44 tempest-CinderUnicodeTest-1720540397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:54:27 devstack sudo[115427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1 Jun 23 16:54:27 devstack sudo[115427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4e4e57d8-115b-47df-8a19-c2cc45856e44 tempest-CinderUnicodeTest-1720540397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b37c0620-b5b3-43b1-a650-178091535dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa', 'volume_size': 1}' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:54:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4e4e57d8-115b-47df-8a19-c2cc45856e44 tempest-CinderUnicodeTest-1720540397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (263682de-86cb-402d-a716-2c5b8a55cbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:54:27 devstack cinder-volume[93788]: INFO cinder.volume.flows.manager.create_volume [None req-4e4e57d8-115b-47df-8a19-c2cc45856e44 tempest-CinderUnicodeTest-1720540397 None] Volume volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa (e52997c0-3cc7-4a6d-99e6-29b191b100aa): created successfully Jun 23 16:54:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4e4e57d8-115b-47df-8a19-c2cc45856e44 tempest-CinderUnicodeTest-1720540397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (263682de-86cb-402d-a716-2c5b8a55cbea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93788) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:54:27 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-4e4e57d8-115b-47df-8a19-c2cc45856e44 tempest-CinderUnicodeTest-1720540397 None] Flow 'volume_create_manager' (5eb4398a-c04d-4e30-92ca-a8e1372d83d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93788) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:54:27 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-4e4e57d8-115b-47df-8a19-c2cc45856e44 tempest-CinderUnicodeTest-1720540397 None] Created volume successfully. Jun 23 16:54:28 devstack sudo[115427]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1906c417-d817-47ad-8ec0-8e5fb00c5000 tempest-SnapshotDependencyTests-778078912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1" returned: 0 in 0.755s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1906c417-d817-47ad-8ec0-8e5fb00c5000 tempest-SnapshotDependencyTests-778078912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1.d1a0d049-1bdf-4178-a45b-69d343c19453 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:28 devstack sudo[115433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1.d1a0d049-1bdf-4178-a45b-69d343c19453 Jun 23 16:54:28 devstack sudo[115433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-4cb7bed3-71e2-46f3-9fad-0ef0510f6048 tempest-CinderUnicodeTest-1720540397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:54:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-4cb7bed3-71e2-46f3-9fad-0ef0510f6048 tempest-CinderUnicodeTest-1720540397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:54:28 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-4cb7bed3-71e2-46f3-9fad-0ef0510f6048 tempest-CinderUnicodeTest-1720540397 None] Creating offline snapshot 0d4c2bf8-45b6-4830-b1ab-77b2c4c01c50 of volume e52997c0-3cc7-4a6d-99e6-29b191b100aa {{(pid=93788) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:54:28 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf885e88-cc4b-4878-8df0-690db16035da]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:54:28 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4cb7bed3-71e2-46f3-9fad-0ef0510f6048 tempest-CinderUnicodeTest-1720540397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:28 devstack sudo[115439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa Jun 23 16:54:28 devstack sudo[115439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:29 devstack sudo[115433]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1906c417-d817-47ad-8ec0-8e5fb00c5000 tempest-SnapshotDependencyTests-778078912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1.d1a0d049-1bdf-4178-a45b-69d343c19453" returned: 0 in 0.779s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1906c417-d817-47ad-8ec0-8e5fb00c5000 tempest-SnapshotDependencyTests-778078912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1.d1a0d049-1bdf-4178-a45b-69d343c19453 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:29 devstack sudo[115441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1.d1a0d049-1bdf-4178-a45b-69d343c19453 Jun 23 16:54:29 devstack sudo[115441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:29 devstack sudo[115439]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4cb7bed3-71e2-46f3-9fad-0ef0510f6048 tempest-CinderUnicodeTest-1720540397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa" returned: 0 in 0.759s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4cb7bed3-71e2-46f3-9fad-0ef0510f6048 tempest-CinderUnicodeTest-1720540397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa.0d4c2bf8-45b6-4830-b1ab-77b2c4c01c50 1G {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:29 devstack sudo[115448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa.0d4c2bf8-45b6-4830-b1ab-77b2c4c01c50 1G Jun 23 16:54:29 devstack sudo[115448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:29 devstack sudo[115441]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:29 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-1906c417-d817-47ad-8ec0-8e5fb00c5000 tempest-SnapshotDependencyTests-778078912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1.d1a0d049-1bdf-4178-a45b-69d343c19453" returned: 0 in 0.676s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:29 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-1906c417-d817-47ad-8ec0-8e5fb00c5000 tempest-SnapshotDependencyTests-778078912 None] Lock "cinder-quobyte-d1a0d049-1bdf-4178-a45b-69d343c19453" released by "_delete_snapshot" :: held 3.087s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:54:29 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-1906c417-d817-47ad-8ec0-8e5fb00c5000 tempest-SnapshotDependencyTests-778078912 None] Lock "cinder-quobyte-97c4d79a-969b-45c5-acdd-633a19eae7d1" released by "delete_snapshot" :: held 3.116s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:54:29 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-1906c417-d817-47ad-8ec0-8e5fb00c5000 tempest-SnapshotDependencyTests-778078912 None] Created reservations ['23a88d2d-5382-4696-ac29-9c02771f98a4', '359ec569-6000-4f9c-a8fc-151b2a1e712d', '7e4ce2ba-da51-4f0d-b0ba-1005dca1e9fe', '5ce866b3-cad4-466f-a911-0fb36405e110'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:54:29 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-1906c417-d817-47ad-8ec0-8e5fb00c5000 tempest-SnapshotDependencyTests-778078912 None] Delete snapshot completed successfully. Jun 23 16:54:29 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-1906c417-d817-47ad-8ec0-8e5fb00c5000 tempest-SnapshotDependencyTests-778078912 None] Lock "cinder-d1a0d049-1bdf-4178-a45b-69d343c19453-delete_snapshot" released by "delete_snapshot" :: held 3.285s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:54:30 devstack sudo[115448]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4cb7bed3-71e2-46f3-9fad-0ef0510f6048 tempest-CinderUnicodeTest-1720540397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa.0d4c2bf8-45b6-4830-b1ab-77b2c4c01c50 1G" returned: 0 in 0.814s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4cb7bed3-71e2-46f3-9fad-0ef0510f6048 tempest-CinderUnicodeTest-1720540397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa.0d4c2bf8-45b6-4830-b1ab-77b2c4c01c50 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:30 devstack sudo[115454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa.0d4c2bf8-45b6-4830-b1ab-77b2c4c01c50 Jun 23 16:54:30 devstack sudo[115454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:30 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-076ff3a1-6a26-40f1-92bd-3bf73d8bf349 tempest-SnapshotDependencyTests-778078912 None] Acquiring lock "cinder-97c4d79a-969b-45c5-acdd-633a19eae7d1-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:54:30 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-076ff3a1-6a26-40f1-92bd-3bf73d8bf349 tempest-SnapshotDependencyTests-778078912 None] Lock "cinder-97c4d79a-969b-45c5-acdd-633a19eae7d1-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:54:30 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-076ff3a1-6a26-40f1-92bd-3bf73d8bf349 tempest-SnapshotDependencyTests-778078912 None] Acquiring lock "cinder-quobyte-97c4d79a-969b-45c5-acdd-633a19eae7d1" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:54:30 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-076ff3a1-6a26-40f1-92bd-3bf73d8bf349 tempest-SnapshotDependencyTests-778078912 None] Lock "cinder-quobyte-97c4d79a-969b-45c5-acdd-633a19eae7d1" acquired by "delete_volume" :: waited 0.019s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:54:30 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3dd033a-474e-4bee-8d89-35390e2612b1]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:54:30 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-076ff3a1-6a26-40f1-92bd-3bf73d8bf349 tempest-SnapshotDependencyTests-778078912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:31 devstack sudo[115456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1 Jun 23 16:54:31 devstack sudo[115456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:31 devstack sudo[115454]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:31 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4cb7bed3-71e2-46f3-9fad-0ef0510f6048 tempest-CinderUnicodeTest-1720540397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa -F qcow2 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa.0d4c2bf8-45b6-4830-b1ab-77b2c4c01c50" returned: 0 in 0.730s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:31 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-4cb7bed3-71e2-46f3-9fad-0ef0510f6048 tempest-CinderUnicodeTest-1720540397 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa.0d4c2bf8-45b6-4830-b1ab-77b2c4c01c50 is being set with open permissions: ugo+rw Jun 23 16:54:31 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4cb7bed3-71e2-46f3-9fad-0ef0510f6048 tempest-CinderUnicodeTest-1720540397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa.0d4c2bf8-45b6-4830-b1ab-77b2c4c01c50 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:31 devstack sudo[115461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa.0d4c2bf8-45b6-4830-b1ab-77b2c4c01c50 Jun 23 16:54:31 devstack sudo[115461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:31 devstack sudo[115456]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:31 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-076ff3a1-6a26-40f1-92bd-3bf73d8bf349 tempest-SnapshotDependencyTests-778078912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1" returned: 0 in 0.739s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:31 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-076ff3a1-6a26-40f1-92bd-3bf73d8bf349 tempest-SnapshotDependencyTests-778078912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:31 devstack sudo[115466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1 Jun 23 16:54:31 devstack sudo[115466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:31 devstack sudo[115461]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:31 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4cb7bed3-71e2-46f3-9fad-0ef0510f6048 tempest-CinderUnicodeTest-1720540397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa.0d4c2bf8-45b6-4830-b1ab-77b2c4c01c50" returned: 0 in 0.680s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:31 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4cb7bed3-71e2-46f3-9fad-0ef0510f6048 tempest-CinderUnicodeTest-1720540397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:31 devstack sudo[115469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa.info Jun 23 16:54:31 devstack sudo[115469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:32 devstack sudo[115466]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-076ff3a1-6a26-40f1-92bd-3bf73d8bf349 tempest-SnapshotDependencyTests-778078912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-97c4d79a-969b-45c5-acdd-633a19eae7d1" returned: 0 in 0.635s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:32 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-076ff3a1-6a26-40f1-92bd-3bf73d8bf349 tempest-SnapshotDependencyTests-778078912 None] Lock "cinder-quobyte-97c4d79a-969b-45c5-acdd-633a19eae7d1" released by "delete_volume" :: held 1.430s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:54:32 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-076ff3a1-6a26-40f1-92bd-3bf73d8bf349 tempest-SnapshotDependencyTests-778078912 None] Created reservations ['2d47beea-d414-43ba-8b09-823eccb181fe', '0b5c91a4-4a0c-4059-bd75-64e0091d86e2', '752b1097-fc95-43e6-bc4c-b1032621574a', 'e75f6cc3-8079-49fd-88cd-68679743c9cc'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:54:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-076ff3a1-6a26-40f1-92bd-3bf73d8bf349 tempest-SnapshotDependencyTests-778078912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:54:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-076ff3a1-6a26-40f1-92bd-3bf73d8bf349 tempest-SnapshotDependencyTests-778078912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:54:32 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-076ff3a1-6a26-40f1-92bd-3bf73d8bf349 tempest-SnapshotDependencyTests-778078912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:54:32 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-076ff3a1-6a26-40f1-92bd-3bf73d8bf349 tempest-SnapshotDependencyTests-778078912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:54:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-076ff3a1-6a26-40f1-92bd-3bf73d8bf349 tempest-SnapshotDependencyTests-778078912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:54:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-076ff3a1-6a26-40f1-92bd-3bf73d8bf349 tempest-SnapshotDependencyTests-778078912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:32 devstack sudo[115472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:54:32 devstack sudo[115472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:32 devstack sudo[115469]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4cb7bed3-71e2-46f3-9fad-0ef0510f6048 tempest-CinderUnicodeTest-1720540397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa.info" returned: 0 in 0.675s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:32 devstack cinder-volume[93788]: WARNING cinder.volume.drivers.remotefs [None req-4cb7bed3-71e2-46f3-9fad-0ef0510f6048 tempest-CinderUnicodeTest-1720540397 None] /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa.info is being set with open permissions: ugo+rw Jun 23 16:54:32 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4cb7bed3-71e2-46f3-9fad-0ef0510f6048 tempest-CinderUnicodeTest-1720540397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa.info {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:32 devstack sudo[115475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa.info Jun 23 16:54:32 devstack sudo[115475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:33 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-94f5665b-0bf3-4ec3-9749-09f0bc6b46bd tempest-SnapshotDependencyTests-778078912 None] Acquiring lock "cinder-9b3eb372-a779-46e3-acf2-8148157861e5-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:54:33 devstack sudo[115472]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:33 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-076ff3a1-6a26-40f1-92bd-3bf73d8bf349 tempest-SnapshotDependencyTests-778078912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.706s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:33 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-076ff3a1-6a26-40f1-92bd-3bf73d8bf349 tempest-SnapshotDependencyTests-778078912 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:54:33 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-94f5665b-0bf3-4ec3-9749-09f0bc6b46bd tempest-SnapshotDependencyTests-778078912 None] Lock "cinder-9b3eb372-a779-46e3-acf2-8148157861e5-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:54:33 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-076ff3a1-6a26-40f1-92bd-3bf73d8bf349 tempest-SnapshotDependencyTests-778078912 None] Deleted volume successfully. Jun 23 16:54:33 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-076ff3a1-6a26-40f1-92bd-3bf73d8bf349 tempest-SnapshotDependencyTests-778078912 None] Lock "cinder-97c4d79a-969b-45c5-acdd-633a19eae7d1-delete_volume" released by "delete_volume" :: held 2.363s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:54:33 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-94f5665b-0bf3-4ec3-9749-09f0bc6b46bd tempest-SnapshotDependencyTests-778078912 None] Acquiring lock "cinder-quobyte-9b3eb372-a779-46e3-acf2-8148157861e5" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:54:33 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-94f5665b-0bf3-4ec3-9749-09f0bc6b46bd tempest-SnapshotDependencyTests-778078912 None] Lock "cinder-quobyte-9b3eb372-a779-46e3-acf2-8148157861e5" acquired by "delete_volume" :: waited 0.014s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:54:33 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[095c08fd-af5b-4ea9-9f0a-f9c1c93a47e1]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:54:33 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-94f5665b-0bf3-4ec3-9749-09f0bc6b46bd tempest-SnapshotDependencyTests-778078912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9b3eb372-a779-46e3-acf2-8148157861e5 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:33 devstack sudo[115475]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:33 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-4cb7bed3-71e2-46f3-9fad-0ef0510f6048 tempest-CinderUnicodeTest-1720540397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa.info" returned: 0 in 0.705s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:33 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-4cb7bed3-71e2-46f3-9fad-0ef0510f6048 tempest-CinderUnicodeTest-1720540397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.464s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:54:33 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-4cb7bed3-71e2-46f3-9fad-0ef0510f6048 tempest-CinderUnicodeTest-1720540397 None] Create snapshot completed successfully Jun 23 16:54:33 devstack sudo[115479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9b3eb372-a779-46e3-acf2-8148157861e5 Jun 23 16:54:33 devstack sudo[115479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:34 devstack sudo[115479]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-94f5665b-0bf3-4ec3-9749-09f0bc6b46bd tempest-SnapshotDependencyTests-778078912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9b3eb372-a779-46e3-acf2-8148157861e5" returned: 0 in 0.781s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-94f5665b-0bf3-4ec3-9749-09f0bc6b46bd tempest-SnapshotDependencyTests-778078912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9b3eb372-a779-46e3-acf2-8148157861e5 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:34 devstack sudo[115484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9b3eb372-a779-46e3-acf2-8148157861e5 Jun 23 16:54:34 devstack sudo[115484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:34 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ce25c50a-77f8-4823-b45a-23f2327c28cd tempest-CinderUnicodeTest-1720540397 None] Acquiring lock "cinder-0d4c2bf8-45b6-4830-b1ab-77b2c4c01c50-delete_snapshot" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:54:34 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ce25c50a-77f8-4823-b45a-23f2327c28cd tempest-CinderUnicodeTest-1720540397 None] Lock "cinder-0d4c2bf8-45b6-4830-b1ab-77b2c4c01c50-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:54:34 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ce25c50a-77f8-4823-b45a-23f2327c28cd tempest-CinderUnicodeTest-1720540397 None] Acquiring lock "cinder-quobyte-e52997c0-3cc7-4a6d-99e6-29b191b100aa" by "delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:54:34 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ce25c50a-77f8-4823-b45a-23f2327c28cd tempest-CinderUnicodeTest-1720540397 None] Lock "cinder-quobyte-e52997c0-3cc7-4a6d-99e6-29b191b100aa" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:54:34 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ce25c50a-77f8-4823-b45a-23f2327c28cd tempest-CinderUnicodeTest-1720540397 None] Acquiring lock "cinder-quobyte-0d4c2bf8-45b6-4830-b1ab-77b2c4c01c50" by "_delete_snapshot" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:54:34 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ce25c50a-77f8-4823-b45a-23f2327c28cd tempest-CinderUnicodeTest-1720540397 None] Lock "cinder-quobyte-0d4c2bf8-45b6-4830-b1ab-77b2c4c01c50" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:54:34 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-ce25c50a-77f8-4823-b45a-23f2327c28cd tempest-CinderUnicodeTest-1720540397 None] Deleting offline snapshot 0d4c2bf8-45b6-4830-b1ab-77b2c4c01c50 of volume e52997c0-3cc7-4a6d-99e6-29b191b100aa {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:54:34 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-ce25c50a-77f8-4823-b45a-23f2327c28cd tempest-CinderUnicodeTest-1720540397 None] snapshot_file for this snap is: volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa.0d4c2bf8-45b6-4830-b1ab-77b2c4c01c50 {{(pid=93788) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:54:34 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[92fe6cc5-e7af-4192-81ed-5599ccbaab4d]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:54:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ce25c50a-77f8-4823-b45a-23f2327c28cd tempest-CinderUnicodeTest-1720540397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa.0d4c2bf8-45b6-4830-b1ab-77b2c4c01c50 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:34 devstack sudo[115486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa.0d4c2bf8-45b6-4830-b1ab-77b2c4c01c50 Jun 23 16:54:34 devstack sudo[115486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:34 devstack sudo[115484]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-94f5665b-0bf3-4ec3-9749-09f0bc6b46bd tempest-SnapshotDependencyTests-778078912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-9b3eb372-a779-46e3-acf2-8148157861e5" returned: 0 in 0.666s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:34 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-94f5665b-0bf3-4ec3-9749-09f0bc6b46bd tempest-SnapshotDependencyTests-778078912 None] Lock "cinder-quobyte-9b3eb372-a779-46e3-acf2-8148157861e5" released by "delete_volume" :: held 1.488s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:54:34 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-94f5665b-0bf3-4ec3-9749-09f0bc6b46bd tempest-SnapshotDependencyTests-778078912 None] Created reservations ['03045e6f-57d2-4ca6-b953-482ec72b2c65', '613b8df8-3560-4d8a-9bb9-9ba3a65dda17', 'd9b93e25-9be2-44ae-9b66-ff4e7e7dde5d', '05fc357c-c809-446d-8cbb-053b034a82b5'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:54:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-94f5665b-0bf3-4ec3-9749-09f0bc6b46bd tempest-SnapshotDependencyTests-778078912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:54:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-94f5665b-0bf3-4ec3-9749-09f0bc6b46bd tempest-SnapshotDependencyTests-778078912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:54:34 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-94f5665b-0bf3-4ec3-9749-09f0bc6b46bd tempest-SnapshotDependencyTests-778078912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:54:34 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-94f5665b-0bf3-4ec3-9749-09f0bc6b46bd tempest-SnapshotDependencyTests-778078912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:54:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-94f5665b-0bf3-4ec3-9749-09f0bc6b46bd tempest-SnapshotDependencyTests-778078912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:54:34 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-94f5665b-0bf3-4ec3-9749-09f0bc6b46bd tempest-SnapshotDependencyTests-778078912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:34 devstack sudo[115489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:54:34 devstack sudo[115489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:35 devstack sudo[115486]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ce25c50a-77f8-4823-b45a-23f2327c28cd tempest-CinderUnicodeTest-1720540397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa.0d4c2bf8-45b6-4830-b1ab-77b2c4c01c50" returned: 0 in 0.783s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:35 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.remotefs [None req-ce25c50a-77f8-4823-b45a-23f2327c28cd tempest-CinderUnicodeTest-1720540397 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93788) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:54:35 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[df11c2a7-0d78-4771-aced-e1e659fec766]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:54:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ce25c50a-77f8-4823-b45a-23f2327c28cd tempest-CinderUnicodeTest-1720540397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:35 devstack sudo[115494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa Jun 23 16:54:35 devstack sudo[115494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:35 devstack sudo[115489]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-94f5665b-0bf3-4ec3-9749-09f0bc6b46bd tempest-SnapshotDependencyTests-778078912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.685s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:35 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-94f5665b-0bf3-4ec3-9749-09f0bc6b46bd tempest-SnapshotDependencyTests-778078912 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:54:35 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-94f5665b-0bf3-4ec3-9749-09f0bc6b46bd tempest-SnapshotDependencyTests-778078912 None] Deleted volume successfully. Jun 23 16:54:35 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-94f5665b-0bf3-4ec3-9749-09f0bc6b46bd tempest-SnapshotDependencyTests-778078912 None] Lock "cinder-9b3eb372-a779-46e3-acf2-8148157861e5-delete_volume" released by "delete_volume" :: held 2.402s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:54:35 devstack sudo[115494]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ce25c50a-77f8-4823-b45a-23f2327c28cd tempest-CinderUnicodeTest-1720540397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa" returned: 0 in 0.807s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:35 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ce25c50a-77f8-4823-b45a-23f2327c28cd tempest-CinderUnicodeTest-1720540397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa.0d4c2bf8-45b6-4830-b1ab-77b2c4c01c50 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:35 devstack sudo[115501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa.0d4c2bf8-45b6-4830-b1ab-77b2c4c01c50 Jun 23 16:54:35 devstack sudo[115501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:36 devstack sudo[115501]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ce25c50a-77f8-4823-b45a-23f2327c28cd tempest-CinderUnicodeTest-1720540397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa.0d4c2bf8-45b6-4830-b1ab-77b2c4c01c50" returned: 0 in 0.782s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:36 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ce25c50a-77f8-4823-b45a-23f2327c28cd tempest-CinderUnicodeTest-1720540397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa.0d4c2bf8-45b6-4830-b1ab-77b2c4c01c50 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:36 devstack sudo[115507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa.0d4c2bf8-45b6-4830-b1ab-77b2c4c01c50 Jun 23 16:54:36 devstack sudo[115507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:37 devstack sudo[115507]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:37 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-ce25c50a-77f8-4823-b45a-23f2327c28cd tempest-CinderUnicodeTest-1720540397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa.0d4c2bf8-45b6-4830-b1ab-77b2c4c01c50" returned: 0 in 0.725s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:37 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ce25c50a-77f8-4823-b45a-23f2327c28cd tempest-CinderUnicodeTest-1720540397 None] Lock "cinder-quobyte-0d4c2bf8-45b6-4830-b1ab-77b2c4c01c50" released by "_delete_snapshot" :: held 3.231s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:54:37 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ce25c50a-77f8-4823-b45a-23f2327c28cd tempest-CinderUnicodeTest-1720540397 None] Lock "cinder-quobyte-e52997c0-3cc7-4a6d-99e6-29b191b100aa" released by "delete_snapshot" :: held 3.267s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:54:37 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-ce25c50a-77f8-4823-b45a-23f2327c28cd tempest-CinderUnicodeTest-1720540397 None] Created reservations ['2302316a-f109-4ff9-b1d8-b2d59006ea0d', 'fb7550f7-3ff4-4fbc-9e7f-5bb612789bb7', '387aa146-30eb-492e-b573-f46b87434170', '7716c133-0552-493c-a5c8-e5abdc5c0214'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:54:37 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-ce25c50a-77f8-4823-b45a-23f2327c28cd tempest-CinderUnicodeTest-1720540397 None] Delete snapshot completed successfully. Jun 23 16:54:37 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-ce25c50a-77f8-4823-b45a-23f2327c28cd tempest-CinderUnicodeTest-1720540397 None] Lock "cinder-0d4c2bf8-45b6-4830-b1ab-77b2c4c01c50-delete_snapshot" released by "delete_snapshot" :: held 3.408s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:54:38 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-790571fd-8180-44c8-aa5a-9b4bcc617d16 tempest-CinderUnicodeTest-1720540397 None] Acquiring lock "cinder-e52997c0-3cc7-4a6d-99e6-29b191b100aa-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:54:38 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-790571fd-8180-44c8-aa5a-9b4bcc617d16 tempest-CinderUnicodeTest-1720540397 None] Lock "cinder-e52997c0-3cc7-4a6d-99e6-29b191b100aa-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:54:38 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-790571fd-8180-44c8-aa5a-9b4bcc617d16 tempest-CinderUnicodeTest-1720540397 None] Acquiring lock "cinder-quobyte-e52997c0-3cc7-4a6d-99e6-29b191b100aa" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:54:38 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-790571fd-8180-44c8-aa5a-9b4bcc617d16 tempest-CinderUnicodeTest-1720540397 None] Lock "cinder-quobyte-e52997c0-3cc7-4a6d-99e6-29b191b100aa" acquired by "delete_volume" :: waited 0.013s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:54:38 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac6b35c-f43a-4b2a-8fd4-c8d13fb05738]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:54:38 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-790571fd-8180-44c8-aa5a-9b4bcc617d16 tempest-CinderUnicodeTest-1720540397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:38 devstack sudo[115512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa Jun 23 16:54:38 devstack sudo[115512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:39 devstack sudo[115512]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-790571fd-8180-44c8-aa5a-9b4bcc617d16 tempest-CinderUnicodeTest-1720540397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa" returned: 0 in 0.903s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:39 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-790571fd-8180-44c8-aa5a-9b4bcc617d16 tempest-CinderUnicodeTest-1720540397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:39 devstack sudo[115522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa Jun 23 16:54:39 devstack sudo[115522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:40 devstack sudo[115522]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-790571fd-8180-44c8-aa5a-9b4bcc617d16 tempest-CinderUnicodeTest-1720540397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-e52997c0-3cc7-4a6d-99e6-29b191b100aa" returned: 0 in 0.726s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:40 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-790571fd-8180-44c8-aa5a-9b4bcc617d16 tempest-CinderUnicodeTest-1720540397 None] Lock "cinder-quobyte-e52997c0-3cc7-4a6d-99e6-29b191b100aa" released by "delete_volume" :: held 1.688s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:54:40 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-790571fd-8180-44c8-aa5a-9b4bcc617d16 tempest-CinderUnicodeTest-1720540397 None] Created reservations ['8b11c35d-e9df-4812-af82-cda52450ecc0', '5270338a-cd03-4180-a263-f28286e59749', '9194cd5b-53ec-4dd1-a2b9-e50f7071a72d', 'c1363d13-679f-4ea7-a07d-72a86162734f'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:54:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-790571fd-8180-44c8-aa5a-9b4bcc617d16 tempest-CinderUnicodeTest-1720540397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:54:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-790571fd-8180-44c8-aa5a-9b4bcc617d16 tempest-CinderUnicodeTest-1720540397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:54:40 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-790571fd-8180-44c8-aa5a-9b4bcc617d16 tempest-CinderUnicodeTest-1720540397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:54:40 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-790571fd-8180-44c8-aa5a-9b4bcc617d16 tempest-CinderUnicodeTest-1720540397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:54:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-790571fd-8180-44c8-aa5a-9b4bcc617d16 tempest-CinderUnicodeTest-1720540397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:54:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-790571fd-8180-44c8-aa5a-9b4bcc617d16 tempest-CinderUnicodeTest-1720540397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:40 devstack sudo[115525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:54:40 devstack sudo[115525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:40 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-db6cc363-63b1-4dcd-9c61-c351e922def3 tempest-CinderUnicodeTest-1720540397 None] Acquiring lock "cinder-5adbce70-5ff7-4f46-8a54-d9f6276c1432-delete_volume" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:54:40 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-db6cc363-63b1-4dcd-9c61-c351e922def3 tempest-CinderUnicodeTest-1720540397 None] Lock "cinder-5adbce70-5ff7-4f46-8a54-d9f6276c1432-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:54:40 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-db6cc363-63b1-4dcd-9c61-c351e922def3 tempest-CinderUnicodeTest-1720540397 None] Acquiring lock "cinder-quobyte-5adbce70-5ff7-4f46-8a54-d9f6276c1432" by "delete_volume" {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:54:40 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-db6cc363-63b1-4dcd-9c61-c351e922def3 tempest-CinderUnicodeTest-1720540397 None] Lock "cinder-quobyte-5adbce70-5ff7-4f46-8a54-d9f6276c1432" acquired by "delete_volume" :: waited 0.017s {{(pid=93788) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:54:40 devstack cinder-volume[93788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2359cc63-db9f-4614-b9d3-6179033ef0d9]: (4, 'qcow2') {{(pid=95055) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:54:40 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-db6cc363-63b1-4dcd-9c61-c351e922def3 tempest-CinderUnicodeTest-1720540397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5adbce70-5ff7-4f46-8a54-d9f6276c1432 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:40 devstack sudo[115528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5adbce70-5ff7-4f46-8a54-d9f6276c1432 Jun 23 16:54:40 devstack sudo[115528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:41 devstack sudo[115525]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-790571fd-8180-44c8-aa5a-9b4bcc617d16 tempest-CinderUnicodeTest-1720540397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.736s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:41 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-790571fd-8180-44c8-aa5a-9b4bcc617d16 tempest-CinderUnicodeTest-1720540397 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:54:41 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-790571fd-8180-44c8-aa5a-9b4bcc617d16 tempest-CinderUnicodeTest-1720540397 None] Deleted volume successfully. Jun 23 16:54:41 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-790571fd-8180-44c8-aa5a-9b4bcc617d16 tempest-CinderUnicodeTest-1720540397 None] Lock "cinder-e52997c0-3cc7-4a6d-99e6-29b191b100aa-delete_volume" released by "delete_volume" :: held 2.658s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:54:41 devstack sudo[115528]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-db6cc363-63b1-4dcd-9c61-c351e922def3 tempest-CinderUnicodeTest-1720540397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5adbce70-5ff7-4f46-8a54-d9f6276c1432" returned: 0 in 0.828s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:41 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-db6cc363-63b1-4dcd-9c61-c351e922def3 tempest-CinderUnicodeTest-1720540397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5adbce70-5ff7-4f46-8a54-d9f6276c1432 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:41 devstack sudo[115534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5adbce70-5ff7-4f46-8a54-d9f6276c1432 Jun 23 16:54:41 devstack sudo[115534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:42 devstack sudo[115534]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:42 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-db6cc363-63b1-4dcd-9c61-c351e922def3 tempest-CinderUnicodeTest-1720540397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94/volume-5adbce70-5ff7-4f46-8a54-d9f6276c1432" returned: 0 in 0.723s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:42 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-db6cc363-63b1-4dcd-9c61-c351e922def3 tempest-CinderUnicodeTest-1720540397 None] Lock "cinder-quobyte-5adbce70-5ff7-4f46-8a54-d9f6276c1432" released by "delete_volume" :: held 1.590s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:54:42 devstack cinder-volume[93788]: DEBUG cinder.quota [None req-db6cc363-63b1-4dcd-9c61-c351e922def3 tempest-CinderUnicodeTest-1720540397 None] Created reservations ['a4c350f6-6d9a-4b1c-853a-2bd544c3417c', '1b5b5fac-643d-4b88-a0c1-9c2329aec9dd', '0252ed94-b455-4ef6-bc79-b2ef144cc6e9', 'da143a4a-3931-472f-9e7b-940a4c26f79a'] {{(pid=93788) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:54:42 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-db6cc363-63b1-4dcd-9c61-c351e922def3 tempest-CinderUnicodeTest-1720540397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:54:42 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-db6cc363-63b1-4dcd-9c61-c351e922def3 tempest-CinderUnicodeTest-1720540397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:54:42 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-db6cc363-63b1-4dcd-9c61-c351e922def3 tempest-CinderUnicodeTest-1720540397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:54:42 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-db6cc363-63b1-4dcd-9c61-c351e922def3 tempest-CinderUnicodeTest-1720540397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:54:42 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-db6cc363-63b1-4dcd-9c61-c351e922def3 tempest-CinderUnicodeTest-1720540397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:54:42 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-db6cc363-63b1-4dcd-9c61-c351e922def3 tempest-CinderUnicodeTest-1720540397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:54:42 devstack sudo[115538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:54:42 devstack sudo[115538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:54:43 devstack sudo[115538]: pam_unix(sudo:session): session closed for user root Jun 23 16:54:43 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-db6cc363-63b1-4dcd-9c61-c351e922def3 tempest-CinderUnicodeTest-1720540397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.735s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:54:43 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-db6cc363-63b1-4dcd-9c61-c351e922def3 tempest-CinderUnicodeTest-1720540397 None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:54:43 devstack cinder-volume[93788]: INFO cinder.volume.manager [None req-db6cc363-63b1-4dcd-9c61-c351e922def3 tempest-CinderUnicodeTest-1720540397 None] Deleted volume successfully. Jun 23 16:54:43 devstack cinder-volume[93788]: DEBUG cinder.coordination [None req-db6cc363-63b1-4dcd-9c61-c351e922def3 tempest-CinderUnicodeTest-1720540397 None] Lock "cinder-5adbce70-5ff7-4f46-8a54-d9f6276c1432-delete_volume" released by "delete_volume" :: held 2.571s {{(pid=93788) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:54:52 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:UPDATE=121,cinder:SELECT=97,cinder:INSERT=33,cinder:DELETE=8 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:54:53 devstack cinder-volume[93788]: DEBUG dbcounter [-] [93788] Writing DB stats cinder:SELECT=102,cinder:UPDATE=144,cinder:INSERT=44,cinder:DELETE=13 {{(pid=93788) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:55:01 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:55:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:55:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:55:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e': None} {{(pid=93788) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:55:01 devstack cinder-volume[93788]: DEBUG cinder.volume.drivers.quobyte [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2d0e16f-3086-4b97-9b34-46e5bd14448e'] {{(pid=93788) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:55:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.lockutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93788) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:55:01 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:55:01 devstack sudo[115859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94 Jun 23 16:55:01 devstack sudo[115859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:55:02 devstack sudo[115859]: pam_unix(sudo:session): session closed for user root Jun 23 16:55:02 devstack cinder-volume[93788]: DEBUG oslo_concurrency.processutils [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1a07c63bfb96b869f4e2863020694a94" returned: 0 in 0.628s {{(pid=93788) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:55:02 devstack cinder-volume[93788]: DEBUG cinder.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Notifying Schedulers of capabilities ... {{(pid=93788) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:55:02 devstack cinder-volume[93788]: DEBUG oslo_service.periodic_task [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] Running periodic task VolumeManager._thread_info {{(pid=93788) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:55:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread count: 28 {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 16:55:02 devstack cinder-volume[93788]: DEBUG cinder.volume.manager [None req-df9dc48b-e045-4334-810f-e422a2699515 None None] thread info: [<_MainThread(MainThread, started 126303828988032)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93788) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}